US9270982B2 - Stereoscopic image display control device, imaging apparatus including the same, and stereoscopic image display control method - Google Patents

Stereoscopic image display control device, imaging apparatus including the same, and stereoscopic image display control method Download PDF

Info

Publication number
US9270982B2
US9270982B2 US14/466,298 US201414466298A US9270982B2 US 9270982 B2 US9270982 B2 US 9270982B2 US 201414466298 A US201414466298 A US 201414466298A US 9270982 B2 US9270982 B2 US 9270982B2
Authority
US
United States
Prior art keywords
stereoscopic image
enlarged
image display
displayed
display device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US14/466,298
Other languages
English (en)
Other versions
US20140362187A1 (en
Inventor
Kenkichi Hayashi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Assigned to FUJIFILM CORPORATION reassignment FUJIFILM CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HAYASHI, KENKICHI
Publication of US20140362187A1 publication Critical patent/US20140362187A1/en
Application granted granted Critical
Publication of US9270982B2 publication Critical patent/US9270982B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H04N13/0497—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/398—Synchronisation thereof; Control thereof
    • G02B27/2214—
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/27—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving lenticular arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • H04N13/0007—
    • H04N13/0022—
    • H04N13/0029—
    • H04N13/0203—
    • H04N13/0475—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/373—Image reproducers using viewer tracking for tracking forward-backward translational head movements, i.e. longitudinal movements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/30—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving parallax barriers
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
    • H04N13/021—
    • H04N13/0239—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/211—Image signal generators using stereoscopic image cameras using a single 2D image sensor using temporal multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance

Definitions

  • the present invention relates to a stereoscopic image display control device, an imaging apparatus including the same and a stereoscopic image display control method.
  • a television receiver capable of displaying a stereoscopic image is spreading, and a digital camera (a stereoscopic image imaging apparatus) capable of photographing the stereoscopic image of a subject is showing a sign of its spread.
  • a digital camera a stereoscopic image imaging apparatus capable of photographing the stereoscopic image of a subject is showing a sign of its spread.
  • the stereoscopic image captured by such a stereoscopic image imaging apparatus is displayed on, for example, a display unit of the stereoscopic image imaging apparatus or an external display device (e.g., a large screen TV)
  • a user may want to display the displayed stereoscopic image in an enlarged scale.
  • FIG. 10 is a view illustrating an exemplary stereoscopic image.
  • a stereoscopic image 300 illustrated in FIG. 10 is constituted by right-eye images and left-eye images.
  • the right-eye images include a main subject 200 R, and a background 100 R positioned at the back of the main subject 200 R
  • the left-eye images include a main subject 200 L displayed at a position shifted with respect to the main subject 200 R by a parallax amount Po, and a background 100 L displayed at a position shifted with respect to the background 100 R by a parallax amount Pb.
  • FIG. 11 is a view illustrating the stereoscopic image 300 of FIG. 10 in an enlarged scale.
  • the parallax amount Pb and the parallax amount Po are also increased according to a magnification.
  • the parallax amount Pb and the parallax amount Po are increased to some extent, it is possible to make the stereoscopic image 300 stereoscopic without burden on, for example, eyes of an observer.
  • the parallax amount Pb and the parallax amount Po are extremely increased, the parallax of the main subject or the background becomes too large, resulting in a great burden on, for example, eyes of the observer.
  • Patent Literature 1 JP-A-20014-349736 discloses an apparatus which determines if a parallax amount of a stereoscopic image is within a stereoscopically visible parallax range, and provides, for example, an alert to a user, or adjusts the parallax amount of the stereoscopic image when determining that the parallax amount is out of the parallax range.
  • the present invention has been made by taking the above described circumstances into account, and an object thereof is to provide a stereoscopic image display control device which may reduce a burden on an observer when a stereoscopic image is enlarged, and an imaging apparatus including the same and a stereoscopic image display control method.
  • a stereoscopic image display control device of the present which causes a stereoscopic image based on a plurality of image data photographed at different viewpoints to be displayed on a stereoscopic image display device, includes: an enlargement instruction receiving unit that receives an enlargement instruction for enlarging the stereoscopic image displayed on the stereoscopic image display device; an enlargement display control unit that causes the stereoscopic image to be displayed in an enlarged scale according to the enlargement instruction on the stereoscopic image display device; and a parallax amount determination unit that determines, when the stereoscopic image is enlarged at a magnification according to the enlargement instruction, whether or not a parallax amount of the enlarged stereoscopic image displayed on the stereoscopic image display device is greater than a threshold value, in which when the enlargement instruction for enlarging the stereoscopic image at the magnification at which the parallax amount is greater than the threshold value is made, the enlargement display control unit
  • the quality of an enlarged stereoscopic image displayed on the stereoscopic image display device is not lowered by an enlargement instruction, but a burden on an observer may be reduced when a stereoscopic image is enlarged.
  • An imaging apparatus of the present invention includes: the stereoscopic image display control device; the stereoscopic image display device; an imaging unit that captures a subject; and an image processing unit that generates the plurality of image data from a plurality of image signals captured by the imaging unit.
  • a stereoscopic image display control method of the present invention for causing a stereoscopic image based on a plurality of image data photographed at different viewpoints to be displayed on a stereoscopic image display device, the method includes: an enlargement instruction receiving step of receiving an enlargement instruction for enlarging the stereoscopic image displayed on the stereoscopic image display device; an enlargement display control step of causing the stereoscopic image to be displayed in an enlarged scale according to the enlargement instruction on the stereoscopic image display device; and a parallax amount determination step of determining, when the stereoscopic image is enlarged at a magnification according to the enlargement instruction, whether or not a parallax amount of the enlarged stereoscopic image displayed on the stereoscopic image display device is greater than a threshold value, in which in the enlargement display control step, when the enlargement instruction for enlarging the stereoscopic image at the magnification at which the parallax amount is greater than
  • a stereoscopic image display control device which may reduce a burden on an observer when a stereoscopic image is enlarged, and an imaging apparatus including the same and a stereoscopic image display control method.
  • FIG. 2 is a flow chart for explaining an operation of a digital camera 1 illustrated FIG. 1 during of an enlargement operation of a stereoscopic image.
  • FIGS. 3A to 3D are views illustrating an exemplary screen displayed on a stereoscopic image display device 23 during the operation based on the flow chart illustrated in FIG. 2 .
  • FIG. 4 is a flow chart for explaining a modified example of an operation of the digital camera 1 illustrated in FIG. 1 during of an enlargement operation of a stereoscopic image.
  • FIGS. 5A to 5E are views illustrating an exemplary screen displayed on the stereoscopic image display device 23 during the operation based on the flow chart of the modified example illustrated in FIG. 4 .
  • FIG. 6 is a view illustrating a screen displayed on the stereoscopic image display device 23 in the digital camera 1 illustrated in FIG. 1 when an enlargement instruction of a stereoscopic image is received.
  • FIG. 8 is a view illustrating an external appearance of a smart phone 200 as an exemplary photographing apparatus of the present invention.
  • FIG. 9 is a block diagram illustrating the configuration of the smart phone 200 illustrated in FIG. 8 .
  • FIG. 10 is a view illustrating an exemplary stereoscopic image.
  • FIG. 1 is a view for explaining an exemplary embodiment of the present invention, which schematically illustrates a configuration of an electronic device provided with a stereoscopic image display control device.
  • the electronic device may include an imaging apparatus such as, for example, a digital camera and a digital video camera, and a cellular phone (a smart phone) and a tablet-type computer each of which is mounted with a camera.
  • an imaging apparatus such as, for example, a digital camera and a digital video camera
  • a cellular phone a smart phone
  • a tablet-type computer each of which is mounted with a camera.
  • a digital camera will be described.
  • the illustrated digital camera 1 includes an imaging unit 10 , a system control unit 11 mainly constituted by a CPU (a central processing unit; a computer), an operation unit 14 including, for example, a shutter button by which an instruction signal from a user is input to the system control unit 11 , a memory control unit 15 , a main memory 16 , a digital signal processing unit 17 , a compression/expansion processing unit 18 , an external memory control unit 20 connected to a detachable recording medium 21 , a display driver 22 , a stereoscopic image display device 23 , and a touch panel 19 .
  • a system control unit 11 mainly constituted by a CPU (a central processing unit; a computer)
  • an operation unit 14 including, for example, a shutter button by which an instruction signal from a user is input to the system control unit 11
  • a memory control unit 15 mainly constituted by a CPU (a central processing unit; a computer)
  • main memory 16 mainly constituted by a CPU (a central processing unit;
  • the imaging unit 10 may obtain a plurality of captured image signals (e.g., two captured image signals in this case) photographed at different viewpoints.
  • the imaging unit 10 includes two imaging devices arranged to be spaced apart from each other and photographing optical systems provided at front sides of the two imaging devices, respectively, and obtains two captured image signals photographed at different viewpoints from the two imaging devices through a single photographing.
  • the imaging unit 10 may include one imaging device and one photographing optical system provided at the front side of the imaging device, and may obtain two captured image signals photographed at different viewpoints from the one imaging device when photographing is performed several times by moving the imaging device and the photographing optical system.
  • the configuration of the imaging unit 10 is not limited to these configurations.
  • the imaging 10 is operated by an instruction of the system control unit 11 .
  • the main memory 16 includes an RAM used as a work memory and an ROM which stores various data, and reading, writing and erasing of data are performed under a control of the memory control unit 15 .
  • the digital signal processing unit 17 performs, for example, an interpolation operation, a gamma correction operation, or an RGB/YC conversion processing on captured image signals output from the imaging unit 10 so as to generate photographed image data.
  • Two captured image data generated by the digital signal processing unit 17 which have been obtained by photographing at different viewpoints, are associated with each other to generate stereoscopic image data.
  • the stereoscopic image data are, for example, MPO format data in accordance with a standard of Camera & Imaging Products Association (CIPA).
  • the compression/expansion processing unit 18 compresses the stereoscopic image data generated by the digital signal processing unit 17 into a JPEG format or expands the compressed image data.
  • the stereoscopic image display device 23 displays a stereoscopic image based on the stereoscopic image data (two captured image data photographed at different viewpoints).
  • the stereoscopic image display device 23 is constituted by, for example, a liquid crystal display device corresponding to, for example, a time division parallax image method, a lenticular method and a parallax barrier method.
  • the stereoscopic image display device 23 is driven by the display driver 22 .
  • the touch panel 19 is adhered on a display surface of the stereoscopic image display device 23 .
  • the touch panel 19 corresponds to a multi touch, and transmits information according to a touch operation of a user on the touch panel 19 such as, for example, coordinate information of respective contact points of two objects (for example, two fingers of the user) on a screen of the stereoscopic image display device 23 , information on presence or absence of movement from the contact points of the two objects, or coordinate information on movement destinations of the two objects, to the system control unit 11 .
  • the memory control unit 15 , the digital signal processing unit 17 , the compression/expansion processing unit 18 , the touch panel 19 , the external memory control unit 20 and the display driver 22 are connected to each other by a control bus 24 and a data bus 25 , and are controlled by commands from the system control unit 11 .
  • stereoscopic image data are generated by the digital signal processing unit 17 , and are recorded in the recording medium 21 .
  • the display driver 22 allows a stereoscopic image based on the stereoscopic image data to be displayed on the stereoscopic image display device 23 by a command of the system control unit 11 .
  • the stereoscopic image displayed on the stereoscopic image display device 23 may be enlarged by an operation of the touch panel 19 .
  • descriptions will be made on the operation of the digital camera 1 when the stereoscopic image is displayed in an enlarged scale.
  • FIG. 2 is a flow chart for explaining an operation of the digital camera 1 illustrated in FIG. 1 during of an enlargement operation of a stereoscopic image.
  • FIGS. 3A to 3D are views illustrating an exemplary screen displayed on the stereoscopic image display device 23 during the operation based on the flow chart illustrated in FIG. 2 .
  • the system control unit 11 When the digital camera 1 is set to be in a play-back mode, and the instruction of playing back stereoscopic image data recorded in the recording medium 21 is made by a user, the system control unit 11 reads the stereoscopic image data from the recording medium 21 to expand the stereoscopic image data in the main memory 16 (step S 1 ). The system control unit 11 causes a stereoscopic image based on the expanded stereoscopic image data to be displayed on the stereoscopic image display device 23 through the display driver 22 (step S 2 ).
  • a screen display of the stereoscopic image display device 23 may be the same as illustrated in FIG. 3A .
  • a stereoscopic image including a subject H is displayed on the stereoscopic image display device 23 .
  • two images photographed at different viewpoints are simultaneously displayed on the stereoscopic image display device 23 , the two images constituting the stereoscopic image.
  • FIGS. 3A to 3D illustrate the state of the image displayed on the stereoscopic image display device 23 , when viewed through the touch panel 19 .
  • a user places a forefinger Y 1 and a thumb Y 2 on free positions of the touch panel 19 . Then, coordinate information on the screen indicating respective contact positions of the forefinger Y 1 and the thumb Y 2 is transmitted from the touch panel 19 to the system control unit 11 .
  • the system control unit 11 determines, based on the information from the touch panel 19 , if an enlargement central point (a point indicating the center at enlargement of the stereoscopic image) has been appointed on the stereoscopic image being displayed on the stereoscopic image display device 23 (step S 3 ). Specifically, the system control unit 11 determines that the enlargement central point has been appointed when receiving the coordinate information of the two fingers from the touch panel 19 , and determines that the enlargement central point has not been appointed when not receiving the coordinate information of the two fingers from the touch panel 19 .
  • step S 4 the system control unit 11 , based on the coordinate information received from the touch panel 19 , sets the enlargement central point on the stereoscopic image (step S 4 ). For example, the system control unit 11 sets a middle point of coordinates of the two objects included in the coordinate information, as the enlargement central point.
  • object movement information indicating that the two fingers have been moved, respectively, and coordinate information on movement destinations of the respective two fingers are transmitted to the system control unit 11 from the touch panel 19 .
  • step S 4 the system control unit 11 determines, based on the information from the touch panel 19 , if the enlargement instruction has been made on the stereoscopic image being displayed on the stereoscopic image display device 23 (step S 5 ). Specifically, the system control unit 11 determines that the enlargement instruction has been made when receiving the object movement information and the coordinate information on movement destinations, and determines that the enlargement instruction has not been made when not receiving the object movement information and the coordinate information on movement destinations.
  • step S 5 When the determination result in step S 5 is YES, the system control unit 11 receives the enlargement instruction from the user, and calculates movement amounts of the two fingers from the coordinate information on initial positions of the two fingers received after step S 2 , and the coordinate information on movement destinations of the two fingers received after step S 4 to acquire magnification information of the stereoscopic image according to the movement amounts (step S 6 ).
  • the magnification information corresponding to the movement amounts is stored in the ROM within the main memory 16 in advance, and the system control unit 11 acquires the magnification information corresponding to the movement amounts of the fingers from the ROM.
  • the determination result in step S 5 is NO, the system control unit 11 returns the process back to step S 3 .
  • the system control unit 11 obtains a parallax amount of the enlarged stereoscopic image displayed on the stereoscopic image display device 23 .
  • the parallax amount of the enlarged stereoscopic image indicates a pixel shift amount (reference numerals Po and Pb exemplified in FIG. 11 ) in relation to a common subject included in each of two images which constitute the enlarged stereoscopic image.
  • an enlarged stereoscopic image may include a plurality of subjects.
  • a representative value of parallax amounts may be obtained as a parallax amount of the enlarged stereoscopic image.
  • a parallax amount of a main subject included in the enlarged stereoscopic image (e.g., a subject having the largest size among subjects extracted from the enlarged stereoscopic image, or a subject located at the center of the enlarged stereoscopic image) is set as a parallax amount of the enlarged stereoscopic image.
  • the largest parallax amount is set as a parallax amount of the enlarged stereoscopic image.
  • a histogram is made on parallax amounts of respective subjects included in the enlarged stereoscopic image, and a parallax amount which is the most numerous in the histogram (a peak value of the histogram) is set as a parallax amount of the enlarged stereoscopic image.
  • An average value of parallax amounts of respective subjects included in the enlarged stereoscopic image is set as a parallax amount of the enlarged stereoscopic image.
  • each subject included in the stereoscopic image appears to be present on a tubular surface of the stereoscopic image display device 23 when its parallax amount is 0, and appears to be protruded or retracted from the tubular surface when its parallax amount is increased.
  • the protrusion side and the retraction side are treated with opposite parallax amount signs (+ ⁇ ), as the largest parallax amount in the calculation method 2 (as described above), for example, a maximum value of absolute values of parallax amounts in subjects at either the protrusion side or the retraction side, or a maximum value of absolute values of parallax amounts in subjects at both sides may be used.
  • an average value of parallax amounts in subjects at either the protrusion side or the retraction side, or an average value of absolute values of parallax amounts in subjects at both sides may be used.
  • the system control unit 11 determines if the obtained parallax amount (as an absolute value irrespective of signs) is greater than a threshold value (step S 7 ).
  • the threshold value is an upper limit of a parallax amount which may provide a stereoscopic effect to some extent which does not cause a burden on eyes of the user who observes the enlarged stereoscopic image.
  • the threshold value is recorded in advance in the ROM within the main memory 16 .
  • step S 7 When the determination in step S 7 is NO, that is, when the parallax amount of the stereoscopic image after the enlargement is not greater than the threshold value, the system control unit 11 causes the stereoscopic image to be displayed on the stereoscopic image display device 23 in an enlarged scale at the magnification acquired in step S 6 (step S 8 ).
  • the state herein is illustrated in FIG. 3B .
  • the enlarged stereoscopic image is moved in a parallel manner in a direction parallel to the display screen around a region on which the enlarged stereoscopic image is displayed, while the movement amount or movement direction is changed with time.
  • the enlarged stereoscopic image displayed on the stereoscopic image display device 23 through the processing in step S 10 is displayed in vibration upward and downward, leftward and rightward, or both within the screen as illustrated in FIG. 3C .
  • the enlarged stereoscopic image may not be vibrated within the screen, but a reduced image and an enlarged image of the enlarged stereoscopic image may be displayed to be alternately repeated.
  • step S 10 is performed to allow the user recognize that the enlargement display processing according to the enlargement instruction is not being performed in consideration of a burden to eyes of the user because the parallax amount of the enlarged stereoscopic image displayed on the stereoscopic image display device 23 is greater than the threshold value.
  • the user recognizes the processing being performed by the digital camera 1 through a change in the display of the enlarged stereoscopic image itself.
  • text information such as, for example, “an enlargement display processing is stopped due to an extremely large parallax” may be displayed together with the enlarged stereoscopic image on the stereoscopic image display device 23 so that the user may recognize the processing being performed by the digital camera 1 .
  • the threshold value may be varied depending on preferences or ages of the user.
  • a plurality of types of threshold values may be recorded in the main memory 16 of the digital camera 1 .
  • the system control unit 11 may cause any one of the plurality of types of threshold values to be selected and used according to the user of the digital camera 1 .
  • a plurality of types of threshold values may be recorded in the main memory 16 according to age ranges of the user (e.g., three of age ranges such as infants younger than elementary school students, elementary and middle school students, high school students or older).
  • age information e.g., information on the user
  • the system control unit 11 acquires the input information on the user, and sets, based on the user age information included in the information on the user, a type of threshold value corresponding to an age range including the age of the user, as the threshold value to be used in the determination in step S 7 .
  • a threshold value according to a preference of the user may be selected and registered to correspond to the user information.
  • the user selects his/her own information from user information registered in advance before playing back the stereoscopic image.
  • the system control unit 11 acquires the user information, and sets a threshold value corresponding to the user information as the threshold value to be used in determination in step S 7 .
  • a threshold value according to the user may be used in determination in step S 7 so that a control according to the age or preference of the user may be possible.
  • step S 11 the system control unit 11 determines if the enlargement instruction is finished.
  • the system control unit 11 determines that the enlargement instruction is finished when receiving information indicating that a contact of at least one of the two objects has disappeared from the touch panel 19 .
  • step S 11 NO
  • step S 5 the processing in step S 5 is performed.
  • step S 11 YES
  • step S 12 the system control unit 11 determines if the processing in step S 10 is being performed.
  • the state herein is illustrated in FIG. 3D . At a point of time when the finger is released from the touch panel 19 in the state of FIG.
  • the system control unit 11 returns the process back to step S 3 after step S 13 .
  • the stereoscopic image is displayed to be gradually enlarged according to the movement of the two fingers until a magnification at which the parallax amount equals the threshold value. Then, at the magnification at which the parallax amount equals the threshold value, enlargement of the displayed image is not performed even though a further enlargement instruction is made. Accordingly, it is possible to suppress an enlarged stereoscopic image with a strong stereoscopic effect from being observed by the user, thereby reducing a burden on eyes of the user.
  • the enlarged stereoscopic image is displayed on the stereoscopic image display device 23 in a different display form from that of the stereoscopic image enlarged at a magnification at which the parallax amount is not greater than the threshold value. Accordingly, through the change of the display form of the enlarged stereoscopic image, the user may recognize that the digital camera 1 is performing a certain special processing. Accordingly, by the special processing, the user may be suppressed from misunderstanding that the stereoscopic image is not enlarged due to his/her mistake in an enlargement operation.
  • the stereoscopic image to be displayed on the stereoscopic image display device 23 is enlarged at the magnification at which parallax amount threshold value.
  • the enlarged stereoscopic image to be displayed may be enlarged at the magnification at which parallax amount ⁇ threshold value.
  • the magnification of the enlarged stereoscopic image displayed in steps S 9 and S 13 is too small, the displayed image is suddenly changed in the vicinity of a boundary where the parallax amount is greater than the threshold value.
  • the magnification is set as a value which does not cause the user to recognize the sudden change of the displayed image.
  • step S 10 when the enlarged stereoscopic image is displayed in vibration, the vibration direction of the enlarged stereoscopic image may substantially match the separation direction of the fingers of the user.
  • the system control unit 11 determines the movement direction of two objects (fingers) within the screen from initial position information of the two objects, and position information on movement destinations of the two objects in relation to initial positions, the information being received from the touch panel 19 .
  • the system control unit 11 performs, in step S 10 , a control of causing the enlarged stereoscopic image to be vibrated in the determined movement direction. In this manner, the enlarged stereoscopic image is vibrated in the separation direction of the fingers of the user.
  • a vibration direction of the enlarged stereoscopic image does not match the separation direction of the fingers of the user (for example, two directions are perpendicular to each other).
  • the system control unit 11 causes an enlarged stereoscopic image in an enlarged scale at the magnification according to the enlargement instruction to be displayed on the stereoscopic image display device 23 at least during the enlargement instruction.
  • the system control unit 11 causes the enlarged stereoscopic image in an enlarged scale at a magnification at which the parallax amount is not greater than the threshold value to be displayed on the stereoscopic image display device 23 , when the enlargement instruction is finished.
  • FIG. 4 is a flow chart for explaining the modified example of an operation of the digital camera 1 illustrated in FIG. 1 during an enlargement operation of a stereoscopic image.
  • FIGS. 5A to 5E are views illustrating an exemplary screen displayed on the stereoscopic image display device 23 during the operation based on the flow chart of the modified example illustrated in FIG. 4 .
  • the system control unit 11 determines if the enlargement instruction is finished in the same manner as in step S 11 of FIG. 2 (step S 22 ). When the enlargement instruction is not finished, the system control unit 11 returns the process back to step S 5 , and when the enlargement instruction is finished, the system control unit 11 causes the processing in step S 23 to be performed.
  • step S 23 the system control unit 11 obtains a parallax amount of the enlarged stereoscopic image being displayed on the stereoscopic image display device 23 .
  • the system control unit 11 determines if the parallax amount obtained in step S 23 is greater than the threshold value (step S 24 ).
  • step S 24 When the determination in step S 24 is NO, the system control unit 11 returns the process back to step S 3 .
  • step S 25 the system control unit 11 returns the process back to step S 3 .
  • the stereoscopic image is continuously enlarged as illustrated in FIGS. 5B and 5C even beyond the magnification at which the parallax amount equals the threshold value.
  • step S 25 of FIG. 4 the enlarged stereoscopic image to be displayed on the stereoscopic image display device 23 is switched from an enlarged stereoscopic image in an enlarged scale at a magnification to (A times) at which the parallax amount is greater than the threshold value, to an enlarged stereoscopic image in an enlarged scale at a magnification (B times) at which the parallax amount equals the threshold value
  • the system control unit 11 may gradually decrease the magnification from A times to B times (gradually change the magnification at a predetermined change rate) so that enlarged stereoscopic images at respective magnifications during the decrease of the magnification may be displayed on the stereoscopic image display device 23 .
  • the image is not suddenly switched from the state of FIG. 5D to the state of FIG. 5E , but may be smoothly switched, thereby reducing a burden on eyes of the user.
  • step S 25 of FIG. 4 After or simultaneously with step S 25 of FIG. 4 in which the enlarged stereoscopic image in an enlarged scale at the magnification at which the parallax amount equals the threshold value is displayed, information such as, for example, “an image at a decreased magnification is being displayed because the parallax becomes extremely large at the instructed magnification” which notifies the processing contents of the digital camera 1 may be displayed on the stereoscopic image display device 23 . In this manner, the user may be suppressed from misunderstanding that the stereoscopic image is not enlarged due to his/her mistake in an enlargement operation.
  • the stereoscopic image in an enlarged scale at a magnification at which the parallax amount is less than the threshold value may be displayed.
  • the system control unit 11 of the digital camera 1 may cause a frame image indicating a movement range of fingers to be displayed on the stereoscopic image display device 23 , the movement range allowing the parallax amount of the stereoscopic image displayed on the stereoscopic image display device 23 to be the threshold value or less.
  • the system control unit 11 calculates an allowable magnification at which the parallax amount equals threshold value, from the parallax amount of the stereoscopic image being displayed.
  • the system control unit 11 obtains positions to which the two fingers are moved at the allowable magnification from contact position information of the two fingers, and data of a table (recorded in the main memory 16 ) in which a movement distance of each of the two fingers in contact with the touch panel 19 is associated with a magnification of the stereoscopic image, so as to generate a frame image 60 which includes connected coordinates indicating positions to which the two fingers are moved.
  • the system control unit 11 causes the frame image 60 to be displayed on the stereoscopic image display device 23 .
  • the frame image 60 may become information that indicates the parallax amount of the stereoscopic image displayed in an enlarged scale on the stereoscopic image display device 23 is not greater than the threshold value when the positions to which the fingers are moved are within the frame, and the parallax amount of the stereoscopic image displayed in an enlarged scale on the stereoscopic image display device 23 is greater than the threshold value when the positions to which the fingers are moved are out of the frame. Since the movement amount of each of fingers corresponds to the magnification, it can be said that the frame image 60 is information that indicates an allowable magnification allowing the parallax amount to be the threshold value or less.
  • the system control unit 11 causes the frame image 60 to be displayed on the stereoscopic image display device 23 , the frame image 60 indicating the movement range of the fingers in which the parallax amount of the stereoscopic image after enlargement is not greater than the threshold value. In this manner, the user may know an extent of an enlargement operation which allows a good stereoscopic effect to be obtained, thereby improving usability.
  • the system control unit 11 may cause a frame image 70 to be displayed as illustrated in FIG. 7 .
  • the frame image 70 indicates movement positions of fingers at which the parallax amount of the stereoscopic image to be displayed in an enlarged scale on the stereoscopic image display device 23 has the most suitable value for stereoscopic vision.
  • the parallax amount which is the most suitable for stereoscopic vision may be a conventionally known value which has been empirically obtained, or an average value of the parallax amount and the threshold value of the stereoscopic image displayed on the stereoscopic image display device 23 .
  • parallax amounts as described in http://www.3dc.gr.jp/jp/scmt_wg_rep/3dc_guideJ — 20100420.pdf may be employed.
  • the system control unit 11 calculates an optimum magnification from the parallax amount of the stereoscopic image being displayed on the stereoscopic image display device 23 .
  • the optimum magnification allows the parallax amount to be an optimum value.
  • the system control unit 11 obtains positions to which the two fingers are moved at the optimum magnification from contact position information of the two fingers, and data of the above described table so as to generate the frame image 70 which includes connected coordinates indicating positions to which the two fingers are moved. Then, the system control unit 11 , as illustrated in FIG. 7 , causes the frame image 70 to be displayed on the stereoscopic image display device 23 .
  • the frame image 70 may become information that indicates the parallax amount of the stereoscopic image displayed in an enlarged scale on the stereoscopic image display device 23 is an optimum value when the positions to which the fingers are moved are on the frame. Since the movement amount of each of fingers corresponds to the magnification, it can be said that the frame image 70 is information that indicates an optimum magnification allowing the parallax amount to be the optimum value.
  • the system control unit 11 may cause the frame image 70 to be displayed on the stereoscopic image display device 23 , the frame image 70 indicating the movement positions of the fingers at which the parallax amount of the stereoscopic image after enlargement has an optimum value.
  • the user may know an extent of an enlargement which allows an optimum stereoscopic effect to be obtained, thereby improving usability.
  • both the frame image 60 and the frame image 70 are displayed, but only the frame image 70 may be displayed.
  • the display range of the stereoscopic image displayed on the stereoscopic image display device 23 becomes narrower according to the enlargement instruction. Accordingly, in a case of a stereoscopic image which includes a subject having a peripheral portion with a large parallax amount, and a central portion with a small parallax amount, when the stereoscopic image is gradually enlarged, the parallax amount of the stereoscopic image after the enlargement in an enlarged scale displayed on the stereoscopic image display device 23 is also gradually increased. Then, beyond a certain extent of a magnification, the range displayed on the stereoscopic image display device 23 may be narrowed to only the central portion of the subject, and the parallax amount may be suddenly the threshold value or less.
  • the system control unit 11 causes the enlarged stereoscopic image in an enlarged scale at a magnification which is greater than a magnification allowing the parallax amount to equal the threshold value but allows the parallax amount to be the threshold value or less to be displayed on the stereoscopic image display device 23 , instead of the enlarged stereoscopic image as illustrated in FIG. 5E .
  • a magnification which is greater than a magnification allowing the parallax amount to equal the threshold value but allows the parallax amount to be the threshold value or less to be displayed on the stereoscopic image display device 23 , instead of the enlarged stereoscopic image as illustrated in FIG. 5E .
  • the touch panel 19 is used as an interface for an enlargement instruction.
  • the interface is not limited to this.
  • the enlargement instruction of a stereoscopic image may be performed by, for example, cross keys, dial keys, or various buttons included in the operation unit 14 .
  • an allowable magnification may be displayed by text information instead of the frame image 60 illustrated in FIG. 6 .
  • an optimum magnification may be displayed by text information instead of the frame image 70 illustrated in FIG. 7 .
  • a digital camera is exemplified, but the technology described in the present exemplary embodiments may be employed in any electronic device (e.g., a television for 3D display, a smart phone, a tablet PC) mounted with a stereoscopic image display control device configured to control a stereoscopic image to be displayed on a stereoscopic image display device based on stereoscopic image data.
  • a CPU computer mounted in the electronic device performs respective steps of the flow chart illustrated in FIG. 2 or FIG. 4 so as to reduce a burden on a user who observes the stereoscopic image display device.
  • the digital camera 1 illustrated in FIG. 1 includes the stereoscopic image display device 23 mounted therein as a display destination of, for example, a stereoscopic image, but the display destination may be, for example, an external stereoscopic image display device (e.g., a television for 3D display) connected to the digital camera 1 .
  • the display destination may be, for example, an external stereoscopic image display device (e.g., a television for 3D display) connected to the digital camera 1 .
  • the above described threshold value may be varied according to a screen size of a display device on which a stereoscopic image is displayed, or a distance (a viewing distance) from the display device to a user.
  • the system control unit 11 may perform a control of decreasing the threshold value as the screen size is increased, or decreasing the threshold value as the viewing distance is decreased.
  • Information on the screen size may be acquired from the display device by the system control unit 11 , or may be input by the user.
  • viewing distance information a predetermined optimum value for each display device may be used. Otherwise, a distance measuring unit configured to measure distance from the user may be provided at the display device side.
  • FIG. 8 is a view illustrating an external appearance of a smart phone 200 as an exemplary photographing apparatus of the present invention.
  • the smart phone 200 illustrated in FIG. 8 includes a plate-shaped housing 201 , and a display input unit 204 on one-side surface of the housing 201 .
  • the display input unit 204 includes a display panel 202 as a display unit, and an operation panel 203 as an input unit, which are integrated with each other.
  • the housing 201 includes a speaker 205 , a microphone 206 , an operation unit 207 , and a camera unit 208 .
  • the configuration of the housing 201 is not limited to this. For example, it is possible to employ other configurations in which a display unit and an input unit are separate, or a folding structure or a sliding mechanism is included.
  • FIG. 9 is a block diagram illustrating the configuration of the smart phone 200 illustrated in FIG. 8 .
  • main elements of the smart phone include a wireless communication unit 210 , the display input unit 204 , a conversation unit 211 , the operation unit 207 , the camera unit 208 , a storage unit 212 , an external I/O unit 213 , a GPS (Global Positioning System) receiving unit 214 , a motion sensor unit 215 , a power supply unit 216 , and a main control unit 220 .
  • the smart phone 200 has, as a main function, a wireless communication function in which a mobile radio communication is performed through a base station device BS (not illustrated) and a mobile communication network NW (not illustrated).
  • the wireless communication unit 210 performs a radio communication in relation to the base station device BS accommodated in the mobile communication network NW under the instruction of the main control unit 220 .
  • reception and transmission of various file data such as audio data or image data, and e-mail data, and reception of web data or streaming data are performed.
  • the display input unit 204 is a so-called touch panel which displays, for example, an image (a still image or a moving image) or text information to visually provide information to a user, and at the same time, detects user information on the displayed information under the control of the main control unit 220 .
  • the display input unit 204 includes the display panel 202 and the operation panel 203 .
  • the display panel 202 uses, for example, a liquid crystal display (LCD), or an organic electro-luminescence display (OELD) as a display device.
  • LCD liquid crystal display
  • OELD organic electro-luminescence display
  • the operation panel 203 is a device which is mounted so that an image displayed on a display surface of the display panel 202 is recognizable, and detects one or more coordinates operated by a finger of a user or a stylus.
  • a detection signal generated due to the operation is output to the main control unit 220 .
  • the main control unit 220 detects an operation location (a coordinate) on the display panel 202 based on the received detection signal.
  • the display panel 202 and the operation panel 203 are integrated to constitute the display input unit 204 , in which the operation panel 203 is disposed to completely cover the display panel 202 .
  • the operation panel 203 may serve to detect a user operation even in a region outside the display panel 202 . That is, the operation panel 203 may have one region for detecting a portion overlapping the display panel 202 (hereinafter, referred to as a display region), and the other region for detecting a periphery portion not overlapping the display panel 202 (hereinafter, referred to as a non-display region).
  • the operation panel 203 may have two sensitive regions including an outer region and an inner region.
  • the width of the outer region is properly designed according to, for example, the size of the housing 201 .
  • a location detecting method for example, a matrix switch method, a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, or an electrostatic capacitance method may be employed in the operation panel 203 , or other methods may be employed.
  • the conversation unit 211 includes the speaker 205 or the microphone 206 .
  • the conversation unit 211 converts a user voice input through the microphone 206 into audio data processible in the main control unit 220 and outputs the audio data to the main control unit 220 , or decodes the audio data received by the wireless communication unit 210 or the external I/O unit 213 , and outputs the decoded audio data from the speaker 205 .
  • the speaker 205 may be mounted at the same plane as the surface where the display input unit 204 is provided, and the microphone 206 may be mounted at the side surface of the housing 201 .
  • the operation unit 207 is a hardware key using, for example, a key switch, and receives an instruction from a user.
  • the operation unit 207 is a push button-type switch mounted at the side surface of the housing 201 of the smart phone 200 , which is turned on by being pressed by, for example, a finger, and is turned off by a restoring force of, for example, a spring when the finger is released.
  • the storage unit 212 stores a control program or control data of the main control unit 220 , application software, address data corresponds to a name or a phone number of a communication partner, data of sent and received e-mail, web data downloaded through web browsing, or downloaded contents data, and temporarily stores, for example, streaming data.
  • the storage unit 212 is constituted by an internal storage unit 217 embedded within a smart phone, and an external storage unit 218 having a detachable external memory slot.
  • each of the internal storage unit 217 and the external storage unit 218 which constitute the storage unit 212 is implemented using a storage medium such as, a flash memory type memory, a hard disk type memory, a multimedia card micro type memory, a card type memory (e.g., a micro SD (registered trademark) memory), a RAM (Random Access Memory), and a ROM (Read Only Memory).
  • a storage medium such as, a flash memory type memory, a hard disk type memory, a multimedia card micro type memory, a card type memory (e.g., a micro SD (registered trademark) memory), a RAM (Random Access Memory), and a ROM (Read Only Memory).
  • the external I/O unit 213 serves as an interface with all external devices connected to the smart phone 200 , and is configured to directly or indirectly connect to other external devices through, for example, a communication (e.g., universal serial bus (USB), or IEEE1394) or a network (e.g., internet, wireless LAN, Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA) (registered trademark), Ultra Wide band (UWB) (registered trademark), ZigBee (registered trademark)).
  • a communication e.g., universal serial bus (USB), or IEEE1394
  • a network e.g., internet, wireless LAN, Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA) (registered trademark), Ultra Wide band (UWB) (registered trademark), ZigBee (registered trademark)).
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • Examples of the external devices connected to the smart phone 200 may include a wired/wireless headset, a wired/wireless external charger, a wired/wireless data port, a memory card or a SIM (Subscriber Identity Module Card)/UIM (User Identity Module Card) card connected through a card socket, an external audio/video device connected through an audio/video I/O (Input/Output) terminal, a wirelessly connected external audio/video device, a wired/wirelessly connected smart phone, a wired/wirelessly connected PC, a wired/wirelessly connected PDA, and an earphone.
  • the external I/O unit 213 may allow data transmitted from these external devices to be transmitted to each component within the smart phone 200 , or data within the smart phone 200 to be transmitted to the external devices.
  • the GPS receiving unit 214 under an instruction of the main control unit 220 , receives GPS signals transmitted from GPS satellites ST1 to STn, and executes a positioning calculation process based on the plurality of received GPS signals to detect a location of the smart phone 200 which is constituted by a latitude, a longitude, and an altitude.
  • the GPS receiving unit 214 may detect a location using position information when the position information can be acquired from the wireless communication unit 210 or the external I/O unit 213 (e.g., a wireless LAN).
  • the motion sensor unit 215 includes, for example, a three-axis acceleration sensor, and detects a physical movement of the smart phone 200 under an instruction of the main control unit 220 .
  • a direction or an acceleration of movement of the smart phone 200 is detected. This detection result is output to the main control unit 220 .
  • the power supply unit 216 under an instruction of the main control unit 220 , supplies power accumulated in a battery (not illustrated) to each unit of the smart phone 200 .
  • the main control unit 220 includes a microprocessor and operates according to a control program or control data stored in the storage unit 212 to generally control respective units of the smart phone 200 .
  • the main control unit 220 has, for example, a mobile communication control function for controlling respective units of a communication system in order to perform voice communication or data communication through the wireless communication unit 210 , and an application processing function.
  • the application processing function is implemented when the main control unit 220 is operated according to application software stored in the storage unit 212 .
  • Examples of the application processing function may include an infrared communication function for performing data communication with the opposing device by controlling the external I/O unit 213 , an e-mail function for transmitting and receiving e-mails, and a web browsing function for reading web pages.
  • the main control unit 220 also includes an image processing function such as displaying of a video on the display input unit 204 , based on image data of, for example, received data or downloaded streaming data (data of a still image or a moving image).
  • the image processing function refers to a function performed by the main control unit 220 in which the image data are decoded, and the decoded result is subjected to image processing to display an image on the display input unit 204 .
  • the main control unit 220 executes a display control on the display panel 202 , and an operation detection control for detecting a user operation through the operation unit 207 and the operation panel 203 .
  • the main control unit 220 displays an icon for starting application software, or a software key such as, for example, a scroll bar, or displays a window to write, for example, an e-mail.
  • the scroll bar refers to a software key configured to receive an instruction for moving a display portion of an image in a case, for example, a large image which, as a whole, cannot be included in the display region of the display panel 202 .
  • the main control unit 220 detects the user operation through the operation unit 207 , receives an operation on the icon, or input of a character string into an input section of the window through the operation panel 203 , or receives a scrolling requirement of a displayed image through the scroll bar.
  • the main control unit 220 has a touch panel control function so that when the operation detection control is executed, the main control unit 220 determines if an operation location on the operation panel 203 is a portion overlapping the display panel 202 (a display region), or a periphery portion not overlapping the display panel 202 (a non-display region), and controls sensitive regions of the operation panel 203 or a display location of the software key.
  • the main control unit 220 may detect a gesture operation on the operation panel 203 , and execute a predetermined function on the detected gesture operation.
  • the gesture operation does not refer to a conventional simple touch operation, but to an operation of drawing a trail by, for example, a finger, simultaneously specifying a plurality of locations, or drawing a trail for at least one from a plurality of locations by combining these two operations.
  • the camera unit 208 has the same function as the imaging unit 10 .
  • the camera unit 208 is a digital camera which electronically photographs an image by using an imaging device such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge-Coupled Device).
  • the camera unit 208 under the control of the main control unit 220 , may convert image data obtained by photographing into image data compressed in, for example, JPEG (Joint Photographic coding Experts Group) so as to store the compressed image data in the storage unit 212 , or output the compressed image data through the external I/O unit 213 or the wireless communication unit 210 .
  • JPEG Joint Photographic coding Experts Group
  • the camera unit 208 is mounted at the same plane as the surface where the display input unit 204 is provided, but the location where the camera unit 208 is mounted is not limited thereto.
  • the camera unit 208 may be mounted at the rear surface of the display input unit 204 .
  • the camera unit 208 may be used for various functions of the smart phone 200 .
  • the image obtained by the camera unit 208 may be displayed on the display panel 202 , or the image of the camera unit 208 may be used as one operation input for the operation panel 203 .
  • the GPS receiving unit 214 detects a location
  • the location may be detected by referring to the image from the camera unit 208 .
  • determination on the optical axis direction of the camera unit 208 of the smart phone 200 , or a current usage environment may be performed without using the three-axis acceleration sensor, or in conjunction with the three-axis acceleration sensor.
  • the image from the camera unit 208 may be used within the application software.
  • the image data of the still image or the moving image may be added with, for example, position information acquired by the GPS receiving unit 214 , audio information acquired by the microphone 206 (which may be converted into text information through voice-to-text conversion by, for example, the main control unit), posture information acquired by the motion sensor unit 215 so as to store the obtained image data in the storage unit 212 , or output the obtained image data through the external I/O unit 213 or the wireless communication unit 210 .
  • the main control unit 220 may perform the processing illustrated in FIGS. 2 and 4 , the processing being the same as that of the system control unit 11 of the digital camera 1 illustrated in FIG. 1 .
  • the main control unit 220 may perform the processing illustrated in FIGS. 2 and 4 , the processing being the same as that of the system control unit 11 of the digital camera 1 illustrated in FIG. 1 .
  • a stereoscopic image display control device which causes a stereoscopic image based on a plurality of image data photographed at different viewpoints to be displayed on a stereoscopic image display device, including: an enlargement instruction receiving unit that receives an enlargement instruction for enlarging the stereoscopic image displayed on the stereoscopic image display device; an enlargement display control unit that causes the stereoscopic image to be displayed in an enlarged scale according to the enlargement instruction on the stereoscopic image display device; and a parallax amount determination unit that determines, when the stereoscopic image is enlarged at a magnification according to the enlargement instruction, whether or not a parallax amount of the enlarged stereoscopic image displayed on the stereoscopic image display device is greater than a threshold value, in which when the enlargement instruction for enlarging the stereoscopic image at the magnification at which the parallax amount is greater than the threshold value is made, the enlargement display control unit
  • the enlargement display control unit stops enlargement processing according to the enlargement instruction, and causes the enlarged stereoscopic image in the enlarged scale at the magnification at which the parallax amount equals the threshold value to be displayed on the stereoscopic image display device in a display form different from a form of the stereoscopic image in the enlarged scale at the magnification at which the parallax amount is not greater than the threshold value.
  • the enlargement display control unit causes the enlarged stereoscopic image in the enlarged scale at the magnification at which the parallax amount equals the threshold value to be displayed in vibration within a screen of the stereoscopic image display device, or causes to be displayed in an enlarged scale and a reduced scale alternately and repeatedly.
  • the stereoscopic image display device includes a touch panel provided on the screen, the enlargement instruction receiving unit acquires information indicating contacts of two objects on the touch panel, respective movements from contact points of the two objects, and movement destinations of the two objects, from the touch panel, and receives the enlargement instruction based on the information, and the enlargement display control unit causes, during the enlargement instruction period, causes the enlarged stereoscopic image in the enlarged scale at the magnification at which the parallax amount equals the threshold value to be displayed in vibration within the screen of the stereoscopic image display device, and acquires a movement direction starting from the contact points of the two objects from the information so that a vibration direction of the enlarged stereoscopic image within the screen substantially matches the movement direction.
  • the enlargement display control unit when the enlargement instruction for enlarging the stereoscopic image beyond the magnification at which the parallax amount equals the threshold value is made, the enlargement display control unit causes the enlarged stereoscopic image in the enlarged scale at the magnification according to the enlargement instruction to be displayed on the stereoscopic image display device during the enlargement instruction, and causes the enlarged stereoscopic image in the enlarged scale at the magnification at which the parallax amount is not greater than the threshold value to be displayed on the stereoscopic image display device when the enlargement instruction is finished.
  • the enlargement display control unit when the enlargement instruction is finished, causes the enlarged stereoscopic image displayed on the stereoscopic image display device to be gradually reduced, and finally causes the stereoscopic image in the enlarged scale at the magnification at which the parallax amount is not greater than the threshold value to be displayed on the stereoscopic image display device.
  • the disclosed stereoscopic image display control device further includes: an observer information acquiring unit that acquires information on an observer of the stereoscopic image display device; and a threshold value setting unit that sets the threshold value according to the information on the observer acquired by the observer information acquiring unit.
  • the disclosed stereoscopic image display control device further includes: a first information display control unit that causes information indicating an allowable magnification allowing the parallax amount to be the threshold value or less to be displayed on the stereoscopic image display device.
  • the disclosed stereoscopic image display control device further includes: a second information display control unit that causes information indicating an optimum magnification allowing the parallax amount to be an optimum value for stereoscopic vision to be displayed on the stereoscopic image display device.
  • the parallax amount of the enlarged stereoscopic image is any one of a parallax amount of a main subject included in the enlarged stereoscopic image, a maximum value of parallax amounts of subjects included in the enlarged stereoscopic image, a peak value of a histogram of the parallax amounts of the subjects included in the enlarged stereoscopic image, and an average value of the parallax amounts of the subjects included in the enlarged stereoscopic image.
  • an imaging apparatus including: the stereoscopic image display control device; the stereoscopic image display device; an imaging unit that captures a subject; and an image processing unit that generates the plurality of image data from a plurality of image signals captured by the imaging unit.
  • a stereoscopic image display control method for causing a stereoscopic image based on a plurality of image data photographed at different viewpoints to be displayed on a stereoscopic image display device, the method including: an enlargement instruction receiving step of receiving an enlargement instruction for enlarging the stereoscopic image displayed on the stereoscopic image display device; an enlargement display control step of causing the stereoscopic image to be displayed in an enlarged scale according to the enlargement instruction on the stereoscopic image display device; and a parallax amount determination step of determining, when the stereoscopic image is enlarged at a magnification according to the enlargement instruction, whether or not a parallax amount of the enlarged stereoscopic image displayed on the stereoscopic image display device is greater than a threshold value, in which in the enlargement display control step, when the enlargement instruction for enlarging the stereoscopic image at the magnification at which the parallax amount is greater than the
  • the present invention may be effectively applicable to, for example, a digital camera or a TV.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Architecture (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Studio Devices (AREA)
US14/466,298 2012-02-23 2014-08-22 Stereoscopic image display control device, imaging apparatus including the same, and stereoscopic image display control method Active US9270982B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2012037646 2012-02-23
JP2012-037646 2012-02-23
PCT/JP2012/081150 WO2013125122A1 (ja) 2012-02-23 2012-11-30 立体画像表示制御装置、これを備える撮像装置、及び立体画像表示制御方法

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/081150 Continuation WO2013125122A1 (ja) 2012-02-23 2012-11-30 立体画像表示制御装置、これを備える撮像装置、及び立体画像表示制御方法

Publications (2)

Publication Number Publication Date
US20140362187A1 US20140362187A1 (en) 2014-12-11
US9270982B2 true US9270982B2 (en) 2016-02-23

Family

ID=49005322

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/466,298 Active US9270982B2 (en) 2012-02-23 2014-08-22 Stereoscopic image display control device, imaging apparatus including the same, and stereoscopic image display control method

Country Status (4)

Country Link
US (1) US9270982B2 (ja)
JP (1) JP5564633B2 (ja)
CN (1) CN104137539B (ja)
WO (1) WO2013125122A1 (ja)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5668385B2 (ja) * 2010-09-17 2015-02-12 ソニー株式会社 情報処理装置、プログラムおよび情報処理方法
US9049423B2 (en) * 2010-12-01 2015-06-02 Qualcomm Incorporated Zero disparity plane for feedback-based three-dimensional video
US20170336626A1 (en) * 2014-11-07 2017-11-23 Sony Corporation Display device and display control method
CN104935998B (zh) * 2015-06-01 2018-08-24 无锡天脉聚源传媒科技有限公司 一种台标插件显示区域的调整方法及装置
CN106020758B (zh) * 2016-05-17 2019-12-03 苏州佳世达电通有限公司 一种荧幕拼接显示系统及方法
JP7356697B2 (ja) * 2019-06-11 2023-10-05 国立大学法人静岡大学 画像観察システム

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08317429A (ja) 1995-05-23 1996-11-29 Matsushita Electric Ind Co Ltd 立体電子ズーム装置及び立体画質制御装置
US6618073B1 (en) * 1998-11-06 2003-09-09 Vtel Corporation Apparatus and method for avoiding invalid camera positioning in a video conference
US6714238B2 (en) * 1996-03-13 2004-03-30 Canon Kabushiki Kaisha Video/audio communication system with confirmation capability
JP2004349736A (ja) 2003-05-08 2004-12-09 Sharp Corp 立体画像処理装置、立体画像処理プログラムおよびそのプログラムを記録した記録媒体
US6864910B1 (en) * 1999-06-30 2005-03-08 Canon Kabushiki Kaisha Optical apparatus
US20060192776A1 (en) 2003-04-17 2006-08-31 Toshio Nomura 3-Dimensional image creation device, 3-dimensional image reproduction device, 3-dimensional image processing device, 3-dimensional image processing program, and recording medium containing the program
US20120133645A1 (en) * 2010-11-26 2012-05-31 Hayang Jung Mobile terminal and operation control method thereof
US8553105B2 (en) * 2009-08-28 2013-10-08 Fujifilm Corporation Audiovisual data recording device and method
US8902295B2 (en) * 2010-05-20 2014-12-02 Sony Computer Entertainment Europe Limited 3D camera and imaging method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4251907B2 (ja) * 2003-04-17 2009-04-08 シャープ株式会社 画像データ作成装置
EP2469876B1 (en) * 2010-06-17 2015-07-29 FUJIFILM Corporation Stereoscopic image display control apparatus and operation control method of the same

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08317429A (ja) 1995-05-23 1996-11-29 Matsushita Electric Ind Co Ltd 立体電子ズーム装置及び立体画質制御装置
US6714238B2 (en) * 1996-03-13 2004-03-30 Canon Kabushiki Kaisha Video/audio communication system with confirmation capability
US6618073B1 (en) * 1998-11-06 2003-09-09 Vtel Corporation Apparatus and method for avoiding invalid camera positioning in a video conference
US6864910B1 (en) * 1999-06-30 2005-03-08 Canon Kabushiki Kaisha Optical apparatus
US20060192776A1 (en) 2003-04-17 2006-08-31 Toshio Nomura 3-Dimensional image creation device, 3-dimensional image reproduction device, 3-dimensional image processing device, 3-dimensional image processing program, and recording medium containing the program
JP2004349736A (ja) 2003-05-08 2004-12-09 Sharp Corp 立体画像処理装置、立体画像処理プログラムおよびそのプログラムを記録した記録媒体
US8553105B2 (en) * 2009-08-28 2013-10-08 Fujifilm Corporation Audiovisual data recording device and method
US8902295B2 (en) * 2010-05-20 2014-12-02 Sony Computer Entertainment Europe Limited 3D camera and imaging method
US20120133645A1 (en) * 2010-11-26 2012-05-31 Hayang Jung Mobile terminal and operation control method thereof
JP2012114920A (ja) 2010-11-26 2012-06-14 Lg Electronics Inc 携帯端末機及びその動作制御方法

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
International Search Report issued in PCT/JP2012/081150, dated Jan. 15, 2013.
Written Opinion of the International Searching Authority issued in PCT/JP2012/081150, dated Jan. 15, 2013 (Form PCT/ISA/237).
Written Opinion of the International Searching Authority issued in PCT/JP2012/081150, dated Jan. 15, 2013.

Also Published As

Publication number Publication date
US20140362187A1 (en) 2014-12-11
JP5564633B2 (ja) 2014-07-30
JPWO2013125122A1 (ja) 2015-07-30
CN104137539A (zh) 2014-11-05
WO2013125122A1 (ja) 2013-08-29
CN104137539B (zh) 2016-07-27

Similar Documents

Publication Publication Date Title
KR101678861B1 (ko) 이동단말기 및 그 제어방법
US9332208B2 (en) Imaging apparatus having a projector with automatic photography activation based on superimposition
US9270982B2 (en) Stereoscopic image display control device, imaging apparatus including the same, and stereoscopic image display control method
KR20170006559A (ko) 이동단말기 및 그 제어방법
KR20160031886A (ko) 이동 단말기 및 그것의 제어방법
KR20170025177A (ko) 이동단말기 및 그 제어방법
US20170098322A1 (en) Image display device and image display method
US10205868B2 (en) Live view control device, live view control method, live view system, and program
JP6435063B2 (ja) 撮像制御装置、撮像制御方法、撮像システム及びプログラム
US10863095B2 (en) Imaging apparatus, imaging method, and imaging program
US20140333724A1 (en) Imaging device, imaging method and program storage medium
KR20160012009A (ko) 이동단말기 및 그 제어방법
KR101717532B1 (ko) 이동단말기 및 그 제어방법
KR20180020734A (ko) 이동단말기 및 그 제어 방법
KR101751348B1 (ko) 이동단말기 및 그 제어방법
KR20170037123A (ko) 이동단말기 및 그 제어방법
KR20180014616A (ko) 이동 단말기 및 그 제어방법
US11600241B2 (en) Display control device, imaging device, display control method, and display control program
KR20170082382A (ko) 이동 단말기 및 그의 화면 확대 방법
KR20180037375A (ko) 단말기 및 그 제어 방법
KR20170071290A (ko) 이동 단말기
JP2015192362A (ja) 画像再生装置，画像再生方法およびその制御プログラム
KR20150133577A (ko) 이동단말기 및 그 제어방법
KR20160007294A (ko) 이동단말기 및 그 제어방법

Legal Events

Date Code Title Description
AS Assignment

Owner name: FUJIFILM CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HAYASHI, KENKICHI;REEL/FRAME:033623/0644

Effective date: 20140817

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8