JP2010213169A - Display device, display processing method, and imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display device, a display processing method, and an imaging apparatus with excellent operability which automatically determines a holding state of a user and allows appropriate display settings according to its posture when used. <P>SOLUTION: The display device includes a display part having display screens determined by a first orientation and a second orientation perpendicular to the first orientation, a touch panel for detecting a contact on the display screen, a display control part for displaying an input part which allows input through the touch panel on the display screen, a plurality of detection blocks aligned along an outer edge of the display screen. When the display control part detects a contact through the detection block, a plurality of continuous detection blocks aligned in a row are regarded as a single group and, according to the number of groups and an alignment of the plurality of detection blocks making up the group, it is set to either a first display mode for displaying the input part with the first orientation of the display screen set to the longitudinal direction or to a second display mode for displaying the input part with the first orientation of the display screen set to the lateral direction. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a display device, a display processing method, and an imaging device.

  A small electronic device such as a digital camera or a mobile phone is provided with a display device including a display unit such as an LCD for displaying information to a user. Recently, a configuration in which a touch panel is provided in a display device is also known. In such a display device, when the user directly touches the touch panel with a finger, various operations and settings based on information displayed on the display unit can be input.

  Patent Document 1 relates to a touch panel type information processing apparatus. This touch panel type information processing apparatus changes and displays the input range displayed on the display unit located on the touch panel in accordance with the size information of the operator's finger or the like input in advance.

  Patent document 2 is related with the input device provided with the touch panel. The input device recognizes the type of a finger touched on the touch pad, and inputs at least one of operation items according to the type of the touched finger.

  Patent Document 3 relates to a touch panel. This touch panel increases the display area of the input part when the area of the touched finger touching area is larger than the display area of the input part.

  Patent Literature 4 relates to an input device including a touch panel. When detecting the user's hand placed at a predetermined position, the input device displays an input reception button displayed on the display device closer to the predetermined position than when the user's hand is not detected.

  Patent Document 5 relates to a camera with a monitor. This camera with a monitor determines a gripping state using a touch panel and displays a reduced image. By doing so, the entire image can be confirmed without being obscured by the photographer's hand.

  Patent Document 6 relates to an imaging apparatus with a display. This imaging apparatus performs control to switch the display mode of the display screen between the shooting mode and the image reproduction mode.

  Patent document 7 is related with the imaging device provided with the touch panel. This imaging device detects the presence or absence of input to the touch panel, and determines whether the shooting is in the horizontal position or the vertical position. Also, based on this determination, at the time of shooting, either the horizontal position shutter button or the vertical position shutter button is validated to prevent malfunction.

  Patent document 8 is related with the imaging device provided with the touch panel. In this imaging apparatus, display on the display is switched based on a contact signal at a position where the finger touches the touch panel and a posture detection signal of the posture sensor.

JP-A-6-83537 JP 2007-72578 A JP 2007-328421 A Japanese Patent Application Laid-Open No. 2008-129689 JP-A-11-289484 JP 2006-166248 A JP 2006-222900 A JP 2007-300353 A

  In the configurations described in Patent Documents 1 to 5, the presence / absence of a finger touching the touch panel and the location of the touch are detected, but in what posture the touched user is inputting. It is not a judgment. In digital cameras, mobile phones, and the like, it is conceivable to use the display unit by gripping the display unit in a portrait or landscape orientation depending on the state during use. At this time, the operability was not good because the information displayed on the display unit was not oriented.

  The imaging device disclosed in Patent Document 6 is provided with a display arranged so that the longitudinal direction of the screen matches the longitudinal direction of the main body of the apparatus, and is assumed to be operated with one hand, and is assumed to be operated with both hands. Not.

  The imaging device disclosed in Patent Document 7 does not assume that the display unit is switched between horizontal position shooting and vertical position shooting.

  Although the image pickup apparatus of Patent Document 8 detects the presence or absence of contact at a predetermined part of the touch panel, it cannot automatically determine whether the contact is a right hand or a left hand. For this reason, it is impossible to determine in what state the detected contact is in contact (for example, the direction of the finger of the hand). For example, when the hand holding the imaging apparatus is changed from the right hand to the left hand during use, it may be difficult to change the display setting of the display unit to an appropriate orientation, and there is room for improvement.

  Therefore, the present invention can automatically determine the gripping state of the user and perform appropriate display settings according to the posture when in use, a display device excellent in operability, a display processing method, and An imaging device is provided.

The display device of the present invention includes a display unit having a display surface defined in a first direction and a second direction perpendicular to the first direction;
A touch panel for detecting contact with the display surface; a display control unit for displaying an input unit capable of input by the touch panel on the display surface;
A plurality of detection blocks arranged side by side along the peripheral edge of the display surface,
When the display control unit detects contact by the detection block, the plurality of detection blocks arranged in a row are grouped together, and the number of the groups and the plurality of detections constituting the group Depending on how the blocks are arranged, in the first display mode in which the input unit is displayed in the state where the first direction of the display surface is vertical, or in the state where the first direction of the display surface is horizontal The second display mode for displaying the input unit is set.

In addition, the present invention provides a display unit having a display surface defined in a first direction and a second direction perpendicular to the first direction;
A touch panel for detecting contact with the display surface; a display control unit for displaying an input unit capable of input by the touch panel on the display surface;
A plurality of detection blocks arranged side by side along the peripheral edge of the display surface, and a display processing method for a display device comprising:
When contact is detected by the detection block, a plurality of the detection blocks arranged in a row as one group, depending on the number of the groups and the arrangement of the plurality of detection blocks constituting the group, A first display mode in which the input unit is displayed with the first direction of the display surface in a vertical state, or a first display mode in which the input unit is displayed in a state in which the first direction of the display surface is horizontal. Set to 2 display mode.

  According to the display device and the display processing method, the plurality of detection blocks provided on the peripheral portion of the display surface detect contact, and depending on the number of groups of detection blocks that detect contact and how the detection blocks are arranged, It is determined how the display surface is gripped. Based on the number of groups of detection blocks and how the detection blocks are arranged, it is possible to know which area is touching which edge of the substantially rectangular display surface. The gripping state can be determined by making it correspond to the pattern. At this time, it can be determined whether the user is holding with one hand or both hands based on the number of groups. Also, based on how the detection blocks are arranged, if the area where the fingers are in contact extends in the direction in which the detection blocks are arranged, it can be determined from the shape or the like whether the hand in contact is the right hand or the left hand. . Based on the determined gripping state, the direction of the input unit displayed on the display surface can be set as appropriate. In this way, the user does not need to set in advance the right and left of the person to be grasped by himself / herself, and the grasping state with both hands is also properly detected, so that the user can automatically detect according to the grasping state. The input part of the display surface is set. Therefore, the operability when handling the display device is excellent.

  According to the present invention, it is possible to automatically determine the gripping state of the user, perform appropriate display settings according to the posture when being used, a display device excellent in operability, a display processing method, and An imaging device can be provided.

It is a block diagram which shows the structure of the imaging device to which a display apparatus is applied. It is a figure which shows the external appearance of the front side of the imaging device of FIG. It is a figure which shows the external appearance of the back side of the imaging device of FIG. It is a figure which shows typically the state which planarly viewed the display surface. It is a figure explaining the method of contact detection. It is a figure which shows the detection pattern of a contact. It is a figure which shows another detection pattern. It is a figure which shows another detection pattern. It is a flowchart explaining the procedure of contact detection. It is a figure which shows the display pattern of the input part in a display surface. It is a figure which shows the modification of the display pattern of the input part in a display surface. It is a figure which shows the example which changes the input determination of a display surface.

  Hereinafter, a display device for explaining an embodiment of the present invention will be described. Hereinafter, a configuration example provided in an imaging device such as a digital camera will be described as an example of a display device. The display device is not limited to a digital camera, but may be another imaging device such as a digital video camera or a device provided in a mobile phone.

  FIG. 1 is a block diagram illustrating an example of the configuration of the imaging apparatus. FIG. 2 is a diagram illustrating an appearance of the front side of the imaging apparatus. FIG. 3 is a diagram illustrating an appearance of the back side of the imaging apparatus.

  The imaging device 10 includes a CCD type solid-state imaging device 12 that functions as an imaging unit that images a subject. The imaging device 10 includes an imaging lens 13 and a diaphragm (iris) 14 in front of the solid-state imaging device 12 in the optical axis direction.

  The image pickup apparatus 10 converts a CDSAMP (correlated double sampling (CDS), gain control amplifier (AMP)) 16 that performs analog signal processing on an output signal (image signal) of the solid-state image pickup device 12, and converts the output signal of the CDSAMP 16 into a digital signal. And an analog / digital (A / D) converter 18.

  The imaging apparatus 10 further includes an image input controller 22 that captures an image signal digitized by the A / D converter 18, a control unit (CPU) 20 that performs overall control of the entire imaging apparatus 10, and image processing of the image signal. And an image signal processing circuit 24 for generating an image and a through image output from the solid-state imaging device 12 (an image generated based on an image signal output from the solid-state imaging device 12 when the shutter button is not pressed). ) To automatically detect a focal position, an AE & AWB detection circuit 44 to detect an exposure amount and white balance from a through image, an SDRAM 46 and a VRAM 48 used as memory for image processing, and after image processing A compression processing circuit 26 that compresses the image into a JPEG image or an MPEG image, and provided on the surface of the casing of the imaging device. Functions as a display memory 54 for backup, a video encoder 28 for displaying an image or a through-image on the display section 54, a media controller 52 for recording an image on a recording medium 56, a backup power supply 64, and a memory for backup. SRAM and flash memory 66 are provided. And a bus for interconnecting them.

  In addition, the imaging apparatus 10 controls detection of a touch panel provided in the display unit 54 and changes or holds display setting of the input unit that can be input by the touch panel displayed on the display unit 54 based on the detection. A display control unit 60 is provided.

  The imaging apparatus 10 further supplies a driving pulse to a timing generator 32 that supplies a driving timing pulse (such as an electronic shutter pulse, a readout pulse, and a transfer pulse) of the solid-state imaging device 12 and a motor that drives the focus lens position of the photographing lens 13. A lens drive motor driver 33 to be supplied and an aperture drive motor driver 34 to supply drive pulses to a drive motor that controls the aperture position of the aperture 14 are provided. The timing generator 32, the lens drive motor driver 33, and the aperture drive motor driver 34 operate based on a command from the CPU 20.

  The imaging apparatus 10 further includes a switch 36 that switches between an imaging mode in which imaging is performed by input of a shutter button and a playback mode in which an image captured by input of the shutter button is reproduced and displayed on the display unit 54. An operation signal is input to the CPU 20 by operating the switch 36.

  As shown in FIG. 2, an optical unit including a photographing lens 13 is provided on the front side of the imaging apparatus 10. As shown in FIG. 3, the screen of the display unit 54 is provided on the back side that is located on the opposite side of the front side so that the user can visually recognize the image capturing apparatus 10 while holding it.

  As shown in FIG. 3, the display unit 54 includes a substantially rectangular display surface in a plan view. The display unit 54 includes a touch panel that detects contact with the display surface. The display surface formed in the display unit 54 is not limited to a substantially rectangular shape. For example, if the display surface 54 has a shape defined in a first direction and a second direction perpendicular to the first direction, the display surface is square. The shape can be changed.

  On the display surface, an input unit that can be input by a touch panel is visually displayed. Visual display information corresponding to operations and settings of the imaging device 10 is assigned to the input unit. The user visually recognizes the display information of the input unit displayed on the display surface, and directly inputs a desired operation or setting according to the display information of the input unit that is in contact with the input unit. Can do. For example, in the shooting mode, “pixel” for setting the pixel size of the shot image on the display surface, “continuous shooting” for executing the continuous shooting function, “sensitivity” for setting the ISO sensitivity, shooting, “Release” or the like for executing is displayed as an input section. In the photographing mode, a through image is displayed on the display surface simultaneously with the display of the input unit. In the playback mode, “image playback” for displaying a captured image, “image deletion” for deleting a captured image, and the like are displayed as an input unit.

  The configuration of the touch panel can be, for example, an analog resistance film type. In the analog resistance film system, a transparent film such as PET provided on the surface side of the display surface and a glass substrate are arranged in parallel with a gap, and a transparent conductive film is provided on each of the opposing surfaces of the transparent film and the glass substrate. (For example, ITO) is formed. When the user touches the screen with the finger, the transparent film side of the part pressed by the finger and the transparent conductive film on the glass substrate side come into contact with each other, electricity is energized, and this electricity is output as information to make contact Can be recognized. The configuration of the touch panel is not particularly limited.

  As shown in FIG. 4, the display unit 54 is provided with a plurality of detection blocks A arranged along the peripheral edge of the display surface in order to detect contact with the user's hand or the like. The peripheral portion includes a pair of long side vicinity and a pair of short side vicinity among the four sides around the display surface, and also includes four corners where the long side and the short side intersect.

  Each of the plurality of detection blocks A is an area having a substantially square shape, and can detect contact with the touch panel independently of each other, and outputs a detection signal in response to the contact. Each of the plurality of detection blocks A is preliminarily assigned position information indicating where the detection block is located with respect to the peripheral edge of the display surface.

  The number of detection blocks A arranged linearly in the direction of the long side of the display surface and the number arranged in the direction of the short side are determined according to the size of the display unit and the individual area of the detection block A. There is no particular limitation. In this configuration example, the direction of the long side of the display surface is the X direction, and the direction of the short side is the Y direction perpendicular to the X direction. When the display surface is an XY plane, the plurality of detection blocks A can represent their positions using XY coordinates. A plurality of detection blocks A may be identified using the XY coordinates. Here, the definition of the direction with respect to the display surface does not mean that the direction is limited to the XY coordinates. For example, the first direction and the second direction perpendicular to the first direction may be used. Good.

  The plurality of detection blocks A need not be visually displayed on the display surface. However, information indicating a plurality of detection blocks A or their areas may be displayed within a range that does not hinder display on the display surface.

  The imaging device 10 is held by both hands or one hand when the user performs photographing or other operations. At this time, in a state where the display surface is arranged in front of its own field of view, a state in which the long side of the display surface is gripped so as to be substantially parallel to the vertical direction (the arrow Y direction with reference to FIG. 4) is displayed It is said to have a vertically long surface. Further, the display surface is arranged so that the long side of the display surface is substantially parallel to the horizontal direction (the arrow X direction with reference to FIG. 4) in a state where the display surface is arranged in front of the field of view. Is said to be in a horizontally long state. Here, the direction is defined by the long side and the short side of the display surface. However, the first direction and the second direction perpendicular to the first direction may be used regardless of the shape of the display surface. . At this time, when the first direction is longer than the second direction, the state in which the first direction of the display surface is set to be vertical is set to the state in which the first direction of the display surface is set to be horizontal. It is good also as the state where was made into landscape.

Next, detection of contact using a plurality of detection blocks will be described based on FIG.
In FIG. 5A, as an example, a case where the imaging apparatus is gripped in a state where the display surface is horizontally long is shown. Here, the user is holding a part of the peripheral edge of the display surface of the display unit 54 with the right hand. At this time, as shown in FIG. 5B, the detection block A included in the gripped region detects contact with the right hand. In FIG. 5 (b), the detection block A that detects contact is shown with a cross in the square to distinguish it from other detection blocks A, but it is actually displayed visually on the display surface. It does not mean to be done. FIG. 5C shows the detection block A in which contact is detected.

  As shown in FIG. 5C, when a contact is detected, a plurality of detection blocks A1, A2, A3, A4 arranged in a row are grouped into one group. Here, based on the XY direction of the display surface, the detection blocks A1, A2, and A3 are arranged in the arrow Y direction, and the detection blocks A3 and A4 are arranged in the arrow X direction. The detection block A3 is arranged at a position corresponding to the corner of the peripheral edge of the display surface. Thus, the detection blocks A1 to A4 are groups having a substantially L-shaped arrangement with the detection block A3 as a corner.

  In addition, the presence / absence of another group composed of detection blocks that have detected contact is determined. In the example shown in FIG. 5, there is no other group, and it is assumed that there is only one of the groups configured by the detection blocks A1 to A4.

  As described above, based on the number of detection block groups and the arrangement of the detection blocks, it can be seen in which region the contact is made on which peripheral portion of the substantially rectangular display surface. The gripping state can be determined by making the contact area correspond to the gripping pattern of the user's finger.

  In the example shown in FIG. 5, the contact area includes the lower right corner of the display surface and is longer in the Y direction than in the X direction. Such a region corresponds to a pattern in which the user grips along the short side on the right hand side toward the substantially rectangular display unit with the right hand (specifically, the thumb). For this reason, according to the number of groups and the arrangement of the detection blocks as described above, it can be determined that the user is holding the imaging apparatus with the right hand only along the short side of the display unit. Note that the gripping state corresponding to the number of groups and the arrangement of the detection blocks may be set in advance or can be changed according to the user's intention, and is not limited.

  6 to 7 show a gripping state and a pattern of a region where contact is detected according to the gripping state. In each figure, the touched area and the group at that time are shown. In the figure, the imaging device is not shown, and only the positions of the display unit 54 and the detection block A are shown.

  In the example shown in FIG. 6A, the user touches the left hand LF along the lower left corner of the display surface along one short side, and the right hand RF touches the lower right corner of the display surface and the other short side. It is gripped so as to come into contact along the side. At this time, two groups are detected. Each group is configured by two detection blocks arranged in the X direction and three detection blocks arranged in the Y direction. In this example, in the case where the number of groups is two and the detection blocks are arranged as shown in FIG. 6A, it is determined that the user is holding with both hands in a state where the display unit is horizontally long.

  In the example shown in FIG. 6B, the user holds the right hand RF so as to contact the lower right corner of the display surface along one short side. At this time, one group is detected. The group configuration is a group composed of two detection blocks arranged in the X direction and three detection blocks arranged in the Y direction. In this example, when the number of groups is one and the detection blocks are arranged as shown in FIG. 6B, it is determined that the user is holding only with the right hand in a state where the display unit is horizontally long. .

  In the example shown in FIG. 6C, the user holds the left hand LF so as to contact the lower left corner of the display surface along one short side. At this time, one group is detected. The group configuration is a group composed of two detection blocks arranged in the X direction and three detection blocks arranged in the Y direction. In this example, in the case where the number of groups is one and the detection blocks are arranged as shown in FIG. 6C, it is determined that the user is holding only with the left hand in a state where the display unit is horizontally long. .

  In the example shown in FIG. 6D, the user touches the left hand LF along the lower right corner of the display surface along one long side, and the right hand RF touches the upper right corner of the display surface and the other length. It is gripped so as to come into contact along the side. At this time, two groups are detected. Each group is composed of three detection blocks arranged in the X direction and two detection blocks arranged in the Y direction. In this example, when the number of groups is two and the detection blocks are arranged as shown in FIG. 6D, it is determined that the user is holding with both hands while the display unit is in a vertically long state.

  In the example shown in FIG. 6E, the user holds the right hand RF so as to contact the upper right corner of the display surface along one long side. At this time, one group is detected. The group configuration is a group composed of two detection blocks arranged in the X direction and three detection blocks arranged in the Y direction. In this example, when the number of groups is one and the detection blocks are arranged as shown in FIG. 6E, it is determined that the user is holding only with the right hand in a state where the display unit is vertically long. .

  In the example shown in FIG. 6 (f), the user holds the left hand LF so as to contact the lower right corner of the display surface along one long side. At this time, one group is detected. The group configuration is a group composed of three detection blocks arranged in the X direction and two detection blocks arranged in the Y direction. In this example, in the case where the number of groups is one and the detection blocks are arranged as shown in FIG. 6F, it is determined that the user is holding with only the left hand in a state where the display unit is vertically long. .

  In the example shown in FIG. 7A, the user holds the right hand RF (or the left hand LF) so as to contact one short side of the display surface. At this time, one group is detected. The group structure is a group composed of only two detection blocks arranged in the Y direction. Here, since the detection blocks are arranged only in the Y direction and the length in the Y direction is short, if one finger of one hand is in contact with the display surface so as to intersect substantially perpendicularly to the direction of the short side Think. In this example, when the number of groups is one and the detection blocks are arranged as shown in FIG. 7A, the user holds the display unit in a vertically long state with one hand (right hand or left hand). It is determined that

  In the example shown in FIG. 7B, the user holds the right hand RF (or the left hand LF) so as to contact one long side of the display surface. At this time, one group is detected. The group structure is a group composed of only two detection blocks arranged in the X direction. Here, since the arrangement of the detection blocks is only in the X direction and the length in the X direction is short, it is assumed that one finger of one hand is in contact with the display surface so as to intersect substantially perpendicular to the direction of the long side. Think. In this example, when the number of groups is one and the detection blocks are arranged as shown in FIG. 7B, the user holds the display unit in a horizontally long state with one hand (right hand or left hand). It is determined that

  In the example shown in FIG. 7C, the user holds one hand in contact with one short side of the display surface and the other hand in contact with the other short side of the display surface. At this time, two groups are detected. Each group is configured by only two detection blocks arranged in the Y direction. Here, since the arrangement of the detection blocks is only in the Y direction and the length in the Y direction is short, it is considered that the finger is in contact with the display surface so as to intersect substantially perpendicular to the direction of the short side. In this example, when the number of groups is two and the detection blocks are arranged as shown in FIG. 7C, it is determined that the user is holding with both hands in a state where the display unit is horizontally long.

  In the example shown in FIG. 7D, the user holds one hand in contact with one long side of the display surface and the other hand in contact with the other long side of the display surface. At this time, two groups are detected. Each group is configured by only two detection blocks arranged in the X direction. Here, since the arrangement of the detection blocks is only in the X direction and the length in the X direction is short, it is considered that the finger is in contact with the display surface so as to intersect substantially perpendicular to the direction of the long side. In this example, when the number of groups is two and the detection blocks are arranged as shown in FIG. 7D, it is determined that the user is holding with both hands while the display unit is vertically long.

  FIG. 8 shows a pattern of a region where contact is detected. In each figure, the touched area and the group at that time are shown. In the figure, the imaging device is not shown, and only the positions of the display unit 54 and the detection block A are shown. FIG. 8 shows a pattern in which some contact is detected, but the gripping state cannot be determined.

  In the example shown in FIG. 8A, three groups are detected. Thus, when three or more groups are detected, it is unclear whether the user is holding with one hand or both hands. In this case, the gripping state cannot be determined.

  In the example shown in FIG. 8B, one group is detected, and this group is composed of three detection blocks arranged in the X direction on the display surface and three detection blocks arranged in the Y direction. . As described above, the arrangement of the detection blocks constituting the group has the same length in the X direction and the Y direction, and the direction of the hand is unknown. In this case, the gripping state cannot be determined.

  In the example shown in FIG. 8C, two groups are detected. One of the two groups is composed of two detection blocks arranged in the X direction on the display surface and three detection blocks arranged in the Y direction, and the remaining one is detected in three in the X direction. It consists of a block and two detection blocks arranged in the Y direction. As described above, since the lengths of the detection blocks arranged in each group in the X direction and the Y direction are different for each group, the direction of the hand is unknown. In this case, the gripping state cannot be determined.

  In the example shown in FIG. 8D, two groups are detected. One of the two groups is composed of two detection blocks that include a corner and are arranged in the X direction on the display surface and three detection blocks that are arranged in the Y direction, and the other one has a corner. The detection block is not included and only two detection blocks are arranged in the Y direction. In this way, the arrangement of the detection blocks that make up the group is a mixture of those that include corners and those that do not. Therefore, the orientation of the hand is unknown. In this case, the gripping state cannot be determined.

  When the gripping state can be determined as in the patterns shown in FIGS. 6 and 7, the display control unit corresponds to a state in which the display surface is in a vertically long state or a state in which the display surface is in a horizontally long state. Controls the display of the input unit. Controlling the display of the input unit includes changing the display direction of the input unit so as to correspond to a state where the display surface is vertically long or a state where the display surface is horizontally long. For example, if the display of the input unit is adjusted to the state in which the display surface is vertically long before the gripping state is determined, and then it is determined that the display surface is horizontally long, the display of the input unit is displayed. The image is displayed after being rotated by approximately 90 °. When the display of the input unit is adjusted to the state in which the display surface is horizontally long before the gripping state is determined, and then it is determined that the display surface is in the vertically long state, the display of the input unit is approximately 90. ° Rotate and display. By doing so, the display of the input unit of the display unit is automatically changed according to his / her gripping state, and thereafter, it is possible to perform operations such as input using the touch panel without a sense of incongruity. Become.

  When the gripping state cannot be determined as in the pattern shown in FIG. 8, the display control unit holds the current display setting without changing the display of the input unit of the display unit.

  Next, the procedure of the display processing method will be described based on the flowchart of FIG. In the following description of the display processing method, description will be made based on a configuration example of an imaging device including the display device already described.

  First, the presence or absence of contact with the touch panel is detected (step S1). This detection may be performed constantly or intermittently while the touch panel is activated.

  When the touch panel is touched, it is determined whether or not the touch is detected by the detection block at the peripheral edge of the display surface (step S2). If contact with the detection block is not detected, the gripping state is not determined and the procedure is terminated (step S10).

  When contact is detected by the detection block, among the detection blocks in which contact is detected, a plurality of detection blocks arranged side by side are set as one group (step S3).

  Then, according to the number of groups, it is determined whether the user is holding with one hand or both hands. Here, when there is one group, it is determined that the user is holding with one hand (step S5). If there are two groups, it is determined that the user is holding with both hands (step S6). If there are three or more groups, it is determined that the detection is invalid (step S10).

  When it is determined that the hand is grasped with one hand, it is determined whether there is a detection block corresponding to the corner position among the detection blocks constituting the group (step S7). It is discriminated whether the arrangement of is long in the X direction or long in the Y direction (step S9). If the arrangement of the detection blocks is long in the Y direction, it corresponds to the pattern of FIG. 7A, and it is determined that the display surface is vertically long and is held with one hand (step S14). If the arrangement of the detection blocks is long in the X direction, it corresponds to the pattern of FIG. 7B, and it is determined that the display surface is horizontally long and is held with one hand (step S13).

  If it is determined in step S6 that the hand is grasped with both hands, it is determined whether or not the detection blocks constituting each group include one corresponding to the position of the corner (step S8). When objects are mixed (see the pattern in FIG. 8D), the procedure is terminated assuming that the gripping state cannot be determined (step S10).

  On the other hand, when the detection block corresponding to the corner position is included in all the groups, and when the detection block corresponding to the corner position is not included in all the groups, the process proceeds to step S11. The determination is made based on the arrangement of the detection blocks constituting the group. If the number of detection blocks arranged in the X direction is larger than the number of detection blocks arranged in the Y direction in step S11, this corresponds to the pattern in FIG. 6D, and the display surface is vertically long. It is determined that it is in a state and is held with both hands (step S15). It is determined whether or not the detection blocks are arranged such that the number of detection blocks arranged in the Y direction is larger than the number of detection blocks arranged in the X direction (step S12). If YES, the pattern of FIG. It is determined that the display surface is horizontally long and is held with both hands (step S16). If the number of detection blocks arranged in the Y direction is equal to the number of detection blocks arranged in the X direction, the procedure is terminated because it is not possible to determine the gripping state (step S10).

  When the determination of one hand or both hands and the determination of the state in which the display surface is horizontally long or vertically long are completed, the display on the input unit on the display surface is changed according to these determinations (step S17). If the gripping state cannot be determined, the procedure ends with the display of the currently set input unit held.

  FIG. 10 illustrates the display pattern of the input unit corresponding to the gripping state. FIG. 10A shows an example of display on the input unit when the display surface of the display unit 54 is vertically long and is held with both hands. Such display of the input unit is set when a gripping state such as a pattern shown in FIG. 6D is determined, for example.

  FIG. 10B shows an example of display on the input unit when the display surface of the display unit 54 is in a vertically long state and is gripped with only the right hand. Such display of the input unit is set when a gripping state such as a pattern shown in FIG. 6E is determined, for example.

  FIG. 10C illustrates an example of display on the input unit when the display surface of the display unit 54 is in a vertically long state and is gripped with only the left hand. Such display of the input unit is set when a gripping state such as a pattern shown in FIG. 6F is determined, for example.

  FIG. 10D shows an example of display on the input unit when the display surface of the display unit 54 is horizontally long and is held with both hands. Such display of the input unit is set when a gripping state such as the pattern shown in FIG. 6A is determined, for example.

  FIG. 10E shows an example of display on the input unit when the display surface of the display unit 54 is in a horizontally long state and is held only with the right hand. Such display of the input unit is set when a gripping state such as the pattern shown in FIG. 6B is determined, for example.

  FIG. 10F shows an example of display on the input unit when the display surface of the display unit 54 is in a horizontally long state and is gripped with only the left hand. Such display of the input unit is set when a gripping state such as a pattern shown in FIG. 6C is determined, for example.

  As in the example shown in FIGS. 10A, 10 </ b> B, and 10 </ b> C, the display setting for displaying the input unit according to the state in which the display surface is vertically long is set to the vertically long display mode. Further, as in the example shown in FIGS. 10D, 10E, and 10F, the display setting for displaying the input unit in accordance with the state where the display surface is horizontally long is set to the horizontally long display mode. Here, when the display surface is defined by the first direction and the second direction perpendicular to the first direction, the input unit is displayed with the first direction of the display surface being vertical. It is good also as a 1st display mode to perform and a 2nd display mode which displays an input part in the state which turned the 1st direction of the display surface sideways.

  As shown in FIG. 10, it is preferable that an input unit that is frequently used be displayed near the gripped hand. For example, in the example of FIG. 10, the “release” input unit frequently used is arranged near the hand. In addition, all the input units are displayed near the gripped hand. At this time, when changing the display of the input unit, the display control unit simultaneously changes the display so that the position where the input unit is displayed is closer to the group position based on the position information of the detection blocks constituting the group. Execute the process.

  Moreover, it is preferable that a display control part displays an input part in the area | region except the position in which the detection block of a display part is provided. By doing so, it is possible to prevent the determination of the gripping state not intended by the user due to the detection block detecting the operation of the user touching the input unit, and the operability is further improved. .

  Furthermore, it is preferable that input by the touch panel is prohibited at a position where the detection block of the display unit is provided during detection by the detection block. By doing so, it is possible to avoid detecting the input of the touch panel as a contact with the detection block, and the operability is further improved. Control for prohibiting input by the touch panel may be performed by the display control unit, or may be controlled by the CPU 20 or the like.

  It is preferable that the display control unit has a function of holding display settings until the next change after the display unit is changed to the portrait display mode or the landscape display mode. By doing so, it is possible to prevent the determination of the gripping state from being frequently executed against the user's intention, so that the operability is further improved.

  According to the procedure of the display device or the display processing method described above, the plurality of detection blocks provided on the peripheral edge of the display surface detect contact, and the number of groups of detection blocks that detect contact and how the detection blocks are arranged Accordingly, it can be determined how the display surface is held. Based on the number of groups of detection blocks and how the detection blocks are arranged, it is possible to know which area is touching which edge of the substantially rectangular display surface. The gripping state can be determined by making it correspond to the pattern. At this time, whether the user is holding with one hand or both hands can be determined based on the number of groups. Also, based on how the detection blocks are arranged, if the area where the fingers are in contact extends in the direction in which the detection blocks are arranged, it can be determined from the shape or the like whether the hand in contact is the right hand or the left hand. . Based on the determined gripping state, the orientation of the input unit displayed on the display surface can be set to a portrait display mode or a landscape display mode. In this way, the user does not need to set in advance the right and left of the person to be grasped by himself / herself, and the grasping state with both hands is also properly detected, so that the user can automatically detect according to the grasping state. The input part of the display surface is set. Therefore, the operability when handling the display device is excellent.

  FIG. 11 shows a modification of the display of the input unit. FIG. 11A is a modification of the display of the input section in the portrait display mode, and FIG. 11B is a modification of the display of the input section in the landscape display mode. When it is determined that the user is holding with both hands, it is preferable to display the input unit in the vicinity of the position of both hands as shown in FIG. At this time, when changing the display of the input unit, the display control unit places the same input unit in the vicinity of the position of each of the two groups based on the position information of the detection blocks constituting each of the two groups. Execute the process to be displayed. In this way, the user can touch the input unit to execute the same input with either hand of both hands, and the operability is improved. At this time, it is preferable that each input unit displays an input unit that displays items that are frequently used near the hands located in the vicinity of each input unit.

  As described above, after setting the display of the input unit according to the determination of the gripping state, a reference (hereinafter referred to as an input determination standard) that is an input detection target in the input unit may be changed. The input determination criterion is a criterion for determining the contact of the user's hand detected by the input unit as an input. For example, normally, when contact is detected in the input unit, the input is determined as it is. The contact with the input unit is not only a mere contact but also, for example, a plurality of so-called slides and a plurality of the same region of the input unit that are moved while keeping the hand in contact with another region of the display surface in contact with the input unit. There is a so-called tap that can be touched by hand continuously. However, there are cases where the operability for the user is better when the operation of bringing the hand into contact with the input unit is changed according to the gripping state. Therefore, by changing the input determination criterion according to the determination of the gripping state, the user can perform input to the input unit with an input method suitable for the gripping state, and the operability is improved.

  For example, the display control unit 60 or the CPU 20 executes a process of changing the input determination criterion according to the determination of the gripping state. Alternatively, the user may set an input determination criterion in advance according to the determination of the gripping state, and in this case, the input determination criterion is changed to a preset input determination criterion according to the determination of the gripping state.

  FIG. 12 shows an example in which the input determination criterion is changed according to the detected gripping state. FIG. 12A illustrates a case where it is determined that the display surface of the display unit 54 is horizontally long and is gripped with the right hand. In this case, if the entire imaging device 10 is considered to be horizontally long like the display surface, a larger load is applied to the right hand gripped compared to the vertically long. For this reason, when a hand is brought into contact with the input unit with the right hand being gripped, the desired position of the input unit is kept as it is, rather than the tap operation that momentarily releases the hand from the display surface. It is more convenient for the user to detect the input by a contact operation (long press) for a predetermined time or longer, such as the operation of sliding to the user. Therefore, when it is determined that the display surface is horizontally long and is gripped with the right hand, the input determination criterion is changed so that the input is detected by long press of a slide or the like.

  FIG. 12B shows a case where it is determined that the display surface of the display unit 54 is vertically long and is gripped with the right hand. In this case, when the entire imaging device 10 is considered to be vertically long like the display surface, the load on the right hand gripped is smaller than the horizontally long. For this reason, when a hand is brought into contact with the input unit with the gripped right hand, a touch operation that momentarily releases the hand from the display surface can be easily performed. Therefore, when it is determined that the display surface is vertically long and is held by the right hand, the input determination criterion is changed so that the input is detected by an operation such as a tap.

  It should be noted that what kind of input determination criterion is used in what kind of gripping state can be appropriately changed.

  In this specification, the following matters are disclosed.

(1) a display unit having a substantially rectangular display surface;
A touch panel for detecting contact with the display surface; a display control unit for displaying an input unit capable of input by the touch panel on the display surface;
A plurality of detection blocks arranged side by side along the peripheral edge of the display surface,
When the display control unit detects contact by the detection block, the plurality of detection blocks arranged in a row are grouped together, and the number of the groups and the plurality of detections constituting the group Depending on how the blocks are arranged, the display is set to a portrait display mode in which the input unit is displayed with the display surface in a portrait orientation, or a landscape display mode in which the input unit is displayed in a state in which the display surface is landscaped. apparatus.
(2) The display device according to (1) above,
The display device in which the display control unit brings the position of the input unit closer to the position of the group.
(3) The display device according to (1) or (2) above,
The display device in which the display control unit displays the input unit in an area excluding a position where the detection block of the display unit is provided.
(4) The display device according to (1) or (2) above,
A display device that prohibits input by the touch panel at a position where the detection block of the display unit is provided during detection by the detection block.
(5) The display device according to any one of (1) to (4) above,
Based on the number of the plurality of detection blocks constituting the group arranged in the first direction of the display unit and the number arranged in the second direction perpendicular to the first direction, A display device that determines the state of a gripping hand.
(6) The display device according to any one of (1) to (5) above,
When the number of the groups is one, it is determined that the user is holding with one hand. When the number of the groups is two, it is determined that the user is holding with both hands. A display device that determines that the detection is invalid when there are three or more.
(7) The display device according to (6) above,
A display device that displays the same input unit in the vicinity of each position of two groups when it is determined that the user is holding with both hands.
(8) The display device according to any one of (1) to (7) above,
The display device in which the display control unit holds display settings until the next change after the display unit is changed to the portrait display mode or the landscape display mode.
(9) The display device according to any one of (1) to (8) above,
The gripping state of the user is determined according to the number of the groups and the way in which the plurality of detection blocks constituting the group are arranged, and based on this determination, the reference for the input detection in the input unit is changed. Display device.
(10) a display unit having a substantially rectangular display surface;
A touch panel for detecting contact with the display surface; a display control unit for displaying an input unit capable of input by the touch panel on the display surface;
A plurality of detection blocks arranged side by side along the peripheral edge of the display surface, and a display processing method for a display device comprising:
When contact is detected by the detection block, a plurality of the detection blocks arranged in a row as one group, depending on the number of the groups and the arrangement of the plurality of detection blocks constituting the group, A display processing method for setting to a vertically long display mode in which the input unit is displayed in a state where the display surface is vertically long, or a horizontally long display mode in which the input unit is displayed in a state where the display surface is horizontally long.
(11) The display processing method according to (10) above,
The display processing method in which the display control unit brings the position of the input unit closer to the position of the group.
(12) The display processing method according to (10) or (11) above,
A display processing method in which the display control unit displays the input unit in an area excluding a position where the detection block of the display unit is provided.
(13) The display processing method according to any one of (10) to (12) above,
A display processing method for prohibiting input by the touch panel at a position where the detection block of the display unit is provided during detection by the detection block.
(14) The display processing method according to any one of (10) to (13) above,
Based on the number of the plurality of detection blocks constituting the group arranged in the first direction of the display unit and the number arranged in the second direction perpendicular to the first direction, A display processing method for determining the state of a gripping hand.
(15) The display processing method according to any one of (10) to (14),
When the number of the groups is one, it is determined that the user is holding with one hand. When the number of the groups is two, it is determined that the user is holding with both hands. A display processing method for determining that the detection is invalid when there are three or more.
(16) The display processing method according to (15) above,
A display processing method for displaying the same input unit in the vicinity of each position of two groups when it is determined that the user is holding with both hands.
(17) The display processing method according to any one of (10) to (16) above,
A display processing method in which the display control unit retains display settings until the next change after changing the display unit to the portrait display mode or the landscape display mode.
(18) The display processing method according to any one of (10) to (17),
The gripping state of the user is determined according to the number of the groups and the way in which the plurality of detection blocks constituting the group are arranged, and based on this determination, the reference for the input detection in the input unit is changed. Display processing method to be performed.
(19) An imaging device including the display device according to any one of (1) to (9).

DESCRIPTION OF SYMBOLS 10 Imaging device 54 Display part A Detection block

Claims (19)

A display unit having a display surface defined in a first direction and a second direction perpendicular to the first direction;
A touch panel for detecting contact with the display surface; a display control unit for displaying an input unit capable of input by the touch panel on the display surface;
A plurality of detection blocks arranged side by side along the peripheral edge of the display surface,
When the display control unit detects contact by the detection block, the plurality of detection blocks arranged in a row are grouped together, and the number of the groups and the plurality of detections constituting the group Depending on how the blocks are arranged, in the first display mode in which the input unit is displayed in the state where the first direction of the display surface is vertical, or in the state where the first direction of the display surface is horizontal A display device that is set to a second display mode for displaying the input unit. The display device according to claim 1,
The display device in which the display control unit brings the position of the input unit closer to the position of the group. The display device according to claim 1 or 2,
The display device in which the display control unit displays the input unit in an area excluding a position where the detection block of the display unit is provided. The display device according to claim 1 or 2,
A display device that prohibits input by the touch panel at a position where the detection block of the display unit is provided during detection by the detection block. A display device according to any one of claims 1 to 4,
The hand gripped by the user based on the number of the detection blocks constituting the group arranged in the first direction and the number arranged in the second direction of the display unit. A display device for determining the state. A display device according to any one of claims 1 to 5,
When the number of the groups is one, it is determined that the user is holding with one hand. When the number of the groups is two, it is determined that the user is holding with both hands. A display device that determines that the detection is invalid when there are three or more. The display device according to claim 6,
A display device that displays the same input unit in the vicinity of each position of two groups when it is determined that the user is holding with both hands. A display device according to any one of claims 1 to 7,
The display device in which the display control unit retains display settings until the next change after the display unit is changed to the first display mode or the second display mode. A display device according to any one of claims 1 to 8,
The gripping state of the user is determined according to the number of the groups and the way in which the plurality of detection blocks constituting the group are arranged, and based on this determination, the reference for the input detection in the input unit is changed. Display device. A display unit having a display surface defined in a first direction and a second direction perpendicular to the first direction;
A touch panel for detecting contact with the display surface; a display control unit for displaying an input unit capable of input by the touch panel on the display surface;
A plurality of detection blocks arranged side by side along the peripheral edge of the display surface, and a display processing method for a display device comprising:
When contact is detected by the detection block, a plurality of the detection blocks arranged in a row as one group, depending on the number of the groups and the arrangement of the plurality of detection blocks constituting the group, A first display mode in which the input unit is displayed with the first direction of the display surface in a vertical state, or a first display mode in which the input unit is displayed in a state in which the first direction of the display surface is horizontal. Display processing method for setting to 2 display mode. The display processing method according to claim 10,
The display processing method in which the display control unit brings the position of the input unit closer to the position of the group. The display processing method according to claim 10 or 11,
A display processing method in which the display control unit displays the input unit in an area excluding a position where the detection block of the display unit is provided. A display processing method according to any one of claims 10 to 12,
A display processing method for prohibiting input by the touch panel at a position where the detection block of the display unit is provided at the time of detection by the detection block. A display processing method according to any one of claims 10 to 13,
The hand gripped by the user based on the number of the detection blocks constituting the group arranged in the first direction and the number arranged in the second direction of the display unit. A display processing method for determining the state. The display processing method according to any one of claims 10 to 14,
When the number of the groups is one, it is determined that the user is holding with one hand. When the number of the groups is two, it is determined that the user is holding with both hands. A display processing method for determining that the detection is invalid when there are three or more. The display processing method according to claim 15,
A display processing method for displaying the same input unit in the vicinity of each position of two groups when it is determined that the user is holding with both hands. A display processing method according to any one of claims 10 to 16, comprising:
A display processing method in which the display control unit retains display settings until the next change after the display unit is changed to the first display mode or the second display mode. A display processing method according to any one of claims 10 to 17,
The gripping state of the user is determined according to the number of the groups and the way in which the plurality of detection blocks constituting the group are arranged, and based on this determination, the reference for the input detection in the input unit is changed. Display processing method to be performed.   An imaging device comprising the display device according to any one of claims 1 to 9.

Images