WO2022201737A1 - 情報処理装置、情報処理方法及びプログラム - Google Patents

情報処理装置、情報処理方法及びプログラム Download PDF

Info

Publication number
WO2022201737A1
WO2022201737A1 PCT/JP2022/000227 JP2022000227W WO2022201737A1 WO 2022201737 A1 WO2022201737 A1 WO 2022201737A1 JP 2022000227 W JP2022000227 W JP 2022000227W WO 2022201737 A1 WO2022201737 A1 WO 2022201737A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
information
imaging device
information processing
photographer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/000227
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
亜由美 中川
恵一朗 谷口
猛史 荻田
大介 山本
篤孝 伊藤
明子 吉本
真由美 植村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Priority to CN202280021774.5A priority Critical patent/CN117015742A/zh
Priority to DE112022001717.1T priority patent/DE112022001717T5/de
Priority to JP2023508646A priority patent/JPWO2022201737A1/ja
Priority to US18/550,358 priority patent/US20240163552A1/en
Publication of WO2022201737A1 publication Critical patent/WO2022201737A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/18—Signals indicating condition of a camera member or suitability of light

Definitions

  • the present technology relates to an information processing device, an information processing method, and a program.
  • Patent Literature 1 describes an imaging apparatus that provides information on photography to the photographer using bone vibration transmission means that transmits vibration to the bones of the photographer.
  • the bone vibration transmitting means is provided at a position corresponding to the cheek of the photographer when using the electronic viewfinder.
  • an object of the present technology is to provide an information processing device, an information processing method, and a program capable of appropriately presenting information related to an imaging device with a sense of touch.
  • an information processing apparatus includes a control unit.
  • the control unit controls shooting environment information in an imaging device including a camera body that includes an imaging device that captures an image of a subject and a vibration device that presents vibrations to a photographer, shooting setting information set by the photographer, and controlling vibration of the vibration device based on at least one piece of state information of the imaging device.
  • the vibration may indicate information related to the imaging device.
  • the information related to the image pickup device includes at least one of operation information of the image pickup device, alert information, operation information of an accessory device attached to the camera body, and image pickup information acquired by the image pickup device. good too.
  • the operation information of the imaging device may include information on the state of focus on the subject, information on the start of exposure in the imaging element, and information on the end of exposure.
  • the imaging device has a shutter button that is operated by half-pressing and full-pressing
  • the control unit controls vibration of the vibrating device indicating a state of focus on the subject performed in response to half-pressing of the shutter button, and starts and controls the exposure performed in response to full-pressing of the shutter button. Vibration of the vibrating device may be controlled to indicate respective terminations.
  • the control unit may vary the vibration indicating the focus state by the vibration device according to the focal length.
  • the imaging information includes information as to whether the captured image acquired by the imaging device is a normal image or an error image
  • the control unit may control the vibration of the vibrating device such that the vibration indicating that the error image has been obtained is different from the vibration indicating that the normal image has been obtained.
  • the control unit may control the vibration of the vibration device to be OFF during the exposure of the imaging device.
  • the vibration drive signal indicating the alert information includes a signal that is hidden when the vibration mode of the vibration device is off or a signal that is visible when the vibration mode is off, and
  • the control unit is When the attention calling information having a signal that is hidden when the vibration mode is off is received during exposure of the image pickup device, vibration indicating the attention calling information is generated after the end of exposure of the image pickup device. , which controls the vibrating device above, When receiving the alert information having a signal that appears when the vibration mode is off during exposure of the imaging device, vibration indicating the alert information is generated during exposure of the imaging device.
  • the vibrating device may be controlled.
  • the alerting information may include at least one of information related to the remaining battery level, which is the driving power source of the imaging device, and information related to the shooting environment information.
  • the control unit may control the vibration of the vibration device so that the vibration indicating the operation information of each of the attached devices differs for each of the plurality of attached devices.
  • the control unit may control the first vibration and the second vibration indicating different information related to the imaging device so that the photographer can distinguish between the first vibration and the second vibration.
  • the shooting setting information may include at least one of shutter speed setting, frame rate setting, single shooting mode or continuous shooting mode setting, and shooting environment setting.
  • the state information of the imaging device includes type information of the accessory device attached to the camera body, form information of the accessory device, information on the gripping state of the imaging device by the photographer, and remaining driving power supply of the imaging device. and at least one of power consumption information of the camera body.
  • the imaging device has a zoom lens
  • the control unit may control the vibration of the vibration device, taking into account the vibration during driving of the zoom lens.
  • the control unit may control the vibration of the vibration device taking into consideration the vibration sound caused by the vibration device.
  • the imaging device has a mechanical shutter
  • the control unit may control the vibration of the vibration device in consideration of vibration during operation of the mechanical shutter.
  • the control unit may use the vibration information of the imaging device to control the next vibration of the vibration device.
  • An information processing method provides imaging environment information in an imaging apparatus including an imaging device that captures an image of a subject and a vibration device that presents vibrations to a photographer, Vibration of the vibration device is controlled based on at least one of setting information and state information of the imaging device.
  • a program includes shooting environment information in an imaging apparatus including an imaging device that captures an image of a subject and a vibration device that presents vibrations to a photographer, and shooting setting information set by the photographer. and, based on at least one of the state information of the imaging device, the information processing device is caused to execute a process of controlling the vibration of the vibration device.
  • FIG. 1A and 1B are a front view and a side view of an imaging device according to an embodiment of the present technology
  • FIG. 1 is a block diagram showing the functions and configuration of an imaging device according to an embodiment of the present technology
  • FIG. 1 is a schematic internal configuration diagram of an imaging device in which a lens unit is attached to a camera body, according to an embodiment of the present technology
  • FIG. 2 is a front view showing a state where an image sensor, a mechanical front curtain, and a mechanical rear curtain are observed along the optical axis direction from the lens side in the mechanical shutter mechanism of the imaging device according to the embodiment of the present technology
  • FIG. It is a figure which shows typically an example of the vibration presentation in the imaging device which concerns on embodiment of this technique.
  • FIG. 1 is a block diagram showing the functions and configuration of an imaging device according to an embodiment of the present technology
  • FIG. 1 is a schematic internal configuration diagram of an imaging device in which a lens unit is attached to a camera body, according to an embodiment of the present technology
  • FIG. 5 is a diagram illustrating an example of vibration presentation according to the length of exposure time and frame rate in the imaging device according to the embodiment of the present technology
  • FIG. 10 is a diagram illustrating a vibration presentation example that takes into consideration the vibration derived from a mechanical shutter in the imaging device according to the embodiment of the present technology
  • FIG. 10 is a diagram illustrating a vibration presentation example that takes into consideration the sound of the vibrating device in the imaging device according to the embodiment of the present technology
  • FIG. 10 is a diagram illustrating a vibration presentation example that takes into consideration the sound of the vibrating device in the imaging device according to the embodiment of the present technology
  • FIG. 5 is a diagram illustrating an example of vibration presentation that takes into consideration vibrations derived from lens driving in the imaging device according to the embodiment of the present technology
  • FIG. 5 is a diagram illustrating an example of vibration presentation that takes into consideration the remaining battery level and the power consumption of the camera body in the imaging device according to the embodiment of the present technology; It is a figure which shows typically an example of the vibration presentation in the imaging device which concerns on embodiment of this technique.
  • FIG. 10 is a flow diagram illustrating basic timing of turning off the vibration mode in vibration presentation in the imaging device according to the embodiment of the present technology;
  • FIG. 10 is a flow diagram when alerting information having a non-display signal is received when the vibration mode is off in vibration presentation in the imaging device according to the embodiment of the present technology;
  • FIG. 10 is a flow diagram when alerting information having a signal that is expressed when the vibration mode is off is received in vibration presentation in the imaging device according to the embodiment of the present technology; It is a figure explaining the vibration presentation example which considered the imaging information in the imaging device which concerns on embodiment of this technique.
  • FIG. 10 is a diagram illustrating an example of vibration presentation that takes into account the focal length (the state of focus on a subject) in the imaging device according to the embodiment of the present technology;
  • FIG. 7 is a diagram illustrating a vibration presentation example when a plurality of attached devices are attached to the imaging device according to the embodiment of the present technology;
  • FIG. 10 is a diagram illustrating vibration presentation that takes into account the type of attachment device to be worn in the imaging device according to the embodiment of the present technology;
  • FIG. 10 is a diagram illustrating vibration presentation that takes into account the type of attachment device to be worn in the imaging device according to the embodiment of the present technology
  • FIG. 10 is a diagram illustrating vibration presentation that takes into account the type of attachment device to be worn in the imaging device according to the embodiment of the present technology
  • FIG. 5 is a diagram illustrating vibration presentation that takes into account the type of lens used and the gripping state in the imaging device according to the embodiment of the present technology
  • FIG. 10 is a diagram illustrating vibration presentation that takes into account the zoom state and grip state of the lens used in the imaging device according to the embodiment of the present technology
  • FIG. 10 is a diagram illustrating vibration presentation in consideration of a gripping state of a lens to be used in the imaging device according to the embodiment of the present technology
  • FIG. 5 is a diagram illustrating vibration presentation that takes into account the orientation (orientation) when the imaging device according to the embodiment of the present technology is used;
  • FIG. 10 is a diagram illustrating vibration presentation that takes into account the occurrence of camera shake when using the imaging device according to the embodiment of the present technology; It is a flow figure explaining an information processing method concerning vibration presentation in an imaging device concerning an embodiment of this art.
  • FIG. 4 is a diagram illustrating a processing example of audio data acquired by a microphone of an imaging device according to an embodiment of the present technology; It is a figure explaining other examples of a vibrating device used for an imaging device concerning an embodiment of this art.
  • 1 is an example of a vibrating device (voice coil motor) used in an imaging device according to an embodiment of the present technology;
  • FIG. 1 an interchangeable lens type digital camera is shown as an imaging device 1 as an example of an imaging device, but the imaging device is not limited to such an example.
  • the imaging device may be a lens-integrated digital camera, a film camera, a video camera, or any other device capable of capturing still images.
  • FIG. 1 is an external configuration diagram of an imaging device 1 according to an embodiment.
  • FIG. 1(A) is a front view of the imaging device 1
  • FIG. 1(B) is a side view thereof.
  • FIG. 2 is a block diagram mainly showing the functions and internal configuration of the imaging device 1.
  • FIG. 3 is a schematic internal configuration diagram of an imaging device in which a lens unit is attached to a camera body.
  • the imaging device 1 includes a camera body 2 as an information processing device and a lens unit 81 as an interchangeable lens.
  • a lens unit 81 is a photographing lens that can be attached to and detached from the camera body 2 .
  • the camera body 2 has a ring-shaped mount section to which the lens unit 81 is attached at substantially the center of the front surface, and a detach button for attaching and detaching the lens unit 81 near the ring-shaped mount section.
  • the camera body 2 has a housing 20.
  • the housing 20 has a grip portion 21 on the front left end portion (on the right side as viewed from the back) to be gripped by the photographer.
  • a shutter button 39 for instructing the start of exposure or the like is provided on the front side of the upper surface of the grip portion 21 .
  • a mode dial 38 is provided on the upper surface of the camera body 2 .
  • the mode dial 38 By turning the mode dial 38, the photographer can select a desired shooting mode.
  • the mode dial 38 has, for example, a single shooting mode, a continuous shooting mode, an automatic setting shooting mode, a shooting mode in which only the exposure (shutter speed and aperture) is automatically set, an aperture priority mode, a manual exposure mode, and the like.
  • the shutter button 39 is composed of a push-down switch capable of detecting a "half-pressed state" where it is pushed halfway and a "full-pressed state” where it is further pushed.
  • preparatory operations for photographing the subject are executed.
  • this preparatory operation for example, exposure control value setting, focus detection, and the like are assumed.
  • a photographing operation is performed.
  • this photographing operation a series of operations are assumed in which an imaging device, which will be described later, is exposed, and image data obtained by the exposure is subjected to predetermined image processing and recorded on a recording medium.
  • An electronic viewfinder 22 is provided on the upper part of the center of the rear surface of the camera body 2 .
  • a subject image from the lens unit 81 is guided to the electronic viewfinder 22 .
  • the photographer can visually recognize the subject by looking through the electronic viewfinder 22 .
  • a display 53 which will be described later, is provided at substantially the center of the rear surface of the camera body 2 (more specifically, at a slightly left position).
  • the display 53 is configured as, for example, a color liquid crystal display.
  • the display 53 can display through images, captured images, reproduced images, and the like.
  • the display 53 can display a user interface screen for mode setting and the like other than when shooting.
  • a touch sensor 34 which will be described later, is arranged on the display 53 to enable touch operations, so that the photographer can perform input operations such as mode setting on the display 53 . For example, by touching the display 53, it is possible to set the shooting environment such as selecting an underwater shooting mode as a setting of camera shooting image quality, selecting a glove mode as a setting of touch panel sensitivity, and the like.
  • the vibration mode is a method that allows information about the imaging device to be fed back to the photographer as vibrotactile feedback using a vibration device, which will be described later.
  • a vibration device 51 is provided inside the housing 20 of the camera body 2 . By driving and vibrating the vibrating device 51 , a vibratory tactile sensation is presented to the photographer holding the imaging device 1 .
  • information related to the image pickup apparatus 1 such as operation information of the image pickup apparatus 1, alert information, operation information of the attached device 8, and image pickup information acquired by the image pickup apparatus 1, is sent to the photographer via the vibration device 51. It is fed back as a vibrotactile sensation using The photographer can intuitively grasp the information related to the imaging device 1 by the tactile presentation by vibration. Details will be described later.
  • various accessory devices can be detachably attached to the camera body 2.
  • the imaging device 1 includes a camera body 2 and an accessory device 8. As shown in FIG. 2, the imaging device 1 includes a camera body 2 and an accessory device 8. As shown in FIG. 2, the imaging device 1 includes a camera body 2 and an accessory device 8. As shown in FIG. 2, the imaging device 1 includes a camera body 2 and an accessory device 8. As shown in FIG. 2, the imaging device 1 includes a camera body 2 and an accessory device 8. As shown in FIG. 2, the imaging device 1 includes a camera body 2 and an accessory device 8. As shown in FIG.
  • the accessory device 8 is a device configured to be detachable from the camera body 2 .
  • the accessory device 8 includes, for example, a lens unit 81, a support 82 such as a tripod, a gimbal 83, an external flash 84, a monitor 85, a high-sensitivity microphone 86, and the like. Two or more of these accessory devices 8 can be used in combination as needed.
  • Attached devices 8 each include a communication section configured to be communicable with a communication section 6 (described later) of camera body 2 .
  • the camera body 2 includes an input system device 3, a control section 4, an output system device 5, a communication section 6, a storage section 7, a mode dial 38, a shutter button 39, a battery 74, and a monitoring section 75. , an attached device database (hereinafter referred to as an attached device DB) 71 , an environment information database (hereinafter referred to as an environment information DB) 72 , and a user attribute and camera spec information section 73 .
  • an attached device database hereinafter referred to as an attached device DB
  • an environment information database hereinafter referred to as an environment information DB
  • the input system device 3 includes an imaging element 31, an acceleration sensor 32, a gyro sensor 33, a touch sensor 34, a pressure sensor 35, an infrared sensor 36, a microphone 37, and the like.
  • the imaging element 31 has a plurality of light receiving elements for photographing.
  • the imaging element 31 is configured by a CMOS (Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge Coupled Device), or the like.
  • the imaging device 31 captures an image of a subject.
  • surrounding information of the imaging device 1, that is, imaging environment information can be acquired.
  • Imaging information (imaging data) acquired by the imaging device 31 is transmitted to the control unit 4 .
  • the acceleration sensor 32 is fixedly arranged inside the camera body 2 and detects acceleration generated in the imaging device 1 .
  • the gyro sensor 33 is fixedly arranged inside the camera body 2 and detects the angular velocity generated in the imaging device 1 . Vibration information of the imaging device 1 can be detected using the sensing result of the gyro sensor 33 . As a result, it is possible to obtain vibration information of the imaging device, such as how the imaging device 1 vibrates due to camera shake or vibration of the vibrating device.
  • the sensing result of the acceleration sensor 32 can be used to calculate the acceleration distribution in the imaging device 1 and estimate the gripping state of the imaging device 1 by the photographer.
  • An IMU Inertial Measurement Unit having an acceleration sensor and a gyro sensor may be used. Acceleration information (acceleration data) and angular velocity information (angular velocity data) acquired by the acceleration sensor 32 and the gyro sensor 33 are transmitted to the control unit 4 . Further, the sensing results of the acceleration sensor 32 and the gyro sensor 33 may be reflected in the generation of the next vibration output waveform. For example, the control unit 4 may determine from the sensing result that the gripping force of the photographer is large and thus the vibration is not easily transmitted to the photographer, and may control the vibration so as to increase the vibration in the next vibration. In this way, the sensing result of the sensor may be fed back to the next vibration waveform.
  • the touch sensor 34 is a sensor that enables touch operation of the display 53 .
  • the touch sensor 34 receives an input operation from the photographer. Input operation information detected by the touch sensor 34 is transmitted to the control unit 4 .
  • the pressure sensor 35 detects, for example, the gripping force of the photographer.
  • the detected pressure value is sent to the controller 4 .
  • the sensing result of the pressure sensor 35 it is possible to grasp how much force the photographer is holding the imaging device 1 with.
  • the gripping state information of the photographer acquired using the sensing result of the pressure sensor 35 may be reflected in the generation of the next vibration output waveform.
  • the infrared sensor 36 is arranged near the electronic viewfinder 22 .
  • the infrared sensor 36 detects whether or not the photographer's eyes are close to the electronic viewfinder 22 .
  • a detection result of the infrared sensor 36 is transmitted to the control unit 4 .
  • Information on the use of the electronic viewfinder 22 by the photographer can be obtained from the detection result of the infrared sensor 36 .
  • the usage information is shooting environment information.
  • the microphone 37 collects surrounding sounds.
  • the collected sound data is transmitted to the control unit 4 .
  • Shooting environment information (surrounding information) of the imaging device 1 can be obtained from audio data collected by the microphone 37 .
  • a battery 74 is a driving power source for the imaging device 1, and is, for example, four AA dry batteries.
  • the battery 74 is stored, for example, in a battery storage chamber located inside the grip portion 21 of the camera body 2 .
  • a monitoring unit 75 monitors the remaining amount of the battery 74 and the power consumption of the camera body 2 . Information obtained by the monitoring unit 75 is output to the control unit 4 .
  • the controller 4 is powered by a battery 74 .
  • the control unit 4 controls the operation of the imaging device 1 as a whole.
  • the control unit 4 controls vibration of the vibration device 51 based on at least one of shooting environment information in the imaging device 1 , shooting setting information set by the photographer, and state information of the imaging device 1 .
  • This control of vibration includes not only adjustment of the vibration waveform but also control of non-vibration.
  • the control unit 4 acquires shooting environment information based on sensing results from the input device 3 .
  • the control unit 4 uses the sensing results to obtain information such as information that the shooting location is a snowy mountain or downtown, information that the location is quiet or noisy, usage information of the electronic viewfinder 22 by the photographer, and the like. obtain shooting environment information.
  • the control unit 4 acquires input operation information by the photographer using the touch-operable display 53, the mode dial 38, etc., and acquires shooting setting information.
  • the state information of the imaging device includes type information of the attached device 8 attached to the camera body 2, form information of the attached device 8, information on the holding state of the imaging device 1 by the photographer, and a battery as a driving power source of the imaging device 1. At least one of 74 remaining amount information is included.
  • a specific vibration control example according to the state information of the imaging device will be described later.
  • the control unit 4 provides an audio signal for driving the speaker 52 so that at least one of the operation information of the imaging device 1, the alert information, the operation information of the attached device, and the imaging information acquired by the imaging device 1 is presented by voice. may be generated.
  • the control unit 4 may acquire information on the remaining amount of the battery 74 and the power consumption of the camera body 2 from the monitoring unit 75, and control the vibration of the vibration device 51 based on the information.
  • the output system device 5 includes a vibration device 51, a speaker 52, a display 53, and the like.
  • the vibration device 51 is supported by the housing 20 and arranged inside the housing 20 .
  • a linear vibration actuator, a voice coil motor, or the like can be used for the vibration device 51 . This makes it possible to easily present various tactile sensations.
  • a voice coil motor as the vibration device 51 will be given.
  • a voice coil motor is a vibration actuator for tactile presentation, and is a linear vibration actuator equipped with a vibrator that vibrates linearly.
  • a linear vibration actuator can present various tactile sensations by appropriately controlling the amplitude and vibration frequency of a linearly moving vibrator.
  • the linear vibration actuator in addition to the voice coil motor, it is possible to use an actuator capable of providing a tactile sensation by pressure, an LRA (Linear Resonant Actuator), an actuator using a piezoelectric element, or the like.
  • LRA Linear Resonant Actuator
  • actuators are examples of vibration devices according to the present embodiment.
  • FIG. 30 is a schematic diagram showing a configuration example of a voice coil motor as the vibration device 51.
  • the vibration device 51 has a vibrator 56 and a stator 57 .
  • the vibration device 51 is a linear actuator that generates vibration by reciprocating the vibrator 56 with respect to the stator 57 along a predetermined direction.
  • the direction in which the vibrator 56 moves (horizontal direction in the figure) is referred to as the vibration direction.
  • the vibrator 56 has, for example, a columnar shape whose axis is the vibration direction.
  • a coil 54 is formed by winding an electric wire or the like around the side surface of the vibrator 56 .
  • the stator 57 is fixed to the housing 20 and has a cylindrical space that accommodates the vibrator 56 so as to be movable along the vibrating direction.
  • a magnet 55 is arranged on the inner surface of the cylindrical space with one magnetic pole (S pole or N pole) facing the vibrator 56 side.
  • the vibrator 56 and the stator 57 are connected to each other via an elastic body such as a spring (not shown).
  • the vibrator 56 reciprocates along the vibration direction.
  • the reaction force generated by this reciprocating motion acts on the housing 20 of the camera body 2, causing the camera body 2 itself to vibrate.
  • the vibration device (voice coil motor) 51 is driven, for example, by voltage drive.
  • a voltage signal (hereinafter referred to as a drive signal) for driving the vibrating device 51 is applied to the coil 54 from a battery 74 as a drive source.
  • This drive signal is generated by the controller 4 .
  • the vibration device (voice coil motor) 51 for example, by controlling the width and period of the reciprocating motion of the vibrator 56, it is possible to generate vibration with arbitrary amplitude over a wide frequency band. Therefore, it can be said that the voice coil motor is a broadband actuator that generates broadband vibration. As a result, it is possible to significantly improve the expressive power of haptics.
  • the specific configuration of the vibration device (voice coil motor) 51 is not limited.
  • a moving coil type motor in which a coil 54 is formed in a vibrator 56 as shown in FIG. 30
  • a moving magnet type motor in which a magnet 55 is arranged in a vibrator 56 may be used.
  • a configuration in which the stator 57 is provided inside the vibrator 56 may be adopted.
  • the size, shape, etc. of the voice coil motor may be appropriately set according to, for example, the size of the camera body 2 to be mounted.
  • the speaker 52 outputs audio based on the audio signal generated by the controller 4 .
  • a speaker using a piezoelectric element can be used as the speaker 52 .
  • the display 53 can display through images, captured images, reproduced images, shooting mode setting screens, etc., as described above.
  • the communication unit 6 communicates with a device different from the camera body 2, such as an accessory device 8, and is configured to be capable of transmitting and receiving various types of information.
  • the storage unit 7 stores data necessary for processing in the camera body 2 as an information processing device.
  • the storage unit 7 stores digital data (image data) captured by an image sensor.
  • the storage unit 7 stores, for example, a program related to vibration control of a vibrating device, which implements the functions of the control unit 4 by being executed by a CPU (Central Processing Unit).
  • the storage unit 7 is implemented by combining storage devices such as ROM (Read Only Memory) and RAM (Random Access Memory), and removable storage media such as optical discs, magnetic discs, and semiconductor memories as necessary. Therefore, the above program may be downloaded from a network (not shown) and stored in a storage device, or may be stored in a removable storage medium in advance.
  • the attached device DB 71 stores information about attached devices such as the weight of the attached device 8 .
  • the environment information DB 72 stores information in which environment information estimated from the sensing result of the input device 3 is associated with the drive signal (vibration waveform) of the vibration device suitable for the environment.
  • the user attribute and camera spec information section 73 stores user attribute information and spec information of the camera body 2 .
  • the user attribute information is information such as the age and gender of the photographer. In general, since sensitivity differs depending on age and gender, the user attribute information can be used to finely adjust the intensity of vibration in the vibrating device.
  • FIG. 3 shows the main internal configuration of the camera body 2, including a mode dial 38, a shutter button 39, an attached device DB 71, an environment information DB 72, a user attribute and camera spec information section 73, a battery 74, and a monitor. Illustrations of the input system devices other than the unit 75, the imaging device 31, and the output system devices other than the vibration device 51 are omitted.
  • the lens unit 81 has a photographing lens 814, a lens control section 811, a lens driving section 812, an aperture driving section 813, an aperture 815, a zoom driving mechanism 816, a zoom position detecting section 817, and a communication section 810.
  • Lens units include a single focus lens unit that has a fixed focal length and cannot zoom, and a zoom lens unit that can zoom. In the following description of the lens unit, an example using a zoom lens will be described.
  • the photographing lens 814 is movable in the optical axis direction.
  • the photographing lens 814 is represented as one lens, but in reality it is composed of a plurality of lenses such as a focus lens and a zoom lens.
  • a lens control unit 811 controls driving of a photographing lens 814 via a lens driving unit 812, drives an aperture 815 via an aperture driving unit 813, and controls the aperture in accordance with subject brightness during shooting operation.
  • the position of the zoom lens can be moved by manually operating the zoom drive mechanism 816, for example, by the photographer.
  • the position (focal length) of the moved zoom lens is detected by a zoom position detection unit 817 and sent to the lens control unit 811 . As shown in FIG.
  • the communication section 810 of the lens unit 81 is connected to the communication section 6 built in the camera body 2 via the communication contacts A of the lens unit 81 and the camera body 2 .
  • the lens unit 81 and the camera body 2 can exchange information with each other.
  • the lens control unit 811 transmits zoom information such as the type of the lens unit 81, the focal length, and the focal position (focus position) via the communication units 810 and 6 to the control unit.
  • Attached devices other than the lens unit also have a communication unit, and the camera body and the attached device are connected via communication contacts so that information can be transmitted and received between them.
  • the control unit 4 of the camera body 2 can acquire the type of attached accessory device and the operation information of the attached device.
  • the operation information of the attached device is, for example, charging completion information of the external flash attached to the camera body, input operation information on the monitor attached to the camera body, and the like.
  • the connection between the camera body and the accessory device through the communication contact may be referred to as "electrical connection”.
  • the camera body 2 includes a communication section 6, a mechanical shutter 11, an imaging element 31, a control section 4, and a vibration device 51.
  • the subject light flux that has passed through the imaging lens 814 and the diaphragm 815 of the lens unit 81 travels toward the imaging device 31 configured by a CMOS sensor, CCD, or the like.
  • Each pixel of the imaging device 31 photoelectrically converts the subject optical image formed by the lens unit 81 according to the amount of light while being exposed, and accumulates the obtained charge.
  • the accumulated electric charge is sent to a signal processing section (not shown) of the camera body 2 , and the imaging data generated in real time by the signal processing section is displayed on the electronic viewfinder 22 and the display 53 . Thereby, the photographer can observe the subject image through the electronic viewfinder 22 and the display 53 .
  • a focal plane shutter (hereinafter referred to as a mechanical shutter) 11, which is a mechanical shutter, is arranged on the object side (lens side) of the imaging device 31.
  • the mechanical shutter 11 has a front curtain (hereinafter referred to as a mechanical front curtain) composed of a plurality of light shielding blades and a rear curtain (hereinafter referred to as a mechanical rear curtain) composed of a plurality of light shielding blades.
  • an imaging apparatus having a mechanical shutter mechanism that performs a shooting operation using the mechanical front curtain and the mechanical rear curtain of the mechanical shutter 11 will be described as an example, but the present invention is not limited to this.
  • the present technology can also be applied to an imaging device having a hybrid shutter mechanism that includes an electronic front curtain and a mechanical rear curtain performed by an image sensor, or an electronic shutter mechanism that includes an electronic front curtain and an electronic rear curtain performed by an image sensor. can be applied.
  • one imaging apparatus may be configured to be able to use any of a mechanical shutter mechanism, an electronic shutter mechanism, and a hybrid shutter mechanism. A hybrid shutter mechanism and an electronic shutter mechanism will be described later.
  • FIG. 4 is a front view showing how the imaging device 31, the mechanical front curtain 111, and the mechanical rear curtain 112 are observed from the lens side along the optical axis direction.
  • FIG. 4 shows a state in which the mechanical front curtain 111 and the mechanical rear curtain 112 of the mechanical shutter 11 shield a partial area of the image sensor 31 from light.
  • a mechanical shutter 11 constitutes a front curtain and a rear curtain.
  • a mechanical front curtain 111 covering the image pickup device 31 is run to open the light incident on the image pickup device 31 , and then a mechanical rear curtain 112 is run to block the light incident on the image pickup device 31 . This realizes an imaging operation (mechanical shutter operation) by the mechanical shutter.
  • the charge accumulation area 310 formed by the slit between the edge 111 a of the mechanical front curtain 111 and the edge 112 a of the mechanical rear curtain 112 is shielded by the mechanical front curtain 111 and the mechanical rear curtain 112 .
  • This is an area where electric charges are accumulated by exposure in the imaging device 31 .
  • the charge accumulation area 310 moves in the direction of the arrow 113 as the mechanical front curtain 111 and the mechanical rear curtain 112 run.
  • the time from when the edge 111a of the mechanical front curtain 111 passes through, that is, when light is released to enter the image sensor 31, to when the mechanical rear curtain 112 enters a light shielding state, is the charge accumulation time due to pixel exposure. becomes. Therefore, by adjusting the slit width a, the charge accumulation region 310 can be changed and the exposure time can be adjusted.
  • a vibrating device 51 is mounted on the camera body 2, and information related to the imaging device is fed back to the photographer as a vibrotactile sensation by the vibrating device 51.
  • the information related to the imaging device includes at least one of operation information of the imaging device 1 , alert information, operation information of the attached device 8 , and imaging information acquired by the imaging device 1 .
  • Information related to the imaging device is fed back to the photographer as vibrotactile sensation by the vibrating device 51, so that the photographer can intuitively grasp the information related to the imaging device.
  • FIG. 5 shows an example of presenting operation information of the imaging device 1 to the photographer by means of sound and vibration.
  • S1 indicates the in-focus time
  • S2 indicates the shutter time.
  • Focus completion indicates the state of focus on the object.
  • the shutter button 39 When the shutter button 39 is fully pressed, a photographing operation is performed.
  • the start of photographing that is, the start of exposure in the imaging element 31 is fed back to the photographer by the vibration 62 of the vibrating device 51 along with the sound of "ka".
  • a vibration 62 indicates that the mechanical front curtain 111 starts running.
  • the end of photographing that is, the end of exposure in the imaging device 31 is fed back to the photographer by the vibration 63 of the vibrating device 51 together with the sound of "Shang”.
  • a vibration 63 indicates that the mechanical trailing curtain 112 has finished running.
  • the photographer can intuitively grasp the operation of the imaging device 1 .
  • the audio mode can be set to off. Even if such audio presentation is not possible, it is possible to present the operation of the imaging device 1 to the photographer by means of vibration.
  • the vibration 61 indicating completion of focusing, the vibration 62 indicating the start of exposure, and the vibration 63 indicating the end of exposure are presented so that the photographer perceives that they are different vibrations. It is possible to accurately grasp the state of the imaging device.
  • the vibration waveforms of the vibrations 61-63 may be different from each other. As a result, the photographer can distinguish different pieces of operation information in the imaging device 1 and grasp them more accurately.
  • two or more of the vibration waveforms of the vibrations 61 to 63 may have the same vibration waveform.
  • the vibration 61 occurs after the shutter button 39 is half-pressed, and the vibrations 62 and 63 occur after the shutter button 39 is fully pressed. Since it is possible to intuitively grasp whether it is the one at the time of focusing or the one at the time of shutter, the vibration waveforms may be the same.
  • Vibration feedback indicating the alerting information, the operation information of the attached device 8, and the imaging information acquired by the imaging device 1 will be described later.
  • Vibration control mainly indicating operation information of the imaging apparatus by the control unit 4 will be described as an example.
  • the example of vibration control described below is also applied to control of vibration indicating each of alerting information, operation information of the attached device 8, and imaging information acquired by the imaging apparatus 1, which will be described later.
  • the vibration control examples given below can be used alone or in combination.
  • information related to the image capturing apparatus such as operation information of the image capturing apparatus 1, alert information, operation information of the attached device 8, and image capturing information, is transmitted to the photographer by vibration of the vibration device 51 mounted on the camera body 2.
  • the information related to the imaging device is fed back to the photographer as a vibrotactile sensation
  • the information indicated by each vibration is presented in a perceptible manner to the photographer.
  • the vibration 62 indicating the start of exposure and the vibration 63 indicating the end of exposure may be continuous depending on the shutter speed (length of exposure time) and frame rate, and the photographer may not be able to distinguish between them. be.
  • the process of making intermittent vibrations so that the two first vibrations and the second vibrations indicating different information related to the imaging device are connected and not perceived as continuous vibrations is referred to as connection prevention. called processing.
  • the connection prevention processing allows the photographer to distinguish between the first vibration and the second vibration, and to appropriately determine what information the presented vibration indicates.
  • connection prevention processing will be described by exemplifying two different operations in the image capturing apparatus 1, that is, two vibrations indicating the start of exposure and the end of exposure, but is not limited to this.
  • the connection prevention processing can be applied to prevent connection of vibrations indicating two different pieces of information.
  • the vibration indicating the two pieces of information may be, for example, the vibration indicating the operation of the imaging device and the vibration indicating the alert, or the vibration indicating the operation of the imaging device and the vibration indicating the operation of the attached device.
  • vibration indicating the operation of the imaging device and vibration indicating imaging information may be used.
  • the vibration indicating the above two pieces of information may be a vibration indicating alert and a vibration indicating operation of the attached device, or may be a vibration indicating alert and vibration indicating imaging information. Vibration indicating the operation of the device and vibration indicating imaging information may be used. Moreover, both of the vibrations indicating the above two pieces of information may be vibrations indicating a call for attention, and both may be vibrations indicating the operation of the attached device.
  • FIGS. 6(A) and (C) show examples of vibration waveforms of the vibration device 51 in this embodiment
  • FIGS. 6(B) and (D) show examples of vibration waveforms of the vibration device 51 in the comparative example.
  • the horizontally extending axis indicates the time axis.
  • the vibration 62 indicating the start of exposure and the vibration 63 indicating the end of exposure are intermittent vibrations, and the photographer distinguishes between them. can be perceived separately.
  • the vibration 62 indicating the start of exposure and the vibration 63 indicating the end of exposure become continuous vibration 640. The photographer cannot distinguish between the two.
  • the vibration waveform can be changed according to the exposure time.
  • the vibration 62 and the vibration 63 are separated so that the photographer can perceive the vibration 62 indicating the start of exposure and the vibration 63 indicating the end of exposure as separate vibrations.
  • 63 generates vibration so as to form an intermittent vibration waveform.
  • vibration waveforms different from those when the exposure time is long for example vibration waveforms with a shorter driving time, are used to generate vibration 62' indicating the start of exposure and vibration 63' indicating the end of exposure.
  • each vibration is controlled so that the vibration 62' and the vibration 63' become intermittent vibration waveforms, and the photographer can separately generate the vibration 62' indicating the start of exposure and the vibration 63' indicating the end of exposure. can be perceived to exist.
  • the vibration device By controlling the vibration device so that the vibration waveform differs according to the exposure time, the photographer can perceive both vibrations separately.
  • the vibration 62 indicating the start of exposure and the vibration 63 indicating the end of exposure become intermittent. It can be perceived separately.
  • the vibration 62 indicating the start of exposure and the vibration 63 indicating the end of exposure are continuous. The vibration becomes 640, and the photographer cannot distinguish between the two.
  • the vibration waveform can be changed according to the numerical value of the frame rate.
  • the vibration 62 indicating the start of exposure and the vibration 63 indicating the end of exposure can be perceived by the photographer as separate vibrations.
  • the vibration 62 and the vibration 63 generate intermittent vibration waveforms.
  • the numerical value of the frame rate is large, vibration is generated with a vibration waveform different from that when the numerical value of the frame rate is small, for example, a vibration waveform with a shorter driving time.
  • each vibration is controlled so that the vibration 62' and the vibration 63' become intermittent vibration waveforms, and the photographer can separately generate the vibration 62' indicating the start of exposure and the vibration 63' indicating the end of exposure. can be perceived to exist.
  • the vibration device By controlling the vibration device so that the vibration waveform differs according to the frame rate, the photographer can perceive both vibrations separately.
  • the photographer Based on at least one of the shutter speed and frame rate set by the photographer, in other words, based on the shooting setting information, by controlling the vibration waveform indicating the start of exposure and the vibration waveform indicating the end of exposure, the photographer can vibration can be distinguished and perceived.
  • the driving signal for driving the vibrating device 51 is input to the vibrating device 51, as shown in the lower diagrams of FIGS.
  • the shooting setting information is, for example, single shooting mode or continuous shooting mode, shutter speed, frame rate during continuous shooting, and the like.
  • connection prevention processing may be performed based on the shooting setting information by the photographer.
  • vibration waveform information may be prepared in advance so that the photographer can distinguish and perceive two different vibrations (in this example, the vibration at the start of exposure and the vibration at the end of exposure) for each shutter speed and frame rate. good.
  • the waveforms do not overlap and form an intermittent waveform, but when output from the vibrating device, the waveforms overlap and become a continuous waveform.
  • To In this case To ⁇ 0.
  • the difference between Ti and To changes depending on the characteristics of the vibrating device and the operating frequency.
  • the difference between Ti and To can be obtained in advance by combining the vibrating device and the camera body 2 on which the vibrating device is mounted.
  • the weight and center of gravity of the entire imaging apparatus differ depending on the type and number of attached devices attached to the camera body 2 and the form of the attached devices.
  • the difference between Ti and To can be obtained in advance for each type and number of attachment devices to be attached, and for each form of attachment device.
  • connection prevention process may be performed using the previously obtained difference between Ti and To.
  • connection prevention processing may be performed based on the state information of the imaging device.
  • the difference between Ti and To may change in real time depending on how the photographer grips the imaging device 1 and how hard it is gripped.
  • the vibration information of the imaging device is acquired using the sensing results of the pressure sensor 35, the acceleration sensor 32, the gyro sensor 33, etc., and the difference between Ti and To is corrected using the vibration information, and the next vibration is detected. may be reflected in the generation of the output waveform of
  • the human's temporal two-point discrimination ability is roughly 10 ms to 50 ms.
  • Th by controlling the vibration by adjusting the interval time between the two vibrations so that To>Th, the photographer can sense different temporally. It is possible to perceive the two vibrations generated at the same time as intermittent vibrations.
  • vibration waveform information may be prepared in advance based on the characteristics of the vibration device 51 so that the photographer can perceive two different vibrations as intermittent vibrations. .
  • connection prevention processing that makes it difficult to perceive two different vibrations as continuous vibrations is given below. The following examples can be combined as appropriate.
  • Connection prevention processing can be performed by changing the interval time (interval), drive time, intensity (amplitude), and frequency in the vibration waveform input to the vibration device.
  • the interval time is short, two different vibrations are connected and easily perceived as continuous vibrations. Therefore, by changing the waveform so as to lengthen the interval time, it becomes easier to perceive two different vibrations.
  • the driving time is long, two different vibrations are connected and easily perceived as continuous vibrations. Therefore, by changing the waveform so as to shorten the drive time, it is easier to perceive two different vibrations.
  • the intensity is weak, two different vibrations are connected and easily perceived as a continuous vibration. Therefore, by changing the waveform so as to increase the intensity, it becomes easier to perceive two different vibrations.
  • the frequency depends on human sensitivity characteristics. Since the sensitivity is high at frequencies of 200 Hz to 250 Hz, two different vibrations are likely to be connected and perceived as continuous vibrations. Therefore, by setting the frequency outside the above range, it becomes easier to perceive two different vibrations.
  • the vibration waveform can be changed to perform connection prevention processing.
  • the type and form of the accessory device 8 in the imaging device 1 are status information of the imaging device.
  • the two different vibrations are likely to join together and be perceived as a continuous vibration. Therefore, by changing the interval time (interval), drive time, intensity (amplitude), frequency, etc. of the vibration waveforms input to the vibration device, as described above, two different vibrations can be generated according to the weight of the attached device. It becomes easy to perceive that it is.
  • the shape of the attached device differs depending on the type of attachment device, and the way of gripping the typical imaging device differs. A lens unit will be described as an example.
  • the photographer When holding an image pickup apparatus equipped with a single focal length lens unit, the photographer typically holds the camera body with both left and right hands.
  • the left hand of the photographer When holding an image pickup apparatus equipped with a zoom lens unit, the left hand of the photographer typically holds the zoom lens unit so as to support it, and the right hand holds the camera body.
  • the contact area between the camera body and the photographer's hand changes depending on the difference in gripping state for each attached device.
  • the contact area is small, two different vibrations are likely to be connected and perceived as continuous vibrations. Therefore, by changing the interval time (interval), drive time, intensity (amplitude), frequency, etc. of the vibration waveform input to the vibration device, as described above, two different vibrations can be generated according to the type of attached device. It becomes easy to perceive that it is. In this way, connection prevention processing may be performed based on the state information of the imaging device.
  • Connection prevention processing can be performed by changing the vibration waveform according to the characteristics of the vibration device 51 .
  • the vibration waveform can be changed according to the frequency-acceleration characteristics of the vibrating device. For example, when the input frequency is close to the resonance frequency, the vibration tends to linger even after the vibration caused by driving the vibrating device, and the vibration is likely to be perceived as a combination of two different vibrations. Also, the start-up of the vibrating device is delayed. Therefore, by setting the input frequency to be different from the resonance frequency, it becomes easier to perceive two different vibrations.
  • the vibration waveform can be changed according to the time response of the vibration device. For example, if the ice rises slowly due to vibration, it is likely to be perceived as vibration in which two different vibrations are connected.
  • the vibration waveform may be changed in consideration of the time responsiveness of the vibrating device. Since the characteristics of the vibration device can be obtained in advance, vibration waveform information may be prepared in advance based on the characteristics of the vibration device 51 so that the photographer can perceive the vibration as intermittent vibration. Information about what characteristics the vibration device 51 has in the camera body 2 is included in the state information of the imaging device. In this way, connection prevention processing may be performed based on the state information of the imaging device.
  • Connection prevention processing can be performed by changing the vibration waveform according to information that can change in real time, such as how the photographer grips the imaging device and the overload of the vibration device. For example, when the photographer grips the camera body 2 strongly, vibration is less likely to occur, and the vibration is likely to be perceived as a combination of two different vibrations. Therefore, as described above, the interval time (interval), drive time, strength (amplitude), frequency, etc. of the vibration waveform input to the vibration device can be changed according to the strength with which the photographer grips the camera body 2. are more likely to be perceived as two different vibrations.
  • Information on the grip of the imaging device 1 by the photographer is detected using the sensing results of the input system device 3 such as an acceleration sensor, a gyro sensor, and a pressure sensor. can be done.
  • the gripping information is included in the state information of the imaging device 1 .
  • the interval time (interval), drive time, strength (amplitude), frequency, etc. of the vibration waveform input to the vibration device according to the state of the vibration device two different vibrations can be obtained. It becomes easy to perceive that it is.
  • Information related to the vibration device is included in the state information of the imaging device 1 . In this way, connection prevention processing may be performed based on the state information of the imaging device.
  • connection prevention processing is performed to control vibrations so that vibrations indicating a plurality of different operations in the imaging device can be perceived as intermittent vibrations.
  • the vibration of the vibration device may be controlled so as not to perform the connection prevention process based on the shooting setting information. For example, when the underwater shooting mode is selected, the photographer perceives the vibration of the camera body 2 by the vibration device 51 to be smaller when shooting underwater than when shooting on the ground. Also, when the glove mode is selected, the photographer perceives the vibration of the camera body 2 due to the vibration device 51 to be smaller than that of shooting with bare hands.
  • the vibrating device may be controlled to maximize the strength of the vibration, as it may be perceived as a vibration.
  • the photographer can intuitively grasp the operation of the imaging device from the vibrations even in a situation where it is difficult to feel the vibrations.
  • vibration of the vibration device 51 may be controlled based on shooting setting information set by the photographer.
  • vibrations indicating two different information are intermittently perceived.
  • the vibrations are controlled so that the photographer can perceive the vibrations indicating the two different information separately. good too.
  • the intensity of both vibrations can be changed to such an extent that the photographer can perceive that the two vibrations indicate different information.
  • the imaging device 1 of this embodiment has a mechanical shutter mechanism.
  • the vibration 62 indicating the start of exposure is presented by driving the vibration device 51 .
  • vibration 63 indicating the end of exposure is presented by driving the vibration device 51 .
  • the control unit 4 may generate pseudo tactile vibrations so that the vibrations 62 and 63 presented to the photographer have desired vibration waveforms, taking into account the vibrations caused by the operation of the mechanical shutter. As shown in the schematic diagram of FIG. 7, the control unit 4 generates a pseudo tactile vibration 621 to be generated in accordance with the vibration waveform 114 originating from the mechanical shutter so that the vibration 62 has a desired vibration waveform. The control unit 4 generates a pseudo tactile vibration 631 to be generated in accordance with the vibration waveform 115 originating from the mechanical shutter so that the vibration 63 has a desired vibration waveform. In this way, when presenting a vibrotactile sensation in an imaging device having a mechanical shutter mechanism, a vibration waveform may be generated in consideration of the amount of vibration derived from the mechanical shutter.
  • FIG. 8 shows an example of vibration sound emitted from the imaging device 1, where the horizontal axis represents frequency and the vertical axis represents sound pressure level (decibel).
  • vibration noise hereinafter sometimes referred to as ringing
  • the degree of sound generation varies depending on not only the frequency band but also the magnitude of the sound pressure of the frequency component, the duration, and the like. For example, as shown in FIG.
  • the vibration of the vibrating device may be controlled so as to adjust the sound caused by the vibration of the vibrating device in accordance with the imaging environment information and the imaging setting information set by the photographer.
  • noise prevention processing such processing for preventing noise due to vibration of the vibrating device is referred to as noise prevention processing.
  • the vibrating sound emitted from the vibrating device 51 may bother the photographer.
  • the vibrating sound caused by the vibrating device 51 does not include a clearly audible frequency component so that the animal cannot escape.
  • the sound including the high frequency band sound in the audible band shown in FIG. As described above, it is possible to perform noise prevention processing for cutting high-frequency band components. Also, in a scene in the city, it is sufficient that the noise level is such that only the photographer himself/herself can hear it. can be processed.
  • the vibration of the vibrating device may be controlled by varying the frequency threshold when using the low-pass filter for noise prevention processing based on the imaging environment information.
  • the shooting environment information can be calculated using sensing results of the input device 3 . More specifically, the scene can be estimated by recognizing the through image (captured data) acquired by the imaging device 31 . Furthermore, the scene can be estimated with higher accuracy by adding audio data such as surrounding environmental sounds sensed by the microphone. In addition, it is possible to acquire ambient environmental sounds with a microphone and adjust the operating band and sound pressure of the vibration device 51 . A scene and a frequency threshold value used for noise prevention processing suitable for that scene may be associated with each other and stored in a database.
  • the behavior of the photographer may be learned, and information on combinations of mutually linked scenes and frequency thresholds may be automatically generated, and the database may be updated. For example, if the photographer always turns off the vibration mode in a particular scene, the database may store information that combines the specific scene and the vibration mode off.
  • the vibration of the vibrating device may be controlled so as not to perform the noise prevention process based on the shooting setting information set by the photographer.
  • FIG. 9 shows an audio waveform of vibration sound of the vibration device.
  • the horizontal axis represents time, and the vertical axis represents frequency.
  • an area B surrounded by a dashed line contains almost no high-frequency band components, so no noise prevention processing is performed.
  • Area C contains a slightly large amount of high frequency components. In this case, noise prevention processing is performed to cut high-frequency band components with a gentle low-pass filter.
  • Area D contains a considerable amount of high frequency band components. In this case, noise prevention processing is performed to cut all high-frequency components.
  • FIG. 10A shows a basic state in which the lens drive variable L1 is smaller than the drive threshold L.
  • FIG. 10B shows a state in which the lens drive variable L1 is greater than the drive threshold L.
  • t1 indicates the lens driving time.
  • t2 indicates an interval between the end of lens driving and the occurrence of vibration 61 indicating completion of focusing.
  • g1 indicates the acceleration of the imaging device 1 during lens driving, and g2 indicates the acceleration of the vibrating device 51 generated during focusing.
  • g0 indicates the acceleration of the vibrating device at the basic time and is set in advance.
  • a and b are coefficients.
  • the acceleration of the imaging device can be measured using the acceleration sensor 32, IMU, and microphone 37 mounted on the camera body 2.
  • FIG. 10A shows a basic state in which the lens drive variable L1 is smaller than the drive threshold L.
  • FIG. 10B shows a state in
  • the acceleration g2 of the vibration device 51 that generates vibration indicating completion of focusing is set to g0. Vibration by the vibration device 51 is generated after the lens is driven. In the basic state, the vibration of the vibrating device 51 is controlled so that the vibration due to driving the lens and the vibration 61 indicating the completion of focusing are separately perceived by the photographer.
  • the acceleration g2 of the vibration device 51 that generates vibration indicating completion of focusing is made greater than g0.
  • an interval t2 is provided.
  • the acceleration g2 of the vibration device 51 is made larger than g0, and an interval t2 is provided. This makes it easier for the photographer to distinguish between the vibration due to driving the lens and the vibration 61 indicating completion of focusing.
  • the vibration of the vibrating device 51 may be controlled in consideration of the vibration during driving of the lens.
  • the control unit 4 may determine whether or not vibration feedback is necessary according to the imaging environment information, the imaging setting information, and the like, and dynamically switch on/off of the vibration feedback (vibration mode).
  • vibration feedback from the vibration device it may be better to control the vibration feedback from the vibration device so that it is dynamically turned on and off.
  • the type of shooting environment is determined by image recognition of through-the-lens images (image data) acquired by the image sensor 31, voice recognition of voice data collected by the microphone 37, and global navigation satellite system (Global Navigation Satellite System).
  • GNSS Global Navigation Satellite System
  • System can be estimated from position information detected by a positioning unit such as a GNSS (GNSS) signal receiver.
  • the GNSS signal receiver may be mounted on the camera body 2, for example.
  • the control unit 4 uses the sensing result of the input device 3 to estimate that the scene is one in which the eyes or glasses of the photographer are near the imaging apparatus 1, and controls the vibration of the vibration device 51 to weaken. or control to turn off the vibration mode. As a result, it is possible to prevent the occurrence of injury to the photographer's eyes, damage to the spectacles, etc., which may startle the photographer due to the vibration.
  • the infrared sensor 36 can detect whether the eye is close to the electronic viewfinder 22 , that is, usage information of the electronic viewfinder. In addition to the infrared sensor 36, a proximity sensor, millimeter wave sensor, pressure sensor, or other sensor capable of detecting distance or area may be used.
  • the usage information of the electronic viewfinder is shooting environment information.
  • the vibration of the vibration device 51 may be dynamically controlled based on the shooting environment information.
  • the control unit 4 may control the vibration of the vibration device 51 according to the monitoring result of the remaining battery level and the power consumption of the camera body by the monitoring unit 75 .
  • Information on the remaining battery level and the power consumption of the camera body is included in the state information of the imaging device.
  • FIG. 11A is a diagram showing the relationship between remaining battery level and allowable power consumption.
  • the allowable power consumption is 1.0 when the remaining battery capacity is 100%.
  • the power consumption of the vibrating device 51 is, for example, about 1 W, which is relatively large.
  • the top diagram in FIG. 11B shows the vibration waveform of the vibrating device 51 when the allowable power consumption based on the remaining battery power is equal to or greater than the sum of the peak power consumption of the camera body and the power consumption of the vibrating device.
  • the lower two diagrams in FIG. 11B show vibration waveforms of the vibrating device 51 when the allowable commodity power based on the remaining battery power is smaller than the sum of the peak power consumption of the camera body and the power consumption of the vibrating device.
  • the signal of the vibrating device is controlled so that the magnitude of the vibration becomes smaller.
  • the power consumption can be reduced, and the camera body 2 does not shut down due to exceeding the permissible power consumption at the moment of vibration.
  • control is performed so that the vibration generation timing is shifted so that the vibration device 51 vibrates after the peak power consumption of the camera body 2 has passed. This prevents the camera body 2 from shutting down due to exceeding the permissible power consumption at the moment of vibration. In this way, the vibration of the vibrating device 51 may be controlled based on the power consumption information of the remaining battery level camera body.
  • the operation information of the imaging apparatus 1 such as focus completion, exposure start, and exposure end
  • the operation information of the imaging apparatus 1 is fed back to the photographer by vibrotactile sensation of the vibrating device 51.
  • a vibration device 51 may be used to present vibration 65 indicating alert information.
  • the vibrating 65 indicating the alert may be presented together with the voice alert.
  • the warning includes, for example, notification of low battery level, notification of dangerous surroundings such as an approaching dangerous object, and the like.
  • the low battery level notification is issued when the battery level 74 is low.
  • the information on the remaining battery level is information related to the remaining battery level of the battery 74 that is the driving power source of the imaging device 1 . It can be estimated using the sensing result of the input system device 3 that the surroundings are dangerous. More specifically, from the image recognition of the through image (image data) acquired by the image pickup device 31, the position information detected by the GNSS signal receiver, etc., the vehicle is approaching the photographer, the photographer is on a cliff, and so on. It is possible to estimate a scene such as being near a person. Furthermore, the scene can be estimated with higher accuracy by adding audio information such as surrounding environmental sounds sensed by the microphone.
  • the vibration drive signal indicating the alert information includes a signal that is hidden when the vibration mode is off or a signal that is visible when the vibration mode is off.
  • the vibration driving signal indicating information about the low battery level includes a signal that is hidden when the vibration mode is off.
  • the vibration drive signal indicating that the surroundings are dangerous includes a signal that appears when the vibration mode is off.
  • FIG. 13 is a processing flow explaining basic control of the vibrating device during exposure in the imaging apparatus 1 .
  • the control unit 4 acquires information that the shutter button 39 is fully pressed (ST1), it controls the image sensor 31 to start shooting, and during exposure (shooting). turns off the vibration of the vibrating device 51 (vibration mode off state) so as not to drive the vibrating device 51 .
  • control unit 4 When the control unit 4 acquires information that the exposure (ST2) in the imaging element 31 is finished and the imaged data has been sent to the signal processing unit, it cancels the vibration mode OFF state (ST3). This suppresses blurring of the captured image caused by vibration of the vibrating device during exposure.
  • FIG. 14 is a processing flow for explaining the control of the vibrating device when the control unit 4 receives information on low battery level, which is alerting information, during exposure.
  • the control unit 4 receives information that the shutter button 39 has been fully pressed (ST1), it controls the image sensor 31 to start shooting, and during exposure (shooting). puts the vibration mode off so as not to drive the vibration device 51 .
  • the control unit 4 receives information about the low battery level during exposure (ST4). Since the signal indicating the low battery level includes a signal that is hidden when the vibration mode is off, the control unit 4 does not drive the vibration device 51 during the vibration mode off state during exposure.
  • control unit 4 When the control unit 4 receives the information that the exposure (ST2) in the image sensor 31 is finished and the image data has been sent to the signal processing unit, it cancels the vibration mode off state and generates vibration indicating that the remaining battery level is low. A drive signal is transmitted to the vibration device 51 so as to cause it to move (ST5). The vibration device 51 vibrates based on the drive signal (ST6). As a result, it is possible to quickly notify the photographer that the remaining battery level is low while suppressing blurring of the captured image caused by vibrations during exposure.
  • FIG. 15 is a processing flow explaining control of the vibrating device when the control unit 4 receives information that the surroundings are dangerous during exposure.
  • the control unit 4 receives information that the shutter button is fully pressed (ST1), it controls the image sensor 31 to start shooting, and during exposure (shooting)
  • the vibration mode is turned off so that the vibration device 51 is not driven.
  • the control unit 4 receives information that the surroundings are dangerous during exposure. Since the signal indicating danger includes a signal that is hidden when the vibration mode is off, the control unit 4 generates vibration indicating that the surroundings are dangerous even during the vibration mode off state.
  • a drive signal is transmitted to the vibration device 51 so as to cause it to move (ST7).
  • the vibration device 51 vibrates based on the drive signal (ST8).
  • the photographer can recognize that the situation is dangerous due to the vibration.
  • the control unit 4 receives the information that the exposure (ST2) in the imaging device 31 is completed and the imaged data has been sent to the signal processing unit, it cancels the vibration mode OFF state (ST9).
  • the occurrence of serious damage such as an accident can be prevented, and the photographer can take pictures in a safe environment.
  • the imaging information includes information as to whether the captured image acquired by the imaging device 31 is a normal image or an error image.
  • the control unit 4 may control the vibrating device 51 so that the vibration indicating that the error image has been obtained differs from the vibration indicating that the normal image has been obtained.
  • An error image is an image in which a subject's eyes are closed, an image in which the subject is blurred, or the like.
  • a normal image is an image in which the subject's eyes are not closed and the subject is not blurred.
  • FIG. 16 shows the vibration presented at the time of shutter after the shutter button is fully pressed.
  • FIG. 16A shows an example of a vibration waveform when the photographed image is a normal image.
  • FIG. 16B shows an example of a vibration waveform when the captured image is an error image.
  • the control unit 4 performs image analysis on the imaging data and determines whether it is a normal image or an error image. For example, it is possible to determine whether blurring occurs in an image by edge detection. When the subject is a person, it is possible to determine whether or not the subject is blinking by facial image recognition. As shown in FIG.
  • the control section 4 presents to the photographer that the exposure is finished by one vibration of the vibrating device 51 .
  • the control unit 4 notifies the photographer that the exposure has ended by vibrating the vibrating device 51 a plurality of times, for example, three times. , to indicate that the captured image is an error image.
  • the vibration of the vibrating device 51 may be controlled according to the imaging information. As a result, the photographer can recognize that the image is an error image by the vibration without looking at the preview screen.
  • FIG. 17 is a schematic diagram for explaining the vibration indicating completion of focusing after the shutter button is half-pressed. Also, in FIG. 17, the circle indicated by reference numeral 15 indicates the position to be focused.
  • FIG. 17A shows an example of vibration waveforms when the focus is relatively close, that is, when the focal length is short.
  • FIG. 17B shows an example of vibration waveforms when the focus is relatively far, that is, when the focal length is long. As shown in FIGS.
  • the control unit 4 controls the vibration of the vibrating device 51 so that the vibration increases when the focal length is short and the vibration decreases when the focal length is long. may be controlled. This allows the photographer to intuitively grasp the length of the focal length.
  • the vibration indicating the difference in the length of the focal length is shown as the vibration 61 at the time of completion of focusing. A vibration may be presented.
  • control unit 4 performs image analysis of the imaging data acquired after the focus operation, and if it determines that the image data is out of focus, the control unit 4 vibrates a plurality of times, for example, three times, to notify the photographer that the image is out of focus. may be presented to
  • FIG. 18 is a perspective view of the imaging apparatus 1 to which a plurality of accessory devices are attached.
  • the imaging apparatus 1 shown in FIG. 18 includes a camera body 2 , a lens unit 81 as an accessory device 8 , an external flash 84 , a monitor 85 and a high-sensitivity microphone 86 .
  • Each accessory device 8 is attached to the camera body 2 directly or indirectly.
  • each accessory device When a plurality of accessory devices are attached to the camera body 2, actions performed by each accessory device may be fed back as vibrotactile feedback. At this time, different vibrations may be generated for each attached device so that the photographer can perceive the motion by distinguishing it by the vibration of which attached device.
  • the monitor 85 may be configured to be touch-operable, and vibration having a 200-Hz SIN wave and a two-pulse vibration waveform indicating that a touch operation has been performed may be emitted from the vibration device 51 .
  • the vibration waveform is a waveform similar to the feeling of pressing a button. Vibration having a 300 Hz SIN wave, 10-pulse vibration waveform may be emitted from the vibration device 51 to indicate that charging of the external flash 84 is complete. A vibration having a 150 Hz SIN wave, 3-pulse vibration waveform, indicating that the microphone level of the sensitive microphone 86 has exceeded the maximum may be emitted from the vibration device 51 . In this way, by changing the vibration waveform for each different accessory device, the photographer can intuitively grasp which accessory device's operation the vibration indicates.
  • the control unit 4 may turn the vibration mode on or off, or change the vibration waveform when the vibration mode is on, according to the type of accessory device attached to the camera body 2 .
  • Information about what accessory devices are attached to the camera body 2 is included in the state information of the imaging apparatus.
  • the control section 4 can determine the type of the accessory device 8 from the electrical connection information.
  • Information such as the weight of each attached device 8 is information known in advance depending on the type of the attached device 8 . For example, as the attachment device 8 becomes heavier, even if the vibration waveform is the same, the vibration tends to be less likely to be transmitted to the photographer.
  • control unit 4 can acquire state information of the imaging device 1 from the sensing results of the acceleration sensor and the gyro sensor when the attachment device 8 is attached.
  • FIG. 19 is a perspective view of the imaging apparatus 1 to which a gimbal 83 is attached in addition to the lens unit 81 as the attachment device 8.
  • FIG. 21 is a perspective view of the imaging apparatus 1 to which a support 82 such as a tripod is attached in addition to a lens unit 81 having a giant lens as an accessory device 8 .
  • the control unit 4 determines that the gimbal 83 and the support 82 are attached based on the electrical connection information and the sensing results of the acceleration sensor and the gyro sensor, it sets the vibration mode to off.
  • the gimbal 83 or support 82 is used, the camera body 2 is often not held by the photographer, so the vibration mode is turned off.
  • the controller 4 may turn off the vibration mode and switch to sound feedback control, that is, turn on the voice mode.
  • the vibration mode is turned off.
  • the external shutter is, for example, a wired or wireless shutter remote control.
  • the control unit 4 determines that the support 82 is attached as the attached device 8 and determines that the support 82 is placed in an unstable place, it generates a vibration that calls attention to consider the location of the support 82.
  • the vibrating device may be controlled to do so.
  • the determination that the post 82 is placed in an unstable place can be made, for example, by estimating that the position of the camera body 2 is not fixed from the sensing results of the imaging device, acceleration sensor, and gyro sensor. can be done.
  • the control section 4 may control the vibration of the vibrating device 51 according to the type of the lens unit 81 .
  • the typical way of holding the imaging device differs.
  • the lens unit is a single-focus lens
  • the photographer often does not hold the lens, and often holds the camera body 2 with both hands.
  • the lens unit is a normal size zoom lens
  • the photographer 10 often holds the lens with the left hand and the camera body 2 with the right hand, as shown in FIG.
  • FIGS. 20 and 21 when the lens unit 81 is a giant lens, the photographer 10 supports the lens with the left hand as shown in FIG. 20 and holds the camera body 2 with the right hand, or Posts 82 are used as shown.
  • the control section 4 can determine the type of the lens unit 81 when the lens unit 81 is attached to the camera body 2 .
  • the control unit 4 determines that a large lens that tends to cause camera shake is attached, the control unit 4 automatically sets the vibration mode to OFF. As a result, it is possible to prevent the vibration of the vibrating device from aggravating camera shake caused by the giant lens.
  • the control unit 4 determines that the lens unit 81 with a single focus lens is mounted and further determines that the distribution of acceleration in the camera body 2 is biased, the vibration waveform of the vibration device 51 is changed to that of the distribution of acceleration.
  • the drive signal may be controlled to be uniform or different.
  • the distribution of acceleration in the camera body 2 can be calculated using sensing results from the acceleration sensor. Based on the distribution result of the acceleration, for example, the control unit 4 sets the hand that feels the vibration weakly as a reference among the left and right hands holding the imaging device 1, and determines the acceleration generated by the vibrating device with respect to the reference sensitivity threshold.
  • the drive signal for the vibrating device 51 may be controlled so as to weaken the generated acceleration.
  • the control unit 4 determines that the lens unit 81 of the normal size zoom lens is mounted and further determines that the distribution of acceleration in the camera body 2 is uneven, the vibration waveform of the vibration device 51 is changed to the acceleration.
  • the drive signal may be controlled such that the distribution of is different from the case where is uniform.
  • the control unit 4 uses the sensitivity of the left hand side as a reference for the vibration related to the lens operation such as the vibration 61 indicating the completion of focusing, and the vibration related to the shutter such as the vibration 62 and 63 indicating the start/end of exposure.
  • the drive signal for the vibration device 51 may be controlled based on the sensitivity of the right hand side.
  • the controller 4 may turn off the vibration mode because the giant lens is likely to cause camera shake. .
  • the controller 4 determines that the lens unit 81 of the giant lens is mounted and further determines that the support 82 is also mounted, the controller 4 sets the vibration mode to OFF or reduces the vibration so that the vibration is weakened.
  • Device 51 may be controlled.
  • the vibration of the vibrating device 51 may be controlled in consideration of the type of lens unit and the gripping state of the photographer.
  • FIGS. 23A to 23C show forms with different zoom states.
  • the photographer 10 holds the camera body 2 with his right hand and his left hand along the lens unit 81 .
  • reference numeral 17 indicates the vibration generation position by the vibration device 51
  • reference numeral 18 indicates the contact position between the hand of the photographer 10 and the lens unit 81 .
  • FIG. 23A shows a state in which the lens zoom is not performed, and the contact position 17 between the hand of the photographer 10 and the lens unit 81 is located near the vibration generating position 18.
  • FIG. FIGS. 23B and 23C show states during lens zooming, and it is assumed that (C) has a higher zoom ratio than (B).
  • (C) has a higher zoom ratio than (B).
  • FIG. 23B the position of the hand is the same as in FIG.
  • FIG. 23C the position of the hand is different from that in FIG.
  • the contact position 17 between the hand of the photographer 10 and the lens unit 81 is located away from the vibration generating position 18 .
  • the controller 4 turns on the vibration mode when the zoom ratio z1 in the lens unit 81 is within the first threshold value Zh1.
  • the vibration acceleration of the vibration feedback may be controlled to weaken in accordance with the zoom rate, and blurring can be reduced.
  • the controller 4 turns off the vibration mode when the zoom ratio z1 in the lens unit 81 exceeds the first threshold value Zh1. This makes it possible to reduce blurring.
  • FIG. 23A the controller 4 turns on the vibration mode when the zoom ratio z1 in the lens unit 81 is within the first threshold value Zh1.
  • the vibration acceleration of the vibration feedback may be controlled to weaken in accordance with the zoom rate, and blurring can be reduced.
  • the controller 4 turns off the vibration mode when the zoom ratio z1 in the lens unit 81 exceeds the first threshold value Zh1. This makes it possible to reduce blurring.
  • the controller 4 holds the lens with the left hand of the photographer 10 and touches the lens. It is assumed that the position 17 and the vibration generation position 18 are located apart.
  • the control unit 4 controls the drive signal to strengthen the vibration of the vibration device 51 in order to reliably give vibration feedback to the left hand holding the lens.
  • the control unit 4 may control the vibration of the vibration device 51 according to the dynamically changing gripping state of the photographer 10 gripping the imaging device 1 .
  • the gripping state may change.
  • the force for gripping the lens unit 81 is weakened due to ergonomics, and a gap is likely to be created between the lens unit 81 and the palm.
  • the contact area tends to be smaller because the fingers are more often in contact than the entire palm.
  • the control unit 4 may change the vibration intensity, frequency, and vibration pattern of the vibration device according to the gripping state. Specifically, the controller 4 determines whether the photographer 10 is gripping the lens unit 81 from below as shown in FIG. 24(A) or from the side as shown in FIG. determine whether you are For example, when it is determined that the device is being held from the side, the acceleration is stronger than the vibration of the vibration device when the device is held from below, the vibration presentation time (driving time) is relatively long, and the frequency with high sensitivity is selected. The driving signal of the vibrating device is controlled so as to become the band. As a result, even if the gripping state changes, the strength of the vibration perceived by the photographer does not change so much, and stable vibration presentation is possible.
  • a contact sensor or the like may be mounted on the lens unit to detect the gripping state by the hand.
  • initial hand position information may be obtained, and the gripping state of the photographer's hands may be estimated from the zoom ratio.
  • the photographer 10 may hold the camera body 2 horizontally as shown in FIG. 25(A), or may hold the camera body 2 vertically as shown in FIG. 24(B).
  • the grasping state may change.
  • the vibration device 51 is mounted on the camera body 2 so that its vibration direction is the height direction of the camera body 2 (the Z-axis direction in FIG. 1).
  • the direction of vibration presented to the photographer by the vibrating device 51 changes depending on whether the imaging apparatus 1 is held horizontally or vertically.
  • the sensitivity of the human hand also changes according to the vibration direction.
  • the control unit 4 may change the drive signal for the vibration device 51 according to the orientation of the camera body 2 .
  • the vibration emitted from the vibrating device may be stronger than when oriented horizontally.
  • two orientations of the camera body 2 horizontal and vertical, are taken as examples, but there are cases in which the camera body 2 is held in an oblique direction for use. includes vertical orientation, horizontal orientation, and oblique orientation.
  • the orientation of the camera body 2 can be estimated from a through-the-lens image captured by the image pickup device 31, posture information of the camera body 2 estimated using sensing results from the acceleration sensor 32, the gyro sensor 33, and the like.
  • the vibrating device 51 is mounted on the camera body 2 so that the vibrating direction of the vibrating device 51 is aligned with the height direction of the camera body 2 is given, but the present invention is not limited to this.
  • the vibration device may be mounted on the camera body so that the vibration directions are the X-axis direction and the Y-axis direction in FIG.
  • the control unit 4 may control the drive signal of the vibration device 51 according to the dynamic posture shake of the photographer 10 holding the imaging device 1 .
  • FIG. 26A is a diagram of the photographer 10 who is unable to fix and hold the imaging apparatus 1 well due to the open armpit.
  • FIG. 26(B) is a diagram of the photographer 10 holding the imaging device 1 well by tightening his armpits.
  • the fact that the imaging device 1 cannot be fixed and held and that the photographer 10 has caused dynamic blurring in the imaging device 1 can be determined using the through image by the imaging device 31 and the sensing results of the acceleration sensor 32, the gyro sensor 33, and the like. can be estimated by Dynamic blurring by the photographer 10 can be said to be camera shake.
  • the control unit 4 When the sum of the camera shake amount of the photographer 10 and the vibration amount of the vibration device is smaller than the camera shake correction allowable vibration amount, the control unit 4 turns on the vibration mode, and the vibration of the vibration device 51 is generated with the basic vibration waveform. Vibrations 62 and 63 presented at the time of shutter are controlled so as to be vibrations. When the sum of the camera shake amount of the photographer and the vibration amount of the vibration device is greater than or equal to the camera shake correction allowable vibration amount, the control unit 4 turns off the vibration mode, or turns on the vibration mode so that the vibration waveform is larger than the basic vibration waveform. Vibrations 62 and 63 presented at the time of shutter are controlled so that vibrations are small.
  • the imaging environment information in the imaging device 1, the imaging setting information set by the photographer, and the state information of the imaging device 1 Vibration of the vibration device 51 mounted on the camera body 2 is controlled based on at least one of .
  • information related to the imaging device 1 is appropriately presented to the photographer through vibrotactile sensation.
  • Changing the vibration waveform of the vibrating device includes not only changing the vibration waveform, but also a form in which the vibrating device does not vibrate.
  • the control unit 4 determines whether or not sensing results, which serve as surrounding shooting environment information, can be acquired from the input system device 3 (ST101).
  • the sensing result is, for example, image data acquired by the imaging device 31, audio data detected by a microphone, or the like.
  • the control unit 4 determines that the sensing result cannot be acquired (NO), it returns to the start and repeats the processing.
  • the process proceeds to ST102.
  • the control unit 4 acquires surrounding shooting environment information based on the sensing result.
  • the control unit 4 determines whether or not it is necessary to change the vibration waveform of the vibration device according to the shooting environment information (ST103). If the control unit 4 determines that it is necessary to change (YES), it proceeds to ST111. When the control unit 4 determines that there is no need to change (NO), it returns to the start and repeats the process.
  • the control section 4 determines whether or not there is an attached device 8 attached to the camera body 2 (ST104). When the control unit 4 determines that the attached device 8 is not present (NO), it returns to the start and repeats the processing. When the control section 4 determines that there is an attached device 8 (YES), the process proceeds to ST105.
  • the control unit 4 acquires the type information of the attached device 8 from the electrical connection information between the camera body 2 and the attached device 8 . In ST105, the control unit 4 uses the attached device DB 71 to obtain information on attached attached devices. Next, the control unit 4 acquires lens state information such as the zoom state of the zoom lens of the lens unit 81 (ST106).
  • the control unit 4 acquires the gripping state of the photographer based on the sensing result of the input device 3 (ST107).
  • the control section 4 determines whether or not it is necessary to change the vibration waveform based on the attached device information, the lens state information, and the gripping state information (ST108).
  • the control unit 4 determines that it is necessary to change (YES)
  • it proceeds to ST111.
  • the control unit 4 determines that there is no need to change (NO), it returns to the start and repeats the process.
  • Attached device information, lens state information, and gripping state information are state information of the imaging device.
  • the control unit 4 acquires input operation information performed by the photographer (ST109).
  • the input operation information is shooting setting information set by the input operation of the photographer.
  • the control unit 4 determines whether or not it is necessary to change the vibration waveform based on the acquired input operation information (ST110). If the control unit 4 determines that it is necessary to change (YES), it proceeds to ST111. When the control unit 4 determines that there is no need to change (NO), it returns to the start and repeats the process.
  • the control unit 4 acquires usage information of the electronic viewfinder (EVF) 22 by the photographer based on the sensing result of the input device 3.
  • EVF electronic viewfinder
  • the control unit 4 uses the shooting environment information, the state information of the imaging device 1, the shooting setting information by the photographer, the usage information of the electronic viewfinder 22, the user attributes, and the information stored in the camera specification information unit 73.
  • a vibration waveform (driving signal) for the vibration device 51 is generated (ST112), and the setting value of the vibration waveform currently set is changed and set (ST113).
  • control unit 4 determines whether or not the drive signal includes a signal that is hidden when the vibration mode is turned off (ST114). If the control unit 4 determines that it is not included (NO), it proceeds to ST116. If the control unit 4 determines that it is included (YES), it determines whether or not the vibration mode is set to off (ST115). When the control unit 4 determines that the vibration mode is set to OFF (YES), the process proceeds to ST118. When the control unit 4 determines that the vibration mode is not set to OFF (NO), the process proceeds to ST116.
  • the control unit 4 acquires sensing results (output information) of the input system device 3, such as acceleration and sound pressure detected by the imaging device 1.
  • FIG. Next, based on the acquired output information, the control unit 4 determines whether or not to feed back the acquired output information to the next vibration of the vibration device 51 (ST117). If the control unit 4 determines to feed back (YES), it proceeds to ST118. When the controller 4 determines not to feed back (NO), it returns to the start and repeats the process. In ST118, the control unit 4 changes and sets the currently set value of the vibration waveform (driving signal). After that, return to the start and repeat the process.
  • the information processing method of the present embodiment based on at least one of the shooting environment information in the imaging device 1, the shooting setting information set by the photographer, and the state information of the imaging device 1, the camera main body to control the vibration of the vibration device mounted on the Accordingly, it is possible to appropriately present the information related to the imaging device to the photographer using the vibrotactile sensation.
  • the vibration device may be provided in each of the camera body and the lens unit.
  • the number of vibrating devices may be one or more, and for example, a plurality of vibrating devices may be mounted on the camera body. In this way, when a plurality of vibrating devices are provided in the entire imaging apparatus, the characteristics of the vibrating devices such as the difference in gripping state due to the difference in the type of lens unit, the timing of vibration generation, acceleration, frequency band, and vibration direction are taken into consideration. to select and determine which vibration device is to be vibrated and how.
  • control unit 4 for controlling the vibration of the vibration device 51 is provided in the camera body 2, and the camera body 2 functions as an information processing device. It may be provided in a different information processing device.
  • vibration feedback may be performed during moving image shooting.
  • the vibration sound of the vibrating device may be recorded in the captured moving image.
  • a filter can be applied so as to cut the frequency band of the vibration sound (vibration frequency in the figure).
  • the opposite phase 28 of the vibration sound frequency 27 may be added to the recorded data 26 .
  • FIG. 29(A) is a diagram illustrating an anti-dust system.
  • the anti-dust system uses a piezo element to vibrate the filter 311 mounted on the entire surface of the imaging device 31 with ultrasonic waves of 70,000 times/second or more, and removes dust attached by changing the oscillation method of the filter 311. It removes dirt and dust.
  • the piezoelectric element used in the anti-dust system may realize the function of the vibrating device described above. In this case, it is preferable to use a low frequency piezo element.
  • a piezo element (vibration device) may have both the function of vibration feedback and the function of an anti-dust system.
  • FIG. 29B is a perspective view of the imaging device 1.
  • the imaging device 1 has a camera body 2 and a lens unit 81 .
  • the camera body 2 includes a housing 20 and an opening/closing section 23 connected to the housing 20 via a connecting section (not shown).
  • the opening/closing part 23 is connected to the camera body 2 by a connecting part so as to be openable and closable about an opening and closing axis along the height direction of the camera body 2 and rotatable about a rotation axis orthogonal to the opening and closing axis.
  • a display 53 is mounted on the opening/closing portion 23 .
  • the example shown in FIG. 29B shows a state in which the opening/closing portion 23 is opened.
  • the opening/closing part 23 can be closed so as to overlap with the housing 20 .
  • a magnet 381 is provided in the opening/closing section 23 and a magnetic sensor 380 is provided in the housing 20 .
  • a magnetic sensor 380 may be provided in the opening/closing portion 23 and a magnet 381 may be provided in the housing 20 .
  • Magnetic sensor 380 detects the strength of the magnetic field. Since the magnetic sensor 380 and the magnet 381 are close to each other when the opening/closing portion 23 is closed, the magnetic sensor 380 can detect the magnet 381 . In this manner, the magnet 381 and the magnetic sensor 380 can be used as an open/close detection section that detects the open/closed state of the open/close section 23 .
  • the magnet of the vibration device VCM
  • the vibration device may have both the function of vibration feedback and the function of the opening/closing detector of the opening/closing portion.
  • Imaging environment information in an imaging device that includes an imaging device that captures an image of a subject and a vibration device that presents vibrations to a photographer, imaging setting information set by the photographer, and information about the imaging device.
  • An information processing apparatus comprising: a control unit that controls vibration of the vibration device based on at least one piece of state information.
  • the information processing device according to (1) above The information processing device, wherein the vibration indicates information related to the imaging device.
  • the information processing device according to (2) above, The information related to the image pickup device includes at least one of operation information of the image pickup device, alert information, operation information of an accessory device attached to the camera body, and image pickup information acquired by the image pickup device. processing equipment.
  • the information processing device wherein the operation information of the imaging device includes information on the state of focusing on the subject, information on the start of exposure in the imaging device, and information on the end of exposure.
  • the imaging device has a shutter button that is operated by half-pressing and full-pressing,
  • the control unit controls vibration of the vibrating device indicating a state of focus on the subject performed in response to half-pressing of the shutter button, and starts and controls the exposure performed in response to full-pressing of the shutter button.
  • An information processing apparatus for controlling vibration of the vibrating device indicating each end.
  • the information processing device (6) The information processing device according to (4) above, The information processing apparatus, wherein the control section causes the vibrating device to vary the vibration indicating the in-focus state according to a focal length.
  • the imaging information includes information as to whether the captured image acquired by the imaging device is a normal image or an error image, The information processing apparatus, wherein the control unit controls the vibration of the vibration device so that the vibration indicating that the error image has been obtained is different from the vibration indicating that the normal image has been obtained.
  • the information processing device controls vibration of the vibration device to be OFF during exposure of the imaging element.
  • the vibration drive signal indicating the alert information includes a signal that is hidden when the vibration mode of the vibrating device is off or a signal that is visible when the vibration mode is off
  • the control unit When the alert information having a signal that is hidden when the vibration mode is off is received during exposure of the imaging device, vibration indicating the alert information is generated after the exposure of the imaging device is completed. , controlling said vibrating device; When the alert information having a signal that appears when the vibration mode is off is received during exposure of the imaging device, vibration indicating the alert information is generated during exposure of the imaging device, An information processing device that controls the vibration device.
  • the information processing device according to any one of (3) to (9) above, The information processing apparatus, wherein the alert information includes at least one of information related to the remaining battery level, which is a driving power source of the imaging device, and information related to the imaging environment information.
  • the imaging device is equipped with a plurality of attachment devices different from each other, The information processing apparatus, wherein the control section controls the vibration of the vibration device so that the vibration indicating operation information of each of the attached devices differs for each of the plurality of attached devices.
  • the information processing device according to any one of (2) to (11) above, The information processing device, wherein the control unit controls first vibration and second vibration indicating different information related to the imaging device so that the photographer can distinguish between the first vibration and the second vibration.
  • the information processing device includes at least one of shutter speed setting, frame rate setting, single shooting mode or continuous shooting mode setting, and shooting environment setting.
  • the state information of the imaging device includes type information of an attached device attached to the camera body, form information of the attached device, information on the holding state of the imaging device by the photographer, and remaining power supply for driving the imaging device. and information on power consumption of the camera body.
  • the imaging device has a zoom lens, The information processing apparatus, wherein the control unit controls vibration of the vibration device in consideration of vibration during driving of the zoom lens.
  • the information processing apparatus controls the vibration of the vibration device in consideration of the vibration sound caused by the vibration device.
  • the imaging device has a mechanical shutter, The information processing apparatus, wherein the control unit controls vibration of the vibration device in consideration of vibration during operation of the mechanical shutter.
  • the information processing device according to any one of (1) to (17) above, The information processing apparatus, wherein the control unit controls the next vibration of the vibration device using the vibration information of the imaging device.
  • An information processing method comprising controlling vibration of the vibration device based on at least one piece of state information.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)
  • Indication In Cameras, And Counting Of Exposures (AREA)
PCT/JP2022/000227 2021-03-25 2022-01-06 情報処理装置、情報処理方法及びプログラム Ceased WO2022201737A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN202280021774.5A CN117015742A (zh) 2021-03-25 2022-01-06 信息处理装置、信息处理方法和程序
DE112022001717.1T DE112022001717T5 (de) 2021-03-25 2022-01-06 Datenverarbeitungseinrichtung, datenverarbeitungsverfahren und programm
JP2023508646A JPWO2022201737A1 (https=) 2021-03-25 2022-01-06
US18/550,358 US20240163552A1 (en) 2021-03-25 2022-01-06 Information processing apparatus, information processing method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021051433 2021-03-25
JP2021-051433 2021-03-25

Publications (1)

Publication Number Publication Date
WO2022201737A1 true WO2022201737A1 (ja) 2022-09-29

Family

ID=83396704

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/000227 Ceased WO2022201737A1 (ja) 2021-03-25 2022-01-06 情報処理装置、情報処理方法及びプログラム

Country Status (5)

Country Link
US (1) US20240163552A1 (https=)
JP (1) JPWO2022201737A1 (https=)
CN (1) CN117015742A (https=)
DE (1) DE112022001717T5 (https=)
WO (1) WO2022201737A1 (https=)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003302692A (ja) * 2002-04-12 2003-10-24 Fuji Photo Film Co Ltd カメラ
JP2005173038A (ja) * 2003-12-09 2005-06-30 Sony Corp カメラ
JP2006136865A (ja) * 2004-11-15 2006-06-01 Sony Corp 振動発生装置、触覚機能付きの入出力装置及びその電子機器
JP2010054820A (ja) * 2008-08-28 2010-03-11 Canon Inc カメラ
JP2015055807A (ja) * 2013-09-13 2015-03-23 カシオ計算機株式会社 報知装置、報知方法及びプログラム
JP2019185023A (ja) * 2018-04-03 2019-10-24 キヤノン株式会社 電子機器、電子機器の制御方法およびプログラム
JP2019191434A (ja) * 2018-04-27 2019-10-31 キヤノン株式会社 撮像装置
WO2020008862A1 (ja) * 2018-07-02 2020-01-09 ソニー株式会社 情報処理装置、情報処理方法及び情報処理装置可読記録媒体

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007199259A (ja) 2006-01-25 2007-08-09 Fujifilm Corp 撮像装置
WO2012176441A1 (ja) * 2011-06-23 2012-12-27 株式会社ニコン 撮像装置
JP2013070303A (ja) * 2011-09-26 2013-04-18 Kddi Corp 画面への押圧で撮影が可能な撮影装置、撮影方法及びプログラム
KR102092571B1 (ko) * 2013-01-04 2020-04-14 삼성전자 주식회사 카메라를 구비하는 장치의 인물 촬영장치 및 방법
KR20140090318A (ko) * 2013-01-07 2014-07-17 삼성전자주식회사 햅틱 기반 카메라 운용 지원 방법 및 이를 지원하는 단말기
US20200068098A1 (en) * 2017-05-18 2020-02-27 Sony Corporation Shooting apparatus
US11150732B2 (en) * 2018-06-25 2021-10-19 Canon Kabushiki Kaisha Image pickup apparatus having vibration device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003302692A (ja) * 2002-04-12 2003-10-24 Fuji Photo Film Co Ltd カメラ
JP2005173038A (ja) * 2003-12-09 2005-06-30 Sony Corp カメラ
JP2006136865A (ja) * 2004-11-15 2006-06-01 Sony Corp 振動発生装置、触覚機能付きの入出力装置及びその電子機器
JP2010054820A (ja) * 2008-08-28 2010-03-11 Canon Inc カメラ
JP2015055807A (ja) * 2013-09-13 2015-03-23 カシオ計算機株式会社 報知装置、報知方法及びプログラム
JP2019185023A (ja) * 2018-04-03 2019-10-24 キヤノン株式会社 電子機器、電子機器の制御方法およびプログラム
JP2019191434A (ja) * 2018-04-27 2019-10-31 キヤノン株式会社 撮像装置
WO2020008862A1 (ja) * 2018-07-02 2020-01-09 ソニー株式会社 情報処理装置、情報処理方法及び情報処理装置可読記録媒体

Also Published As

Publication number Publication date
JPWO2022201737A1 (https=) 2022-09-29
DE112022001717T5 (de) 2024-01-18
CN117015742A (zh) 2023-11-07
US20240163552A1 (en) 2024-05-16

Similar Documents

Publication Publication Date Title
US8136952B2 (en) Image capturing apparatus
JP5853197B2 (ja) 交換レンズ、カメラボディ及びカメラシステム
WO2012176441A1 (ja) 撮像装置
US11442340B2 (en) Electronic apparatus, electronic apparatus control method and storage medium
US8830353B2 (en) Camera body, and camera system
JP2010171935A (ja) 振動装置及びそれを用いた画像機器
JP7814910B2 (ja) 電子機器、電子機器の制御方法、プログラム、および記録媒体
JP7309432B2 (ja) 振動デバイスを有する光学機器
WO2022201737A1 (ja) 情報処理装置、情報処理方法及びプログラム
JP2004104652A (ja) 撮像装置
JP5266950B2 (ja) カメラ
JP4536593B2 (ja) 画像機器及びカメラ
JP5700204B2 (ja) 頭部装着型撮像装置
JP5100367B2 (ja) 撮像装置
JP2010118962A (ja) 撮像装置及びその制御方法及びプログラム
JP2008131448A (ja) カメラ
US11297235B2 (en) Optical apparatus having vibration device
JP6286951B2 (ja) 撮影装置及びその調整制御方法
US20210357033A1 (en) Image pickup apparatus with vibration device
JP7378953B2 (ja) 撮像装置、撮像装置の制御方法、プログラム
JP5294917B2 (ja) 撮像装置
JP2011109463A (ja) 撮影装置および遠隔作業支援システム
JP2010171939A (ja) 振動装置及びそれを用いた画像機器
JP4845653B2 (ja) カメラシステム、カメラ本体、交換レンズユニットおよび像ブレ補正方法
JP2012129816A (ja) 撮像装置及びその制御方法、プログラム、記憶媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22774542

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18550358

Country of ref document: US

Ref document number: 2023508646

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 202280021774.5

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 112022001717

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22774542

Country of ref document: EP

Kind code of ref document: A1