JP2002354324A - Image-photographing device, operation device and image- photographing system therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem of the occurrence of misoperations by a user, based on blurred images during camera operations and images in which a communication delay has generated. SOLUTION: A mobile telephone 3 as an operation device of an image- photographing system comprises an image-processing part 340, an operation control part 341 and a communication part 342. The operation control part 341 transmits optical operation commands to a camera via the communication part 342, based on an input of an optical operation command from an operation part 31. The image-processing part 340 is not mode to carry out the operations of displaying of display image data 111 on an image display part 32, until a non-optical operation command indicating completion of operations instructed by an optical operation command from the camera is received.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for photographing an image by remotely operating an image photographing apparatus, and more particularly to improvement of a user's operation environment in such an image photographing method.

[0002]

2. Description of the Related Art Conventionally, there has been known a system for obtaining an image by remotely operating a digital camera (hereinafter abbreviated as "camera"). In such a system, an operation device such as a mobile phone is provided with a display, and a user operates an operation button while observing a live view image from the camera on the display, and in response to the operation, instructs the camera to shoot an image. Has been sent. However, if a delay occurs in the transmission of image data from the camera to the operating device, the user operating the camera may receive an extra operation command because the image being operated is displayed with a delay. Erroneous operation has occurred. As a technique for reducing such a delay, for example, Japanese Unexamined Patent Application Publication No.
Japanese Patent Application Laid-Open No. 239329 proposes a technique of reducing the data transfer delay by increasing the compression ratio of an image transferred from the camera to the operation unit while the camera is performing a pan / tilt operation.

[0003]

However, in the above technique, although the delay can be reduced, the amount of the reduction is insufficient. In addition, an image during a pan / tilt operation of the camera becomes a blurred image, and displaying such an image is not very meaningful.

The present invention has been made in view of the above problems, and has as its object to reduce erroneous operations by a user and eliminate user discomfort during the operation.

[0005]

According to a first aspect of the present invention, there is provided an image photographing apparatus operable from an operation device, wherein a photographing means for acquiring image data of a subject and a data between the operation device are provided. A communication unit for performing communication, and when the data received by the communication unit is an optical operation command for instructing a change in an optical incidence condition in the imaging unit, controlling the imaging unit based on the optical operation instruction A control unit; and a holding unit for holding the transmission of the image data in the communication unit while the control unit controls the imaging unit in accordance with the optical operation command.

According to a second aspect of the present invention, there is provided the image capturing apparatus according to the first aspect, wherein a plurality of commands are continuously received as the optical operation command within a predetermined determination time by the communication means. Then, the holding means is activated.

According to a third aspect of the present invention, there is provided the image photographing apparatus according to the first or second aspect, wherein the optical operation command includes a pan, a tilt, a zoom, a focus, and an iris.

According to a fourth aspect of the present invention, there is provided an operating device for operating the image capturing apparatus, wherein the input means inputs a command for operating the image capturing apparatus by a user, the display means displays image data, A communication unit that performs data communication with the image capturing device and receives first image data as a live image from the image capturing device; and the operation command input by the input unit is an optical device in the image capturing device. And control means for causing the display means to temporarily perform alternative display when the command is an optical operation command for changing a target incidence condition.

According to a fifth aspect of the present invention, in the operation device according to the fourth aspect, when a plurality of commands are input as the optical operation commands, the control means is activated.

The invention according to claim 6 is the operating device according to claim 4 or 5, wherein the control means does not display anything on the display means as the substitute display.

The invention according to claim 7 is the operating device according to claim 4 or 5, wherein the image processing means generates second image data different from the first image data received by the communication means. The control means causes the display means to display the second image data obtained by the image processing means as the substitute display instead of the first image data.

The invention according to claim 8 is the operating device according to claim 7, wherein the image processing means transforms the old image data which has been received in advance as the first image data by the communication means. To generate the second image data.

According to a ninth aspect of the present invention, in the operating device according to the seventh aspect, the image processing means converts the old image data, which has been received in advance as the first image data by the communication means, into another image data. By combining image data, the second
Generate image data.

According to a tenth aspect of the present invention, there is provided the operation device according to any one of the fourth to ninth aspects, wherein the optical operation instruction includes pan, tilt, zoom, focus, or iris.

According to an eleventh aspect of the present invention, there is provided an image photographing system, comprising: the image photographing device according to any one of claims 1 to 3; and the operating device according to any one of claims 4 to 10. Prepare.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

<1. First Embodiment><1.1. System Configuration> FIG. 1 is a diagram showing a configuration of an image photographing system 1 according to a first embodiment of the present invention. The image photographing system 1 includes a camera (digital still camera or digital movie camera) 2 as an image photographing device and a mobile phone 3 having a function as an operation device capable of remotely operating the camera 2. The pan / tilt operation as described later is performed not only in a digital movie camera but also in a digital still camera having a dynamic image capturing function as a live view. Is applicable.

The camera 2 has an imaging system 21 disposed in front of a main body 29 containing circuits as described later, and an antenna 24 for communicating with the mobile phone 3. The mobile phone 3 includes an operation unit 31 for inputting a command to the camera 2 by a user, an image display unit 32 for displaying data such as a received image, and a camera. 2 has an antenna 33 for communicating with it.

FIG. 2 is a diagram showing the internal configuration of the camera 2. As shown in FIG. 2, the imaging system 21 of the camera 2 performs focus by driving the zoom lens 210 and the focus lens 221, the first drive unit 230 that drives the zoom lens 210, and the focus lens 221, and drives the aperture. The second drive unit 231 adjusts the light image of the subject formed by the imaging system 21 into R (red), G (green), B
CC that performs photoelectric conversion to an image signal of a (blue) color component (a signal composed of a signal sequence of pixel signals received by each pixel) and outputs
D220, a spherical unit 22 that houses these, and a third drive unit 232 that drives the spherical unit 22 such as panning and tilting.

The third drive section 232 gives the spherical unit 22 a swing of about ± 70 ° in the pan direction (θ rotation) and a tilt of ± 70 ° in the tilt direction (φ rotation). Has become possible. The third drive unit 232 includes a plurality of piezo elements for performing the rotation driving in the pan direction and the rotation driving in the tilt direction. Also,
The driving of the first drive unit 230 for the zoom operation is also performed by another piezo element. By applying a sawtooth wave signal to these piezo elements, the element to be driven by the piezo element jogs, and a required movement is given to the element by repetition. These drive mechanisms are described in, for example, JP-A-11-18000 and
No. 1-41504.

Hereinafter, the first driving section 230, the second driving section 231 and the third driving section 232 are collectively referred to as the driving section 2
No. 3.

The camera 2 mainly includes an image pickup system 21 and a CCD 2
The image of the subject is obtained as image data by the CPU 20, the CPU 25, the ROM 26, and the RAM 27. That is, an image of a subject is formed on the CCD 220 by the imaging system 21, converted into digital data by an A / D converter (not shown), and stored in the RAM 27 as image data. The acquired image data is stored in the RAM 27 as needed.
Is transferred to the memory 28 and stored. The image data is transmitted to the mobile phone 3 via the antenna 24. The control of these processes is performed by the CPU 25 operating according to a program stored in the ROM 26.

FIG. 3 is a diagram showing a functional configuration realized by the CPU 25 operating according to a program in the ROM 26, together with other components. In the configuration illustrated in FIG. 3, functions of the image processing unit 250, the camera control unit 251, and the communication unit 252 realized by the CPU 25 are described.

The image processing unit 250 includes a camera control unit 251
The image data 100 acquired from the CCD 220 is subjected to color correction, interpolation between pixels, compression processing, encryption, and the like based on the instruction from the CPU 220 to generate transmission image data 101 as necessary. The image data 100 is stored in the memory 2 based on a non-optical operation command from the camera control unit 251 (a command that is not a command for controlling the driving unit 23; for example, an image storage instruction or a camera status acquisition instruction).
8 is also provided.

The camera control unit 251 is configured to control the driving unit 23 and the image processing unit 2 based on the commands (optical operation command and non-optical operation command) received by the communication unit 252.
50 and the communication unit 252. The mobile phone 3 also has a function of transmitting data indicating a processing result for each command to the mobile phone 3 via the communication unit 252. A command for controlling the drive unit 23 to instruct the camera 2 to change the optical incidence condition, that is, a pan command,
The tilt command, zoom command, focus command, iris command, and the like are particularly called optical operation commands. Communication unit 2
52 performs data communication between the camera 2 and the mobile phone 3.

FIG. 4 is a diagram showing a portion of the configuration of the mobile phone 3 that mainly relates to the features of the present invention. As shown in FIG. 4, the mobile phone 3 transmits the image data received by the antenna 33 to the CPU 34, the ROM 35, and the RAM 36.
And is displayed on the image display unit 32. The memory 37 stores various data such as received image data as needed. In addition, a command for the camera 2 is generated and transmitted to the camera 2 via the antenna 33.
These commands are received by receiving a user's instruction from the operation unit 31 or according to the situation.
Is automatically generated.

FIG. 5 shows that the CPU 34 of the mobile phone 3 has a ROM
35 is a diagram showing a functional configuration realized by operating according to a program in 35 together with other configurations. FIG. 5, the image processing unit 340 and the operation control unit 34
1, and a function of the communication unit 342 realized by the CPU 34.

The image processing unit 340 performs necessary processing on the image data 110 received by the communication unit 342 in accordance with an instruction from the operation control unit 341 to perform display image data 111 processing.
Is generated and displayed on the image display unit 32.

The operation control unit 341 accepts a user's command input from the operation unit 31 or automatically generates non-optical operation commands such as a status acquisition command, and based on these commands, the image processing unit 340 and the communication unit. 3
Control is performed by giving necessary instructions to 42. Further, a processing result for the command is received from the communication unit 342, and the image processing unit 340 is instructed to switch between a normal display and an alternative display described later.

The communication section 342 performs data communication with the camera 2. Also, the received data is image data 110
If the data is, the data is transferred to the RAM 36 and stored.

<1.2. Operation of Camera> FIG. 6 is a flowchart showing the operation of camera 2 in the present embodiment.
The operation of the camera 2 which is an image photographing device in the image photographing system 1 according to the present invention will be described with reference to FIGS.

First, an image is taken by the camera 2, the image processing unit 250 acquires the image data 100, and performs image processing such as color correction, interpolation between pixels, compression processing, or encryption to transmit the transmission image data. 101 (Step S1)
1). When the transmission image data 101 is generated, the communication unit 252 transmits the generated transmission image data 101 to the mobile phone 3 via a telephone line based on an instruction from the camera control unit 251.
(Step S12).

The image transmitted from the camera 2 in this way can be viewed on the mobile phone 3 and can be stored in the mobile phone 3 in response to a user operation.

Next, the camera control unit 251
2 determines whether an optical operation command has been received from the mobile phone 3 (step S13). If it is determined that the optical operation command has not been received, steps S11 to S1 are performed.
Repeat 3.

On the other hand, if the camera control unit 251 determines that the optical operation command has been received, it gives an instruction not to generate the transmission image data 101 to the image processing unit 250 and transmits the transmission image data to the communication unit 252. 101
Stop sending. Further, the optical operation command is executed by controlling the drive unit 23 based on the received optical operation command (step S14).

Subsequently, the camera control unit 251
Wait until the operation is completed (step S15). When the operation of the drive unit 23 is completed, the fact is transmitted to the mobile phone 3 via the communication unit 252 as a processing result (step S1).
6). After that, the processing from step S11 is repeated, so that the acquisition of the image data 100 by photographing and the transmission of the transmission image data 101 are restarted.

When the portable telephone 3 receives the non-optical operation command, an interruption process shown in FIG. 7 is executed. In the interrupt processing, first, the camera control unit 251 controls each unit according to the type of the received non-optical operation command and processes the non-optical operation command (step S101). Then, the processing result is transmitted (step S102), and the interrupt processing ends. For example, in the case of an image storage instruction, the latest image data 100 currently acquired is stored in the memory 28.
As will be described later, while the optical operation command is being executed, a status acquisition command is repeatedly transmitted from the mobile phone 3, and in response to this status acquisition command, data such as the current pan direction, tilt direction, zoom position, focus position, etc. Send.

Here, the state of data communication between the camera 2 and the mobile phone 3 during the operation of the camera 2 will be described with reference to the drawings while comparing the conventional image photographing system with the image photographing system 1 according to the present embodiment. The effect will be described.

FIGS. 8 (a) to 8 (c) are diagrams schematically showing the state of data generation in the conventional image photographing system with time taken along the horizontal axis. The details are as follows. is there.

FIG. 8 (a) is a diagram showing data generated in the portable telephone, wherein data 400 is data of an optical operation command, and data 401 to 403 with a reference symbol "T" are non-optical operation commands (status Acquisition command). The time t indicates a time during which the camera is operated by the optical operation command indicated by the data 400.

FIG. 8 (b) is a view showing data generated in the camera, and data 40 denoted by reference numeral "C".
Data 4 to 406 are data indicating the response of the camera 2 to the non-optical operation command from the mobile phone 3 (data indicating the processing result, etc.). Data 410 and data 411 are image data while the camera is operating according to the optical operation command indicated as data 400. Further, data 412 is image data taken after the optical operation of the camera is completed.

FIG. 8C is a diagram showing the state of each data on the telephone line. The band h is a value indicating the communication band of the telephone line, and is a value indicating the capability regarding the data communication amount. The time d1 indicates the time from the completion of the optical operation of the camera to the start of transmission of the data 412 as image data after the operation is completed. Each of the data 410 to 412 as image data may be considered to correspond to data representing an image for one frame, or may be considered to be a set of images for a plurality of frames.

FIGS. 9 (a) to 9 (c) are diagrams schematically showing the generation status of data in the image photographing system 1 according to the present embodiment with time taken along the horizontal axis. FIG. 9 is a diagram corresponding to FIGS. 8 (a) to 8 (c).
The time d2 shown in FIG. 9C is the time from the completion of the optical operation of the camera 2 to the start of transmission of the data 412 as the image data after the operation is completed in the image capturing system 1 according to the present embodiment. Show. 8 (a) to 8 (c) are denoted by the same reference numerals as appropriate.

First, comparing FIG. 8 (b) and FIG. 9 (b), in the camera 2 in the image photographing system 1 of the present embodiment, while the camera control unit 251 controls the driving unit 23 ( During the time t), the generation of the transmission image data 101 by the image processing unit 250 is suspended by the camera control unit 251, so that data corresponding to the data 410 and the data 411 in the related art is not generated.

Also, comparing FIG. 8 (c) and FIG. 9 (c), since the camera control unit 251 suspends transmission of the transmission image data 101 in the communication unit 252, the amount of data transmitted to the telephone line is reduced. Have been. Accordingly, the time d1 and the time d2 until the data 412 (data corresponding to the transmission image data 101 after the completion of the optical operation), which is the image data desired by the user, are shorter in the time d2. That is, the camera 2 according to the present embodiment can transmit the data 412, which is the image data desired by the user, more quickly than the conventional system. By doing so, it is possible to prevent an erroneous operation such as a user inputting an extra optical operation command.

Furthermore, optical operation commands, non-optical operation commands, and responses from the camera 2 to these commands can be transmitted and received more quickly than in the conventional system. Operability can be improved.

<1.3. Operation of Mobile Phone> FIG.
5 is a flowchart showing a part related to the features of the present invention in the operation of the mobile phone 3 in the present embodiment. FIG.
Mobile phone 3 of image capturing system 1 using FIG.
Will be described.

First, the communication unit 342 receives the image data 110 transmitted from the camera 2 (step S21),
The data is stored in the RAM 36. Subsequently, the image processing section 340 performs processing necessary for decoding and displaying on the image display section 32 to generate display image data 111, and displays the display image data 111 on the image display section 32 (step S22).

Next, the operation control section 341 determines whether or not an optical operation command has been input from the operation section 31 (step S23). If no optical operation command has been input, steps S21 to S23 are repeated. Thus, the latest image is displayed on the image display unit 32 every time the image data 110 is received.

On the other hand, when it is determined that the optical operation command has been input, the optical operation command input to the camera 2 is transmitted via the communication unit 342 (step S24), and the camera 2 transmits the optical operation command to the image processing unit 340. Since the optical operation command is being executed, the display image data 1 is displayed on the image display unit 32.
An instruction is given not to display 11. Based on this instruction, the image processing unit 340 suspends the generation of the display image data 111 and does not display anything on the image display unit 32 (step S25).

FIGS. 11A to 11D are diagrams showing examples of images displayed during a panning operation of a camera to the right in a conventional image photographing system. FIG.
FIGS. 12A to 12D are diagrams illustrating examples of images displayed on the image display unit 32 of the mobile phone 3 when the same operation is performed in the image capturing system 1 according to the present embodiment. is there.

When an optical operation command for panning right is input while the image shown in FIG. 11A is displayed, the image desired by the user is shown in FIG. 11D after the panning operation. 11 (b) and 11 (c) are transmitted from the camera during the panning operation and displayed. These images also have a delay due to data transfer. Such an image is not only unnecessary, but also unpleasant for the user, and causes an erroneous operation.

In the image photographing system 1 according to the present embodiment, in step S25, the operation control unit 341 controls the image processing unit 340 so that the image is not displayed on the image display unit 32 based on the optical operation command. FIG.
It is possible to avoid displaying an image in which blurring or delay has occurred as shown in FIG. 1 (b) and FIG. 11 (c).
That is, as shown in FIG. 12B and FIG. 12C, a state in which nothing is displayed on the image display unit 32 during the operation of the camera 2 can be achieved. Note that displaying nothing means that substantially nothing is displayed, such as displaying a white or black screen.

Thus, when the command input by the operation unit 31 is an optical operation command for instructing the camera 2 to change the optical incidence condition, the image display unit 32 is caused to perform a temporary alternative display. At this time, nothing is displayed on the image display unit 32 and a blurred image that is unpleasant for the user is not displayed, so that a comfortable operation environment can be provided to the user.

Returning to FIG. 10, after step S25 is executed, the communication unit 3 is controlled based on the instruction of the operation control unit 341.
42 transmits a non-optical operation command such as a status acquisition command and receives data indicating a processing result (step S2).
6). Further, the operation control unit 341 determines whether or not the operation based on the optical operation command transmitted in step S24 is completed based on the data indicating the processing result received from the camera 2 (step S27), and the operation is completed. If not, steps S26 and S27 are repeated. on the other hand,
If the operation has been completed, the process returns to step S21 to perform the processing, thereby terminating the alternative display.

The operation control unit 341 may determine that the operation of the drive unit 23 of the camera 2 has been completed when a certain time has elapsed after the transmission of the optical operation command, and without transmitting the status acquisition command. Alternatively, it may simply wait for the camera 2 to transmit data indicating the processing result indicating that the operation has been completed. When such control is performed, the amount of data communication can be further reduced.

As described above, in the image photographing system 1, the data processing and the data communication amount in the camera 2 can be reduced, and the occurrence of delay in the transmitted image data 101 after the operation can be suppressed. In addition, a comfortable environment can be provided to the user by not displaying a blurred image during operation that is unpleasant for the user. Furthermore, reduction of data processing in the mobile phone 3 and improvement of the user's operation environment are achieved.

<2. Second Embodiment> In the camera 2 according to the first embodiment, a mobile phone 3 as an operation device is used.
When the optical operation command is received from the
Although control was performed so as not to acquire 0 and to generate and transmit the transmission image data 101, such control is limited to only when a plurality of optical operation commands are continuously received within a predetermined determination time. It can also be done.

It is to be noted that the case where the optical operation command is successively input a plurality of times means that the user intermittently operates the operation unit 31 a plurality of times, or that the user presses a predetermined button in the operation unit 31. Subsequently, the case where the button operation is repeatedly detected by the mobile phone 3 at a predetermined time interval includes a case where the optical operation command is substantially continuously given a plurality of times. Further, the plurality of optical operation commands is not limited to a plurality of the same optical operation commands, but also corresponds to a case where different types of optical operation commands are continuously input within a predetermined time.

FIG. 13 is a flowchart showing the operation of the camera 2 according to the second embodiment constructed according to such a principle. Note that the image capturing system 1 according to the second embodiment has the same configuration as that of the first embodiment (see FIGS. 1 to 5). Step S3 shown in FIG.
1 to S33 correspond to steps S11 to S shown in FIG.
13 is the same processing as that in FIG. Steps S36 to S38 shown in FIG. 13 are the same as step S1 shown in FIG.
The processing is the same as the processing from S4 to S16.

That is, the camera 2 in the present embodiment
Then, the optical operation command is received once (step S3
3, the control operation corresponding to steps S14 to S16 in the first embodiment is not performed, and the received optical operation command is executed (step S3).
4) After that, it is determined whether or not a plurality of optical operation commands have been received by determining whether or not further optical operation commands have been received within a predetermined determination time from the time when the execution has been completed (step S35). Only when a plurality of optical operation commands are received, steps S36 and S36 are performed until the optical operation corresponding to those optical operation commands is completed.
37 is performed.

The above-described determination time is shorter than the delay time in which the maker of the image photographing system 1 previously evaluates the width of the delay time of the transmission of image data from the camera 2 to the mobile phone 3 by an experiment or the like. In addition, a finite time (a time other than zero) longer than an average time interval for the user to change from one button operation to another button operation is set in the camera 2 in advance.

Thus, when the optical operation command is received substantially continuously by the communication unit 252, the transmission of the transmission image data 101 can be suspended, the processing amount increases, and a delay occurs noticeably. When it is anticipated, the amount of data communication can be reduced.

Thereafter, the camera control unit 251
Is detected (Yes in step S37)
s. ), The communication unit 2 to transmit the processing result to the mobile phone 3
52 is given an instruction. Based on the instruction, the communication unit 25
2 transmits the processing result (step S38), and the camera 2
Repeats the processing from step S31 again. In addition,
Also in the camera 2 according to the present embodiment, similarly to the first embodiment, when a non-optical operation command is received, an interrupt process (FIG. 7) is executed.

The above is the description of the camera 2 according to the second embodiment.
Operation. Next, the mobile phone 3 in the present embodiment
Will be described.

FIG. 14 is a flowchart showing the operation of the mobile phone 3 according to the second embodiment. Similarly to the first embodiment, the mobile phone 3 receives the image data 110 (step S51), saves the image data 110 in the RAM 36, performs processing necessary for display on the image display unit 32, and performs display image data processing. 111 is generated and an image is displayed on the image display unit 32 (step S52).

Next, the operation control section 341 determines whether or not an optical operation command has been input from the operation section 31 (step S53). If it is determined that an optical operation command has not been input, steps S51 to S53. repeat. If it is determined that an optical operation command has been input,
The input optical operation command is transmitted (step S5).
4) By giving an instruction to the communication unit 342 and determining whether an optical operation command is further input within a predetermined determination time, it is determined whether a plurality of optical operation commands are input (step S55). ).

If it is determined that a plurality of optical operation commands have not been input, steps S51 to S55 are repeated, and if it is determined that they have been input, the communication unit 3 transmits the input optical operation commands (step S56).
An instruction is given to 42, and an instruction is given to the image processing unit 340 to suspend the display of the image display unit 32. Based on this instruction, the image processing unit 340 sets the display image data 111
Is suspended, and nothing is displayed on the image display unit 32 (step S57).

Thereafter, as in the first embodiment, the non-optical operation command is transmitted until the communication unit 342 receives data indicating the processing result indicating that the operation of the driving unit 23 of the camera 2 has been completed. Is received (steps S58, S59).

As described above, when a plurality of commands are input as optical operation commands, it is possible to prevent an image from being displayed on the image display unit 32, and control the image display unit 32 only when an optical operation requires some time. hand,
Frequent switching of the display state can be prevented.

<3. Third Embodiment> In the mobile phone 3 according to the above embodiment, an image is not displayed on the image display unit 32 of the mobile phone 3 while the driving unit 23 of the camera 2 is operating. Based on the image data 110 and the optical operation command input from the operation unit 31, it is also possible to display some image on the image display unit 32 so that the user can easily grasp the situation of the camera 2.

FIG. 15 is a flowchart showing the operation of the mobile phone 3 according to the third embodiment constructed according to such a principle. Note that the image capturing system 1 according to the third embodiment has the same configuration as that of the first embodiment (see FIGS. 1 to 5).

The mobile phone 3 according to the present embodiment receives the image data 110 (step S61) and generates and displays the display image data 111 (step S62), as in the first embodiment. Further, it is determined whether or not an optical operation command has been input (step S63). If the optical operation command has been input, the input optical operation command is transmitted to the camera 2 (step S64).

Operation control section 341 in the present embodiment
Notifies the image processing unit 340 of the input optical operation command. The image processing unit 340 that has received the notification,
For example, left and right for pan command, up and down for tilt command,
In the case of a zoom command, the display image data 111 displayed immediately before is deformed to an expected state in accordance with the input optical operation command such as enlargement / reduction, and new display image data 111 is generated to display the image. It is displayed temporarily on the unit 32 (step S65).

It is to be noted that this temporary alternative display may be performed only for a predetermined time from the time of input of the optical operation command, and when the camera 2 performs transmission hold control as in the first embodiment. The alternative display is completed in response to the completion of the pan or tilt operation and the release of the hold, in response to the image of the new frame being transmitted from the camera 2,
The display may return to the display of the live image transmitted from the camera 2.

FIG. 16A to FIG. 16D show the third
FIG. 14 is a diagram showing an example of an image displayed before and after an optical operation command is input in the image display unit 32 of the mobile phone 3 according to the embodiment. FIG. 16A is a diagram illustrating an image immediately before an optical operation command is input. FIG.
6 (b) and FIG. 16 (c) show the driving unit 23 of the camera 2.
FIG. 8 is a diagram showing an image that is alternately displayed during the operation of FIG. FIG.
(D) is a diagram showing an image after the operation by the optical operation command is completed.

The images shown in FIGS. 16 (b) and 16 (c) correspond to the images shown in FIG.
This image is generated by shifting the image shown in (a) to the left based on an optical operation command of panning right, and interpolating the blank portion created by the shift with one color of the background. By alternately displaying such an image, the user can easily confirm with the optical operation command that the camera 2 is operating according to the user's instruction.

The color used for the interpolation is not limited to one color of the background, but may be white or black, and may not be one color. That is, any image pattern can be used as long as it is an image pattern that can be easily generated and the user can easily recognize that the image displayed as a substitute is an image during operation of the camera 2.

Thereafter, similarly to the first embodiment, transmission of the non-optical operation command is performed until the operation control unit 341 determines that the operation of the driving unit 23 of the camera 2 is completed based on the data indicating the processing result. And the reception of the data indicating the processing result are repeated (steps S66 and S67). When it is determined that the operation is completed, the processing is executed from step S61 to terminate the alternative display.

As described above, similar to the first embodiment, the effects of reducing the amount of data processing and image processing during the operation of the drive unit 23 of the camera 2 can be obtained, and the image display unit of the mobile phone 3 can be obtained. By alternately displaying an image similar to the image during operation of the camera 2 at 32, the user can easily grasp the situation of the camera 2 and reduce erroneous operations and the like.

Further, as in the second embodiment, it is determined whether or not a plurality of types of optical operation commands are continuously input within a predetermined time, and the plurality of types of optical operation commands are continuously input within a predetermined time. The above alternative display may be performed only when input is made by the user. This is the same in the following fourth embodiment.

<4. Fourth Embodiment> In the third embodiment, the display image data 111 used for the alternative display during the operation of the camera 2 is the display image data 1 that was displayed immediately before.
It was decided to generate by deforming based on 11
The generation of the display image data 111 used for the alternative display may be performed by synthesizing a fixed image prepared in response to an optical operation command input in advance and the immediately preceding display image data 111.

The operation of the mobile phone 3 according to the fourth embodiment constructed according to such a principle will be described with reference to FIG. First, in the mobile phone 3 according to the present embodiment,
As in the third embodiment, steps S61 to S6
4 is performed. For example, in the case of a pan command, the image processing unit 340 notified of the input optical operation command reads a fixed image prepared in advance corresponding to the pan command from the memory 37, and displays the fixed image immediately before the fixed image. The display image data 111 is combined with the display image data 111, and the display image data 111 is newly generated and displayed on the image display unit 32 (step S65).

FIG. 17A to FIG. 17D show the fourth embodiment.
FIG. 14 is a diagram showing an example of an image displayed before and after an optical operation command is input in the image display unit 32 of the mobile phone 3 according to the embodiment. FIG. 17A is a diagram illustrating an image immediately before an optical operation command is input. FIG.
7 (b) and FIG. 17 (c) show the drive unit 23 of the camera 2.
FIG. 8 is a diagram showing an image that is alternately displayed during the operation of FIG. FIG.
(D) is a diagram showing an image after the operation by the optical operation command is completed.

The images shown in FIG. 17 (b) and FIG. 17 (c) correspond to the images shown in FIG.
This is an image generated by combining the immediately preceding display image shown in (a) with the fixed image 600 prepared in advance corresponding to the optical operation command to pan right. By alternately displaying such an image, the user can easily confirm with the optical operation command that the camera 2 is operating according to the user's instruction.

Thereafter, similarly to the third embodiment, transmission of the non-optical operation command is performed until the operation control unit 341 determines that the operation of the driving unit 23 of the camera 2 is completed based on the data indicating the processing result. And the reception of data indicating the processing result are repeated (steps S66 and S67), and when it is determined that the operation is completed, the processing is repeated from step S61 again.

As described above, in the image photographing system 1 according to the fourth embodiment, the same effect as that of the third embodiment can be obtained, and an image to be alternately displayed during the operation of the drive unit 23 of the camera 2 can be obtained. Standard image 60 prepared in advance
By generating the display image data 111 by synthesizing 0 and the display image data 111, the data processing amount in the mobile phone 3 can be reduced as compared with the case where the display image data 111 is sequentially deformed and generated.

<5. Modifications> While the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-discussed preferred embodiments, but allows various modifications.

For example, in the above-described embodiment, the mobile phone 3 has been described as an example of the operating device in the image capturing system 1, but the operating device is not limited to the mobile phone, but may be a dedicated mobile terminal or a personal computer. May be used. That is, any device may be used as long as it has a function of transmitting a user operation signal to the camera and a function of receiving and displaying an image captured by the camera.

The method of communicating data between the photographing device and the operation device is not limited to the above embodiment. For example, wireless communication such as Bluetooth may be used,
The Internet may be used.

Further, in the camera 2 and the mobile phone 3, a series of image processings are all executed by software processing by the CPU, but a part or all of the processings can be realized by a dedicated circuit. is there.

In the above embodiment, the image display unit 32 is operated based on the optical operation command input from the operation unit 31.
Is changed, the data indicating the optical operation command received by the camera 2 may be transmitted from the camera 2 and the display may be changed accordingly. In the image capturing system 1, sufficient real-time responsiveness of the processing result and the like of the camera 2 is secured, and even if the alternative display on the mobile phone 3 is performed by the method shown in FIG. Smooth display can be performed using the response from the camera 2.

[0093]

According to the first to third and ninth aspects of the present invention, while the control means of the image photographing apparatus controls the photographing means in accordance with the optical operation command, the communication means transmits image data to the communication means. By suspending the transmission, the amount of data processing and the amount of data communication in the image capturing apparatus can be reduced, and the effect of image delay when the user operates the image capturing apparatus from the operation device can be prevented.

According to the third and tenth aspects of the present invention, the optical operation command includes pan, tilt, zoom, focus, or iris, so that a flexible and complicated operation can be performed on the image photographing apparatus. The operation environment of the user can be improved.

According to the fourth to eleventh aspects of the present invention, when an optical operation command is input, a blurred image unnecessary for the user or an image in which a delay has occurred is prevented from being displayed. The operation environment of the user can be improved.

According to the fifth aspect of the present invention, the display state of the image display section is frequently changed by performing the alternative display only when a plurality of optical operation commands are input and the optical operation requires time. Can be prevented, and the operation environment of the user can be improved.

According to the sixth aspect of the present invention, an erroneous operation by a user caused by displaying a blurred image or an image having a delay is prevented by performing an alternative display in which an image is not displayed during the operation of the image photographing apparatus. be able to.

According to the seventh aspect of the present invention, the image generated by the image processing unit is displayed alternately during the operation of the image capturing apparatus, so that the user can easily grasp the state of the operating image capturing apparatus. it can.

According to the eighth aspect of the present invention, the previously received old image data is transformed to generate the second image data, and in the ninth aspect of the present invention, the previously received old image data is generated. Second image is synthesized with other image data
By generating the image data, the user can easily grasp the situation during the operation of the image photographing apparatus, and the operation environment of the user can be improved.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of an image photographing system according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration of a camera in the image capturing system.

FIG. 3 is a diagram showing a functional configuration of the camera together with other configurations.

FIG. 4 is a diagram showing a part of the configuration of the mobile phone in the image capturing system, which mainly relates to features of the present invention.

FIG. 5 is a diagram showing a functional configuration of a mobile phone together with other configurations.

FIG. 6 is a flowchart showing an operation of the camera according to the first embodiment.

FIG. 7 is a flowchart showing an operation of a camera interrupt process.

FIG. 8 is a diagram schematically showing a data generation situation in a conventional image photographing system.

FIG. 9 is a diagram schematically showing a data generation state in the image photographing system according to the embodiment.

FIG. 10 is a flowchart showing an operation of the mobile phone according to the first embodiment.

FIG. 11 is a diagram showing a display example of an image in a conventional image photographing system.

FIG. 12 is a diagram showing a display example of an image in the image photographing system according to the embodiment.

FIG. 13 is a flowchart showing the operation of the camera according to the second embodiment.

FIG. 14 is a flowchart showing an operation of the mobile phone according to the second embodiment.

FIG. 15 is a flowchart showing an operation of the mobile phone according to the third embodiment.

FIG. 16 is a diagram illustrating a display example of an image in the third image capturing system.

FIG. 17 is a diagram illustrating a display example of an image in the fourth image capturing system.

[Description of Signs] 1 Image capturing system 2 Camera 21 Image capturing system 210 Zoom lens 221 Focus lens 22 Spherical unit 220 CCD 23 Drive unit 230 First drive unit 231 Second drive unit 232 Third drive unit 24, 33 Antenna 250 Image processing Unit 251 Camera control unit 252 Communication unit 29 Main body 3 Mobile phone 31 Operation unit 32 Image display unit 340 Image processing unit 341 Operation control unit 342 Communication unit 600 Standard image

Continued on the front page (72) Inventor Keiji Kondo 2-3-13 Azuchicho, Chuo-ku, Osaka-shi, Osaka Osaka International Building Minolta Co., Ltd. F term (reference) 5C022 AA13 AB01 AB21 AB65 AB66 AC27 5C054 AA01 CF03 CF05 DA07 EA03 EA05 FF02 5C062 AA11 AA12 AA37 AB17 AB25 AB38 AC05 AC21 AC24 AC34 AC58 AE01 AE15 BB03 BD00 5C075 AB06 CA90 CD11 CD21 CD90 FF90

Claims (11)

[Claims] 1. An image photographing device operable from an operation device, comprising: photographing means for acquiring image data of a subject; communication means for performing data communication with the operation device; Control means for controlling the photographing means based on the optical operation command, when the obtained data is an optical operation command for instructing a change of an optical incidence condition in the photographing means; and An image photographing apparatus comprising: a suspending unit that suspends transmission of the image data in the communication unit while controlling the photographing unit accordingly. 2. The image photographing apparatus according to claim 1, wherein the holding unit is activated when a plurality of commands are continuously received as the optical operation command within a predetermined determination time by the communication unit. An image photographing apparatus characterized by being performed. 3. The image capturing apparatus according to claim 1, wherein the optical operation command includes a pan, a tilt, a zoom, a focus, or an iris. 4. An operating device for operating an image capturing apparatus, comprising: an input unit for a user to input an operation command for the image capturing apparatus; a display unit for displaying image data; A communication unit that performs data communication and receives first image data as a live image from the image capturing device; and the operation command input by the input unit instructs a change in an optical incident condition in the image capturing device. Control means for causing the display means to temporarily perform alternative display when the instruction is an optical operation command to be performed. 5. The operation device according to claim 4, wherein the control unit is activated when a plurality of commands are input as the optical operation command. 6. The operating device according to claim 4, wherein the control unit does not display anything on the display unit as the substitute display. 7. The operating device according to claim 4, further comprising: an image processing unit configured to generate second image data different from the first image data received by the communication unit; However, the operation device displays the second image data obtained by the image processing means as the simplified display on the display means instead of the first image data. 8. The operating device according to claim 7, wherein the image processing unit is configured to execute the first processing by the communication unit in advance.
An operation device, wherein the second image data is generated by transforming received old image data as image data. 9. The operating device according to claim 7, wherein the image processing unit is configured to execute the first processing by the communication unit in advance.
An operation device, wherein the second image data is generated by combining other image data with old image data that has been received as image data. 10. The operating device according to claim 4, wherein the optical operation command includes pan, tilt, zoom, focus, or iris. 11. An image photographing system, comprising: the image photographing device according to claim 1; and the operating device according to claim 4. Imaging system.