JPS6162281A - Image pickup and display system - Google Patents

Abstract

PURPOSE:To eliminate longitudinal and lateral operations at the time of picking up an image and to draw freely a picture by providing an image pickup means for converting optical picture information into an electrical signal, and 1st means for forming information on the attitude of the image pickup means, a display means for projecting an optical picture and the 2nd means for controlling the attitude of the optical picture on a display screen. CONSTITUTION:Data relating to the rotation of an image pickup device at the time of picking up the image of an attitude sensor 12 is outputted to a data adder circuit 13. On the other hand, attitude data is added to the picture signal outputted from an image pickup element 11 in the data adder circuit 13, and is recorded on a magnetic disk 15 by a recorder 14. The directional data for showing the rotational attitude of the image pickup device is separated from the signal reproduced by a reproducing device 25 in terms of a data separator circuit 22, and a control circuit 23 forms control data used for processing the rotation, reduction, etc., so that a subject can be in the standing state on the display screen of a display device 21. A picture processing circuit 24 carries out the picture processing such as the rotation and reduction, and the display device 21 projects the reproduction picture.

Description

Detailed Description of the Invention [Technical Field] The present invention relates to imaging and display systems, and in particular, in an imaging means, image information is converted into an electrical signal, and this is transmitted through a transmission path or magnetically or optically recorded. Imaging and display for observation on a display means via a medium
Regarding the system.

[Background technology]

General K, TV/・Systems display images with an aspect ratio of 3:
It is assumed that the observation will be made on the 4th monitor screen, and all the related equipment, such as the camera and monitor, are set up with the assumption that the vertical and horizontal relationships will always be constant.

Therefore, when taking an image with a camera, since the vertical and horizontal relationships are determined by the TV/monitor, it is necessary for the camera to take images while also observing the vertical and horizontal relationships. In other words, if this relationship is not maintained, it will not be possible to observe an erect image during playback.

However, especially with portable cameras, etc.
Dogs are the most important aspect of drawing when taking images. Rimashi,
When taking an image, there are many cases where it is desired to take images with free varus, for example, changing the vertical and horizontal relationship, without being limited to the vertical and horizontal relationships. For this reason, there has been a strong demand for a system with a high degree of freedom in image creation.

〔the purpose〕

Therefore, the purpose of non-invention is to solve the above problem? In order to eliminate vertical and horizontal constraints during image capture and to enable free drawing, we provide an imaging and display system that enables the observation of an erect image at all times, regardless of the vertical and horizontal angle K at the time of image capture, when monitoring the image. It's about doing.

Another object of the present invention is to provide an imaging and display system that can achieve the above object without requiring large-scale means such as mechanical attitude control of the display means. .

[Explanation based on examples]

Hereinafter, the means taken in the present invention to achieve the above object will be explained by way of example. First, referring to FIG. 1, the figure shows an image pickup device in a conventional image pickup and display system. This figure shows the relationship between the orientation of the image and the orientation of the reproduced image displayed on the image reproducing device accordingly. In FIGS. 1(a) and (bXc), IO is an imaging device such as an electronic camera, 11 is an imaging device such as a CCD that converts an optical image of a subject into an electrical signal, and 20 is an imaging device 10.
an image reproducing and displaying device for reproducing and displaying an image captured by the 2
Reference numeral 1 denotes display means such as a CRT display for displaying images.

FIG. 1(a) shows the case where the image capturing device 10 is not rotated, that is, the subject is imaged in a normal upright position.

In this case, the reproduced image of the subject displayed on the display device 21 of the image reproduction device 2 is in an erect state and at an angle of 6 degrees.
9. However, if the imaging device 10 is rotated from an upright position, i-'c', 1. - When imaging is performed (for example, FIGS. 1(b) and 1(c)), the reproduced image of the subject displayed on the display means 21 of the image reproducing and displaying device 20 changes as the imaging device 10 is rotated. It will rotate from an upright position on the screen.

For this reason, it is not only unpleasant for the person viewing the reproduced image, but also the meaning of the subject may become unclear depending on the subject.

The present invention is intended to solve such disadvantages, and embodiments thereof will be described below.

In addition, the embodiments described below will be described with reference to still image capturing and display using the present invention using a magnetic disk as a recording medium.
Although this is an example in which the present invention is applied to a system, it goes without saying that the present invention is not limited to this embodiment. For example, the recording medium may be an optical disk or a magnetic tape in a VTR. Furthermore, it is also applicable to a system in which captured images are directly displayed without any recording/reproduction intervention.

Referring to FIG. 2, (a) shows imaging, recording, etc. In the figure, 11 is an image sensor such as a CCD that converts an optical image of a subject into an electrical signal, and 12 is an image sensor including the image sensor 11. A posture sensor 13 detects the posture, that is, the rotational state, of the device 10 (such as an electronic camera) and outputs an electric signal corresponding to the posture.
This is a data addition circuit that adds the attitude data output from step 12. Reference numeral 14 denotes a recording device for recording onto the magnetic disk 15 an image signal to which posture data, which is the output of the data addition circuit 13, is added.

Next, FIG. 2(b) shows reproduction and display, etc., for reproducing image signals including posture data from a magnetic disk on which image signals including posture data are recorded by the imaging and recording shown in FIG. 2(a), and displaying images. In the figure, reference numeral 25 indicates a reproducing device for reproducing recorded signals from the magnetic disk 15;
23 is a data separation circuit that separates posture data and image signals from the reproduction signal; 23 is a control circuit that generates control signals for rotation, reduction, etc. based on the posture data separated by the data separation circuit; 24 is a data separation circuit; This is an image signal processing circuit that performs rotation, reduction, etc. on the image signal separated by the circuit 22 based on a control signal that is the output of the control circuit 23. Reference numeral 21 denotes display means such as a CRT displayer for displaying an image signal subjected to processing such as rotation and reduction by the image processing circuit 24.

Assume that in the above configuration, the imaging device (imaging element 11) is rotated to capture an image of a subject. At this time, the posture sensor 12 outputs data regarding the rotation of the imaging device during imaging to the data addition circuit 13. On the other hand, the image signal output by the image sensor 11 is added with attitude data in the data addition circuit 13, and is recorded on the magnetic disk 15 by the recording device 14. Next, upon reproduction, the reproduction device 25 reproduces the image signal to which the attitude data has been added from the magnetic disk 15. Data separation circuit 22 from the reproduced signal
, the direction data indicating the rotational attitude of the imaging device is separated, and the control circuit 23 performs processing such as rotation and reduction on the separated data so that the subject is in a royal state on the display surface of the display device 21. Form the control data for performing this. Based on this control data, the image processing circuit 24
performs image processing such as rotation and reduction, and displays the reproduced image on the display device 21. For this reason, Fig. 3(a)(b)(
c) As shown in comparison with Fig. 1 (≧) (b) and (c) for each K, the subject's body is always in the royal state on the display surface of the display means 21, regardless of the posture of the imaging device at the time of imaging. is displayed.

4 and 5 show specific examples of the attitude sensor 12. FIG. 4(a) is a layout of the first example, t0,
Figure (b) is its circuit diagram. Also, Fig. 5(a) shows the second
FIG. 5(b) is a circuit diagram of the example shown in FIG.

First, the first example will be explained. In FIGS. 4(a) and (b), 121 is a resistance band provided inside the cylindrical insulating case in an insulated state, and 122 is a fluid conductor such as mercury that can freely move inside the cylindrical insulating case. , 123 are output terminals for taking out the output of the attitude sensor as a change in resistance value. In such a configuration, the attitude sensor is fixed at an appropriate location inside the imaging device. When the imaging device is rotated, the conductor 122 is always in the downward position due to gravity, so
The resistance value of the circuit consisting of the output terminal 123, the resistance band 121, and the conductor 122, that is, the resistance value between the output terminals 123 changes depending on the rotational position of the posture fixed to the imaging device. In other words, the posture sensor obtains a resistance value according to the rotational position of the imaging device.
In b), 122 is a fluid conductor such as mercury that can freely move inside the cylindrical insulating case, 124 is the width of the conductor provided inside the cylindrical insulating case, and 125 is the cylindrical insulating case. There are a plurality of ring contact terminals inside which are insulated with respect to the conductor width 124 and electrically connected to the conductor 122.

In such a configuration, the conductor width 124 and donor contact terminal 12
5, an output related to the rotational attitude of the imaging device can be obtained as a digital quantity.

6 and 7, the data addition circuit 13 of FIG. 2(a)
In FIG. 6, which shows a specific example and its output format, 131 is a vertical and The synchronization detector 132 detects a horizontal synchronization signal, and the analog/digital converter (hereinafter referred to as A) converts the analog attitude data from the attitude sensor described in FIG.
/D converter), 133 is a belly button parity addition input terminal 135 for adding a header and a harness to the posture data.
A switch is used to switch between the video signal from the video signal and the posture data to which the header and parity are added from the henodata adder 133.

Here, in this example, the synchronization detector 131 detects the 16H (H is one horizontal period) IH from the previous image of the coma blurring/king period.
During this time, the switch 134 is controlled to select the output of the header parity adder 133, and otherwise select the video signal from the input terminal 135.

In such a configuration, the analog output of the posture sensor 12 appearing at the terminal 123 is converted into a digital signal by the flA/D converter 132, and then converted to a digital signal by the header parity adder 133.
After the header and parity are added in the switch 134
is output to. Here, the synchronization detector 131 normally causes the switch 134 to select the video signal from the input terminal 135;
I-] Only between the IH of the eyes, the belly button grip attachment device 1
33 outputs are selected.

The video signal added with the posture data appearing at the output terminal 136 in this manner becomes as shown in FIG. 7(a).

Here, 31 indicates attitude data to which a header and parity have been added. As can be understood from FIG. 3(b), this attitude f-tater 31 is housed within the IH and has a format as shown in FIG. 4(c).

Note that when using the attitude sensor shown in FIG. 5, the A/D converter 132 is not necessary. In that case, a data converter may be used if necessary.

FIG. 8 shows a specific example of the data separation circuit 22 shown in FIG. 2(b). In the figure, 221 is a data detector that detects posture data included in the reproduced video signal that is reproduced from the magnetic disk 15 by the reproduction device 25 and input to the input terminal 223; This is a switch that outputs posture data to an output terminal 224 and a video signal to an output terminal 225.

In such a configuration, as shown in FIG. 7(a), when a video signal with posture data added is input to the input terminal 223, the data detector 221 detects a data header,
The switch 222 is controlled to output the attitude data added in the IH to the output terminal 224, and otherwise output the video signal to the output terminal 225. Note that at this time, the data detector 221 is configured to also perform a parity check.

FIG. 9 shows a specific example of the image signal processing circuit 24 shown in FIG. 2(b). In FIG. 9, 241 is an A7/Dt converter that converts the image signal from the data separation circuit 22 applied to the input terminal 248 into digital data, and 242 is an A/D converter.
-”i,,r.

Image signal converted to file data (hereinafter referred to as image data)
A frame memory 243 that stores the input terminal 24
An address generator 244 generates a memory address of the frame memory 242 in order to perform processing such as rotation and reduction of data according to the output of the control circuit 23 shown in FIG. When performing processing such as rotation or reduction, the rotation of the point with no image data is
The image data interpolator 245 performs interpolation from the image data to create complete image data.When the image data is rotated or reduced, etc., the image data interpolator 245 borders the image data and colors the gap between the image data and the display screen. A back/force 2-/pose generator 246 generates signals for the image data interpolator 244, and a back/color/pose generator 245 applies the image data output from the image data interpolator 244 and subjected to processing such as rotation and reduction.
A bank/color/pose synthesizer 247 which frames the image data created by the above and synthesizes a signal for coloring the image data and the gap between the display screen,
A digital /
An analog converter (hereinafter referred to as a D/A converter) is used.

In the above configuration, when an image signal is input to the input terminal 248, the image signal is converted into digital image data by the A/D converter 241, and the digital data for one field or one frame is stored in the frame memory 242. is memorized. - 10,000, address and address by the output of the control circuit 23
A generator 243 generates addresses for the frame memory 242 in response to image rotation and reduction. In this process, when there is no image data, interpolation is performed from surrounding image data by the image data interpolator 244. The interpolated image data is sent to a back color pose generator 24.
After the back color drawn in step 5 is synthesized by the back color pose synthesizer 246,
The D/A converter 247 performs D/person conversion and outputs it to the display means 21 as an analog image signal.

FIG. 10 shows an example of the characteristics of the control circuit 23. Figure (a)
indicates a correction angle at the time of reproduction with respect to a rotation angle of the imaging device at the time of imaging. To output a correction angle with an equal bag value in the opposite direction so that a reproduced image is erected regardless of the rotation of an imaging device during imaging. FIG. 4B shows a reduction ratio when the reproduction image is reduced so as not to protrude from the display screen when the reproduced image is rotated in an imaging display system with an aspect ratio of 4:3. Changing the reduction ratio with respect to the rotation of the imaging device during imaging is unpleasant and unpleasant for the W;A prize winner, and also complicates the circuit configuration. Therefore, the reduction ratio may be fixed at about 0.7 times, and even if the reproduced image slightly protrudes from the display screen, it may be ignored and only rotation performed.

In the second embodiment described above, 11 posture data are added to the IH during the sericulture direct plugging/king period, but if the posture data can be separated from the image signal, how about frequency multiplexing, etc. It may be added in any form. Further, the posture data may not be added at the time of image capture, but may be added after image capture. Furthermore, by adding data after imaging, it can also be used as a key signal for special effects.

Furthermore, at the time of reproduction, the reproduced image is rotated by digital processing based on the posture data, but rotation and other processes may be performed in an analog manner.

〔effect〕

As described above, the present invention provides a system that electronically captures images and monitors them via a recording medium or a transmission path, with an extremely simple and economical configuration, which allows freedom of drawing at the time of image capture. This system is extremely useful in this type of system because it increases the angle of view and allows the monitor to always display an upright image regardless of the orientation of the imaging means at the time of imaging. . In particular, since the image is held erect by electrically processing the image signal, the configuration is larger and less expensive than a monitor that rotates. It is something that can be implemented.

[Brief explanation of the drawing]

Figures 1 (a), (b), and (c) show conventional imaging.
A schematic diagram showing the relationship between captured images and reproduced images in a display system. FIGS. 3(a), (b), and (C) show the relationship between the reproduced image and the captured image obtained by the system shown in FIG.
Schematic diagrams shown in the same manner as the figures, Figures 4(a), (b) and 5(a), (b) are m2
Figure 6 is a block diagram showing a specific example of the data addition circuit in Figure 2(a); Figures (a), (b), (((I) are diagrams showing the output and data format of the data addition circuit in Figure 6, and Figure 8 is a specific example of the data separation circuit in Figure 2 (b). 9 is a block diagram showing a specific example of the image signal processing circuit in FIG. 2(b), and FIG. 10(a) and (b) are a block diagram of the control circuit in wJ2(b). It is a diagram showing control characteristics. 10... Imaging device, 11... Imaging element, 12...
Posture sensor, 13... Data addition circuit, 14... Recording device, 15... Magnetic disk, 2o... Image reproducing display device, 21... Display means, 22... Data separation circuit, 23 . . . control circuit, 24 . . . image signal processing circuit, 25 . . . playback device.

Claims (2)

[Claims] (1) An imaging device that converts optical image information into an electrical signal, a first device that forms information regarding the posture of the imaging device, and a display that projects an optical image expressed by the electrical signal. and second means for controlling the orientation of the optical image on a display screen of the display means based on the information formed by the first means. . (2) a recording means for recording the electrical signal and the information regarding the posture on a recording medium; and reproducing the electrical signal and the information regarding the posture from the recording medium and supplying them to the display means and the second control means, respectively. The imaging and display system according to claim 1, further comprising reproduction means for.