JP2008153876A - Image display system, camera device, display processing device, and display magnification change method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display system in which resolution does not deteriorate even if a display magnification is changed, allowing a surrounding view to be observed. <P>SOLUTION: A camera device 2 has an operation portion, an optical photographing portion with an optical zoom function, and a camera controller. The camera controller acquires a representative image of a desired optical zooming factor, and a plurality of images including at least one variable magnification image of a scale factor different from the desired optical zooming factor by continuous shooting. A display magnification controller 5 controls changing of a display magnification of a video content to a fixed image area 61 of a display device 6. The display magnification controller 5 selects the representative image to be displayed on an image area 61 in the absence of instructions, and selects one variable magnification image corresponding to the instructions, and controls to replace the selected image with the representative image displayed in the image area 61 in the presence of instructions. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image display system capable of changing the display magnification of video content for a screen area having a certain size based on an instruction from the outside, and a camera device and a display processing device that can be used in the image display system And a display magnification changing method.

Recent image display systems have various functions such as addition of information such as characters and simultaneous display of a plurality of videos in addition to the conventional function of viewing and enjoying video content (video content). Such functions are diversified more than ever due to the progress of digital image display systems and the increase in the size and definition of display screens.
As one of the diversification of digital display functions, there is known a zoom display function for enlarging and displaying video content within a fixed screen area of a part or all of the display screen (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 2004-228867 zooms the video content displayed in a unit of a predetermined equally divided area of the display screen by two or three times on the entire screen by a cursor operation of the remote controller. Possible video display devices (eg video devices such as DVD players) are disclosed.
This disclosed function is also applied to a television receiver and is known as a zoom display function.

On the other hand, the zoom display function of a video device or a television receiver (or a video monitor) can be used in other ways besides watching a software such as a DVD or a broadcast program. Specifically, these devices are input from a recording medium such as a cord connected to an external input terminal or a card-type memory inserted into a dedicated slot, and acquired by an external device (for example, a digital camera). The image data can be displayed as a moving image or a still image. When displaying an image from an external device or a recording medium, using the zoom display function is convenient because various ways of enjoying video can be enjoyed.
JP-A-11-266437

  The zoom display function of the video display device and the television receiver disclosed in the above cited document 1 changes the display magnification in the area by a user operation while keeping the size of a certain screen area as it is. . Using this function, for example, in a concert program in which a large number of musicians are participating, only a favorite musician can be enlarged and viewed. In addition, the OSD screen in the broadcast video (moving image) can be viewed by enlarging the detailed video content displayed on the OSD screen without changing the size of the OSD screen. Note that switching the OSD screen to full screen display is an enlargement of the display screen size, which is different from the “zoom display function of video content” referred to here.

However, the zoom display function is disadvantageous in that it is difficult to view simply by enlarging the video content, or the desired information cannot be obtained.
One of the causes is that the resolution of the display image is lowered because the zoom display function is digital zoom by digital processing. A technique for improving resolution by interpolation processing or the like is also known, but in this case, the processing load is large and there is a limit to resolution improvement by interpolation.
In general, when the image to be zoomed in is a moving image, even if the resolution is lowered, the viewer is not so concerned. On the other hand, in the case of a still image, when zooming up, the screen becomes very difficult to see due to a decrease in resolution. Furthermore, in the initial state where a scene (still image) that you want to zoom is displayed in a program or commercially available software, you can only zoom in from the entire video content of the scene. You can't see the surroundings beyond the content of the first video.

However, in view of the fact that the zoom display function is used with a video source arbitrarily input by a general user as described above, the zoom-up function alone is insufficient. In other words, the image taken by the user may be dissatisfied, for example, "I wanted more up" or "Part of the face is off the screen". Absent.
Furthermore, with regard to programs and commercial software, considering the current situation in which the communication environment is improving and the capacity of media is rapidly increasing, not only the content of the video that is initially projected but also that it is usually unnecessary. Though possible, in order to respond to various requests of viewers who are interested in the surrounding situation, it is desirable to distribute or market in advance including a video showing the surrounding situation.

An image display system according to the present invention includes a camera device, a display device, and a display magnification control unit built in the display device or provided in another electrical device connected to the display device.
The camera device includes an operation unit capable of performing a shutter operation and a zoom operation, an optical photographing unit having an optical zoom function capable of increasing a photographing magnification by the zoom operation, and the optical photographing unit based on the shutter operation. A camera control unit for controlling the camera. By this control, a plurality of images including a representative image having a desired optical zoom magnification determined by the zoom operation and at least one zoomed image having a magnification different from the desired optical zoom magnification are obtained by continuous shooting. Is done.
The display magnification control unit performs control for changing the display magnification of the video content for a screen area having a certain size of the display device based on an instruction from the outside. Specifically, when there is no instruction, the display magnification control unit performs control to select the representative image from the plurality of images sent from the camera device and display the selected representative image on the screen area of the display device. . On the other hand, when the instruction is given, the display magnification control unit selects the one scaled image corresponding to the instruction from the plurality of images and displays the representative image on the screen area. Perform replacement control.

  The camera device according to the present invention includes an operation unit capable of performing a shutter operation and a zoom operation, an optical photographing unit having an optical zoom function capable of increasing a photographing magnification by the zoom operation, and a camera control unit. The camera control unit controls the optical photographing unit based on the shutter operation, and represents at least one representative image having a desired optical zoom magnification determined by the zoom operation and a magnification different from the desired optical zoom magnification. A plurality of images including the zoomed image are obtained by continuous shooting, and the data group of the plurality of images is converted into one file data to which an identifier indicating that the zoomed image is included is attached.

  In one aspect of the present invention, preferably, the camera device further includes a primary memory unit and a secondary memory unit. The camera control unit controls execution of continuous shooting for acquiring the plurality of images in response to a half operation of the shutter, stores the obtained plurality of image data in the primary memory unit, and subsequently When a full shutter operation is detected, control is performed to read the obtained plurality of image data from the primary memory unit and record them in the secondary memory unit.

In another aspect of the present invention, the optical imaging unit preferably includes a plurality of the optical imaging units that are arranged so that the imaging centers for the same subject are different and can perform simultaneous imaging.
In this case, more preferably, the camera apparatus has a captured image monitor unit capable of displaying a plurality of positions of the imaging centers corresponding to each of the plurality of optical imaging units.
Preferably, the camera control unit has a plurality of image data groups acquired by simultaneous photographing of the plurality of optical imaging units, and position information of the imaging center of each image in the coordinates of the entire plurality of images. The control unit converts the attached file data into one file data and sends it to the display magnification control unit. The display magnification control unit is configured to display a plurality of marks representing the imaging center positions of the plurality of optical imaging units when displaying each image in the file data sent in the image area of the display device. Is displayed so as to be superimposed on each image.
In this case, preferably, the plurality of marks can be selected by a user operation. Then, when one mark is selected from the plurality of marks, the display magnification control unit converts one image data group acquired by the one optical photographing unit corresponding to the selected mark to the plurality of marks. An image data group is selected and used for image display on the display device.
More preferably, the display unit or the electric device provided with the display magnification control unit can arbitrarily specify a screen center position for changing the display magnification of the video content with respect to the image area by a cursor position by a user operation. And a video processing unit for changing the zoom display magnification of the video with respect to the image area by digital processing around the designated screen center position. The display magnification control unit controls the video processing unit to execute zoom display by the digital processing when a position in the screen other than the mark is designated by the cursor, and the mark is displayed by the cursor. Is selected, the image data group corresponding to the selected mark is selected, and the display magnification change control of the video content is performed by switching between the representative image and the scaled image.

The display processing apparatus according to the present invention can change the display magnification of the video content for a screen area having a certain size in the built-in or external display unit. The display processing apparatus includes an image input unit, a video processing unit, and a display magnification control unit.
The image input unit is a data group of a plurality of images obtained by continuously capturing a representative image acquired at a desired optical zoom magnification with respect to the same subject and at least one zoomed image having a different optical zoom magnification. It is possible to input file data created by attaching an identifier indicating that the zoomed image is included, and image data not including the identifier.
The video processing unit can digitally change the zoom magnification of the input image with respect to the image area.
The display magnification control unit attempts to detect the presence / absence of the identifier with respect to the image data input to the image input unit, and if the identifier is detected, the magnification of the video content with respect to the image region is determined as the file data. The change is executed by switching between the representative image and the scaled image. If the identifier is not detected, the video processing unit is controlled to change the zoom magnification by digital processing.

  A display magnification changing method according to the present invention is a video content display magnification changing method for changing a display magnification of video content for a screen area having a certain size based on an instruction from the outside, and for the same subject. In addition to the representative image acquired at a desired optical zoom magnification, a photographing step of continuously photographing a plurality of images including at least one zoomed image obtained by changing the magnification from the desired optical zoom magnification; and When there is no instruction, the representative image is selected from the plurality of images and displayed on the screen area. When the instruction is given, one scaled image corresponding to the instruction is selected from the plurality of images. And a display control step of replacing the representative image selected from the image and displayed in the screen area.

  Another display magnification changing method according to the present invention is a video content display magnification changing method for changing a video content display magnification for a screen area having a certain size based on an instruction from the outside. In contrast, a representative image acquired at a desired optical zoom magnification and at least one variable-magnification image having different optical zoom magnifications are included in a data group of a plurality of images obtained by continuously capturing the zoom image. An image input step capable of inputting file data created by attaching an identifier indicating the identifier and image data not including the identifier, and attempting to detect the presence or absence of the identifier with respect to the input image data. If detected, the file data is assumed to be the file data, and the magnification change of the video content for the image area is executed by switching between the representative image and the scaled image, If Besshi is not detected, the image area to comprise a display control step of performing a zoom magnification changes carried out by digital processing of the zoom magnification change of the input image.

  According to the above configuration, for example, when the operator of the camera apparatus captures an image with a desired optical zoom magnification and acquires one image, a change in the optical zoom magnification that is different (large or small) from the acquired desired image (representative image). A double (enlarged or reduced) image is automatically acquired. As a result, the enlarged screen at the time of zoom display can be replaced with the scaling screen and displayed, so that the resolution does not decrease. Further, when the representative image is captured in the middle of zooming, a zoomed (reduced) image with a smaller zoom magnification can be acquired, and in this case, control for displaying up to the information around the subject shown in the desired representative image Is possible.

  According to the present invention, even if the display magnification is changed, the resolution does not decrease, and an image display system that can be viewed up to the surrounding situation and has high viewer satisfaction, a camera device therefor and display processing therefor An apparatus and a display magnification changing method can be provided.

  The image display system according to the present embodiment includes a camera device, a display device, and a display magnification control unit. The display magnification control unit can be incorporated in a display device such as a television receiver or a video monitor, and can be connected to the display device and control the video display of the display device without being incorporated in the display device. There is a form that is built in an electric device, for example, a data storage device or a (recording) reproducing device. Further, the camera device may be any camera device that can be used not only for consumer applications used by general users but also for creating video content for programs, commercial software, and the like.

<< First Embodiment >>
The first embodiment relates to a case where a display magnification control unit is built in a data storage device capable of display control for an external display device. Hereinafter, the present embodiment will be described with reference to the drawings.

FIG. 1 shows the configuration of an image display system according to the first embodiment.
The illustrated image display system 1 includes a camera device 2 such as a digital still camera, a card type memory (MC) 3 in which image data captured by the camera device 2 is recorded and can be taken out to an external device, and a card type memory. 3 and a display device 6 connected to the data storage device 4 and capable of receiving display control from the data storage device 4.
The illustrated image display system 1 can record image data taken by the camera device 2 on a hard disk in the data storage device 4 via, for example, a USB cable or a card-type memory 3. The image recorded on the hard disk in the data storage device 4 is sent to the display device 6 via the HDMI cable. The data storage device 4 includes a display magnification control unit 5 that performs control when changing the display magnification of video content displayed on a predetermined image area (for example, an effective screen area) 61 of the display device 6. Details of the display magnification control unit 5 will be described later.

FIG. 2 is a block diagram of the camera device 2, FIG. 3 is a block diagram of the data storage device 4, and FIG. 5 is a block diagram of the display device 6.
The camera device 2 illustrated in FIG. 2 roughly includes an optical photographing unit 2A, a signal processing unit 2B, a camera control unit 2C, an operation unit 2D, a memory unit 2E, and a video and audio input / output unit. All of these components are connected to the internal bus 2F so that signals can be exchanged with each other.

  The optical photographing unit 2 </ b> A receives a light from a subject and is zoomed by a zoom lens 21 having a zoom function for changing an incident light range (photographing range of a subject) by position control of a plurality of lenses, and a zoom lens 21. An imaging element (for example, a CCD or CMOS sensor) 22 that receives the captured light on the imaging surface and photoelectrically converts it to output an imaging signal (image data).

The operation unit 2D includes a zoom operation unit 36 in which buttons for wide (W) at zoom-up and tele (T) at zoom-down are formed, and a button-type shutter operation unit 37, for example.
The memory unit 2E includes a built-in memory (Built-In Memory) 31 as a primary memory and a memory slot unit 32 into which a card type memory 3 as a secondary memory is inserted. The built-in memory 31 is, for example, a nonvolatile memory or a RAM, and the card type memory 3 has a configuration in which, for example, the nonvolatile memory is built in the card body.
The video and audio input / output unit includes, for example, an LCD display panel (LCD Display) 38, a microphone (MIC.) 34, and a speaker 35 as a captured image monitor. The microphone 34 collects sound in synchronization with photographing by the image sensor 22 and outputs an analog audio signal.

  The signal processing unit 2B includes an A / D converter (Audio A / D Converter) 23, an A / V encoder (A / V Encoder) 24, an A / V decoder (A / V Decoder) 25, and a D / A converter (Audio D / A Converter) 26 and LCD controller 27 (LCD Controller) 27.

The A / D converter 23 converts an analog audio signal output from the microphone 34 into digital audio data.
The A / V encoder 24 inputs digital image data from the image sensor 22 and digital audio data from the A / D converter 23, and compresses them and superimposes them for memory storage or line output. .
The A / V decoder 25 decompresses the digital data so that the audio data and the image data are compressed and superimposed on each other by the monitor display panel 38 and the speaker 35, and the original audio data and image data are reproduced. To restore. The digital data input to the A / V decoder 25 is acquired by the camera device 2 and is stored in the built-in memory 31 or the card-type memory 3, for example, and the camera device by line input. Any of image data and audio data sent to 2 may be used.
The D / A converter 26 is a circuit for converting the digital audio data restored by the A / V decoder 25 into analog and reproducing it from the speaker 35.
The LCD control circuit 27 controls the monitor display panel 38 based on the digital image data restored by the A / V decoder 25 and displays an image on the monitor display panel 38. The monitor display panel 38 can display various display data sent from the camera control unit 2C so as to be superimposed on the image, and the LCD control circuit 27 performs the data superimposition.

  The camera control unit 2C includes, for example, a main processor 28 including a CPU and a DSP, a primary memory control circuit (1st Memory Controller) 29, a secondary memory control circuit (2nd Memory Controller) 30, and a USB control circuit ( USB Controller) 33 is included.

The primary memory control circuit 29 is connected to the built-in memory 31 and controls writing and reading of data to and from the built-in memory 31.
The secondary memory control circuit 30 is connected to the card type memory 3 via the memory slot portion 32 and controls writing and reading of data to and from the card type memory 3.
The USB control circuit 33 has a USB cable connected to its output via an interface (not shown), and controls signal format conversion and data input / output between the camera device 2 and the USB cable.
The main processor 28 controls the other configuration shown in the figure, and further the operation of the camera device 2 as a whole. This control is performed by the main processor 28 executing a program built in advance. The program is stored in a storage area in the main processor 28 or the built-in memory 31, and the main processor 28 reads and executes the program.

The data storage device 4 illustrated in FIG. 3 is equipped with a remote controller 41 as an accessory.
The remote controller 41 includes a direction key 41A for instructing cursor movement in the up / down / left / right direction and an up / down key 41B that can be used to change the magnification, and converts key operation information including these into an infrared signal IR. Can be sent.
In the data storage device 4, an IR light receiving unit (IR DET.) 42 for receiving the infrared signal IR from the light receiving window 42A is provided.

  As shown in FIG. 3, the data storage device 4 includes two data storage means, that is, a built-in memory 43 and a hard disk device 46. Further, the data storage device 4 includes a memory slot portion 44 into which a card-type memory 3 can be inserted as a removable data storage medium, and a disc slot portion into which a disc (DISC) 7 such as a DVD or Blu-Ray can be mounted. 45.

The data storage device 4 includes a transcoder 47, an A / V decoder 48, and an HDMI transmission circuit 49 as signal processing circuits.
The transcoder 47 compresses and superimposes video data and audio data, respectively, to convert them into digital data, and converts the converted digital data into a different format, for example, depending on the data storage means, The process of converting to the specified bit rate is performed.
The A / V decoder 48 converts predetermined compressed data such as MPEG2 digital data into a baseband signal suitable for the display device 6.
The HDMI transmission circuit 49 converts the baseband signal from the A / V decoder 48 into a signal conforming to the HDMI standard, performs power amplification, etc., and transmits the signal to an HDMI cable connected to an interface (not shown). The signal sent to the HDMI cable may be a signal from the card type memory 3, USB cable, built-in memory 43, hard disk device 46 or disk 7.

A data storage control unit that controls the above-described configuration and the like is provided in the data storage device 4 (portion surrounded by a broken line in FIG. 3).
The data storage control unit includes, for example, a CPU, a DSP, etc., and a main processor (Main Processor) 50, a primary memory control circuit (1st Memory Controller) 51, and a secondary memory control circuit (as a display magnification control unit 5 shown in FIG. 2nd Memory Controller) 52, disk control circuit (DISC Controller) 53, hard disk control circuit (Hard Disc Controller) 54, USB control circuit (USB Controller) 55, bus arbitration circuit (Arbiter) 56, and encryption circuit (Encrypt- Engine) 57.
All the components in the data storage device 4 are connected to the internal bus 4A and can exchange signals with each other.

The primary memory control circuit 51 is connected to the built-in memory 43 and controls writing and reading of data to and from the built-in memory 43.
The secondary memory control circuit 52 is connected to the card type memory 3 through the memory slot 44 and controls writing and reading of data to and from the card type memory 3.
The disk control circuit 53 is connected to the disk slot unit 45 and controls writing and reading of data to and from the disk 7 loaded in the disk slot unit 45.
The hard disk control circuit 54 is connected to the hard disk device 46 and controls writing and reading of data to and from the hard disk device 46.
The USB control circuit 55 has a USB cable connected to its input via an interface (not shown), and controls signal format conversion and data input / output between the data storage device 4 and the USB cable.
The bus arbitration circuit 56 arbitrates data and control signals transmitted through the internal bus 4A.
The encryption circuit 57 encrypts data when storing it in the hard disk device 46, for example.
The main processor 50 controls the other configuration shown in the figure and the operation of the entire data storage apparatus 4. This control is performed by the main processor 50 executing a pre-installed program. The program is stored in a storage area in the main processor 50 or the built-in memory 43, and the main processor 50 reads and executes the program.

FIG. 4A shows an arrangement example of the front surface of the main body of the data storage device 4, and FIG.
In the illustrated arrangement example, two memory slot portions 44, one disk slot portion 45, and two USB terminals 4B are provided on the front surface of the data storage device 4. Further, two insertion ports 46A for the disk unit of the hard disk device 46 are provided on the back surface of the data storage device 4, and an HDMI terminal 4C and an AC power cord 4D are provided.
For this reason, the data storage device 4 of the present embodiment can insert two different types of card type memories 3 such as a memory stick (trade name) and an SD memory card (trade name). Also, different types of discs 7 such as DVD discs and Blu-ray discs (trade names) can be inserted. Furthermore, image data from a digital camera or a mobile phone can be input via the USB terminal 4B.
Further, since the data storage device 4 has two insertion ports 46A for the disk unit, in addition to the main hard disk device 46, another hard disk device 46 having the same recorded contents can be mounted for data backup. Can do. Further, a RAID (Redundant Array of Independent Discs) is constituted by these two hard disks, and a backup system in which recorded contents are constantly rewritten in synchronization can be constructed, thereby enhancing the safety of data storage.

  The display device 6 illustrated in FIG. 5 includes a display panel 62 having a screen area 61, a speaker 64 and a built-in memory 63, a signal processing unit 6A, and a display control unit 6B. All of these components are connected to the internal bus 6C and can exchange signals with each other.

  The signal processing unit 6A includes an HDMI receiver circuit (HDMI Receiver) 65, a graphics control circuit (Graphics Controller) 66, an A / V control circuit (A / V Controller) 67, a panel driver circuit (Panel Driver) 68, and an audio amplifier. (Audio Amp.) 69 is included.

The HDMI receiving circuit 65 receives an HDMI standard baseband signal from an HDMI cable connected to an interface (not shown), converts the format, and outputs the converted signal to the A / V control circuit 67.
The graphic control circuit 66 generates a graphic image from the received signal of the HDMI receiving circuit 65 or data such as OSD stored in the internal memory 63 in advance, and outputs it to the A / V control circuit 67.
The A / V control circuit 67 combines the graphic image from the graphic control circuit 66 with the image data of the baseband signal from the HDMI receiving circuit 65. When a graphic image such as a moving image is included in the signal received by the HDMI receiving circuit 65, the graphic image is extracted by the graphic control circuit 66 and then combined with the background image data by the A / V control circuit 67. The The A / V control circuit 67 also performs other video processing such as video and audio separation, image quality adjustment, and white balance adjustment.
The panel drive circuit 68 receives the image data from the A / V control circuit 67, drives the display panel 62 in accordance with the image data, and displays an image.
The audio amplifier 69 amplifies the audio data from the A / V control circuit 67 after analog conversion by a built-in D / A converter. The amplified audio data is output from the speaker 64 as audio.

  The display device 6 can perform digital zoom processing, and the processing is executed by the A / V control circuit 67 and the panel drive circuit 68. Therefore, the A / V control circuit 67 and the panel drive circuit 68 correspond to an example of the “video processing unit” in the present invention.

The image display system 1 according to the present embodiment configured as described above has at least one image having a different zoom magnification in addition to an image (hereinafter referred to as a representative image) taken by a user of the camera device 2 at a desired zoom magnification. Take images continuously (magnified images).
Then, when the user of the data storage device 4 gives an instruction to zoom in using the remote controller 41, the display magnification change of the video content in the screen area 61 of the display device 6 is performed by replacing the representative screen with the reference screen. Is executed under the control from the data storage device 4 side.

Hereinafter, the processing for changing the display magnification by the image replacement will be described with reference to the flowcharts of FIGS.
FIG. 6 is a flowchart showing a rough flow of processing of the present embodiment.
In this processing, the embodiment of the image data acquisition step ST1, the data transfer via the USB cable (or the data movement by the card-type memory (secondary memory) 3) ST2, and the display magnification changing method of the present invention is described. Including display control processing step ST3.
FIG. 7 is a flowchart showing details of image data acquisition in step ST1, and FIG. 8 is a flowchart showing details of step ST3.

Data acquisition shown in FIG. 7 is controlled by the main processor 28 shown in FIG. 2 executing a predetermined program.
After the power is turned on (not shown), the operation waits. In step ST <b> 10, the user operates the zoom operation unit 36 so that the subject fits in the monitor display panel 38 with a desired composition. Thereby, the zoom lens 21 operates.
Next, when the user operates the shutter operation unit 37 to bring it into a half-operation state (step ST11), the automatic focusing mechanism of the zoom lens 21 operates. This composition is determined, and the magnification at the end of automatic focusing is the “desired zoom magnification”.
FIG. 9 shows an example of the representative screen P (0) displayed on the monitor display panel 38.

In a general camera device, the shutter does not operate in this state (image is not taken), but in the camera device 2 of the present embodiment, the image sensor 22 captures an image with a desired zoom magnification to obtain a representative image (step ST12). ).
Next, it is determined whether the acquired number is a predetermined number (step ST13). The predetermined number of sheets is set in advance to, for example, two or more sheets to ten or more sheets. Initially, this determination is “No”, and the zoom magnification of the zoom lens 21 is changed in the next step ST14. The change width and change rule at this time are determined in advance. For example, the zoom magnification is initially changed in the enlargement direction (W direction) by a predetermined minimum zoom change width.
Thereafter, the process returns to step ST12, imaging is performed again, and the determination in step ST13 is performed.

In this manner, steps ST12 to ST14 are repeated until it is determined in step ST13 that the required number of images has been captured.
In this case, assuming that the required number is N, for example, it is possible to determine in advance that the magnification image in the W direction is captured i times and that the magnification image in the T direction is captured j (= N−i−1) times. it can. Alternatively, if the W direction is prioritized and a zoomed image is acquired on the W side as much as possible with a predetermined minimum zoom change width, and if the required number of images can be captured on the T side, that number is the T side. You may make it acquire the magnification image in. However, the above image acquisition method is merely an example, and other methods can be employed.
FIG. 10 shows the relationship between the representative screen P (0) and the zoomed image. Hereinafter, the scaled image is denoted by P (+ i, −j).

Step ST15 is sequentially executed every time imaging is performed in step ST12. In step ST15, the imaging signal from the imaging element 22 is encoded and converted into compressed data. When all the image data is prepared, conversion to file data F including the image data is performed. The file data F includes N pieces of image data and other attached information shown in FIG. A detailed example of the data structure of the file data F will be described in a second embodiment described later.
In step ST16, primary storage for writing file data F in the built-in memory 31 is performed under the control of the primary memory control circuit 29.

In step ST17, whether or not the shutter is fully operated is monitored. This step is continued until a predetermined time elapses after the half operation of the shutter.
When a full operation (for example, complete depression of the shutter button) is detected, in step ST18, the file data F is read from the built-in memory (primary memory) 31 and the secondary memory control is performed on the card-type memory 3 as the secondary memory. Write through circuit 30. On the other hand, if the full operation is not detected even after a predetermined time has elapsed and it is detected that the shutter has been returned, the file data F stored in the built-in memory 31 is discarded (erased).

Next, the display control process shown in step ST3 of FIG. 6 will be described with reference to the flowchart of FIG.
The display control process shown in FIG. 8 is controlled by the main processor 50 shown in FIG. 3 executing a predetermined program. At this time, a display device 6 is connected to the data storage device 4 via an HDMI cable.
The display control process controls the display magnification in the screen area 61 of the video content displayed on the screen area 61 of the display device 6 (for example, the effective screen area or OSD image of the display panel 62). Therefore, if remote control of the display magnification is performed on the data storage device 4 side, this is immediately reflected in the display magnification of the screen area 61 by the A / V control circuit 67 and the panel drive circuit 68 shown in FIG. Further, a display device 6 is configured. For example, the A / V control circuit 67 controls a video memory (not shown) that constantly holds the display contents of the screen area 61, and if the contents of the video memory are rewritten, the display of the screen area 61 is immediately performed with new storage contents. The content is configured to change.

The process of step ST8 shown in FIG. 8 (display control process) is started in the data storage device 4.
First, in step ST20, image data is input. Image data is input from the camera device 2 via the USB cable or the card type memory 3 as file data F, and is not the file data F from the camera device 2 but is reproduced from the built-in hard disk device 46 or disk 7. Alternatively, there is an input from another external device (such as a mobile phone) via a USB cable.
Whether the input image data is the file data F from the camera device 2 is detected in the next step ST21. Whether or not the file data is F can be determined by referring to an identifier (for example, a flag) in the file data F as shown in a second embodiment to be described later.

If it is not file data F, the process flow proceeds to step ST22A, where image display instruction control is performed. An image is displayed first, and a viewer may perform a zoom display operation as an optional step during the reproduction of video content (step ST23A). Specifically, the viewer operates the menu button (not shown) of the remote controller 41 to switch to the zoom mode, and presses the up / down key 41B stepwise to enlarge the image content in the screen area 61. Request.
Step ST24A constantly monitors the presence or absence of this zoom display operation from the beginning of image reproduction.

When there is a zoom display operation, in the next step ST25A, the data storage device 4 instructs the display device 6 to perform digital zoom processing, and the display device 6 is digitally controlled by the A / V control circuit 67 and the panel drive circuit 68. Execute zoom processing. Since this process simply zooms up the video content, the resolution is lowered.
After the instruction to execute the digital zoom process or when it is determined in step ST24A that there is no zoom display operation, it is determined that the image reproduction is finished (step ST26A). When this determination is “No”, a zoom display operation standby state is set. If it is determined in step ST26A that the process is to end, the display control process ends.

On the other hand, when the file data F is detected in step ST21, the processing flow proceeds to step ST22B.
In step ST22B, the representative screen P (0) is extracted from the file data F, and the image data is sent and displayed on the screen area 61 of the display device 6. An image display is first performed, and a zoom display operation may be performed by the viewer as an arbitrary step in the middle (step ST23B). Specifically, the viewer operates the menu button (not shown) of the remote controller 41 to switch to the zoom mode, and presses the up / down key 41B stepwise up or down in the screen area 61 of the image content. Request enlargement or reduction.
In step ST24B, the presence / absence of this zoom display operation is constantly monitored after the representative screen P (0) is first displayed.

If there is a zoom display operation, the data storage device 4 instructs the display device 6 to change the display magnification by image replacement in the next step ST25B, and the display device 6 controls the A / V control circuit 67 and the panel drive circuit 68. To perform image replacement. Specifically, when zoom-in is instructed, one zoom image corresponding to the operation amount is displayed from the zoom image P (+1),... P (+ i) on the W side shown in FIG. Select and replace the representative screen P (0). On the other hand, when zoom-down is instructed, one scaled image corresponding to the operation amount is selected from the scaled image P (-1),... P (-j) on the T side. Replace (0). Since these processes are replacements between images taken by the same image sensor 22, resolution reduction due to zoom-up does not occur. Further, when zooming down, it is possible to display an image showing the surrounding situation further from the desired representative screen P (0) acquired by the user using the camera device 2.
After the instruction to execute the display magnification change or when it is determined in step ST24B that there is no zoom display operation, it is determined that the image reproduction is finished (step ST26B). When this determination is “No”, a zoom display operation standby state is set. If it is determined in step ST26B that the process is ended, the display control process is ended.

  According to the image display system 1 of the present embodiment, it is possible to zoom up without a decrease in resolution, or to check the surrounding situation further than a desired image, so that it is possible to meet various requirements of the user with high quality.

<< Second Embodiment >>
FIG. 11 shows a front view (lens side surface) of the camera apparatus 2 according to the present embodiment.
The illustrated camera device 2 is provided with a plurality of zoom lenses, five in this example. This is for acquiring images having different photographing center positions as will be described later. Although the central zoom lens 21_0 is also provided in the first embodiment, four zoom lenses 21_1 to 21_4 are added thereto.

The block diagram shown in FIG. 2 can also be applied to this embodiment, but is different in that five optical photographing units 2A are provided corresponding to the five zoom lenses 21_0 to 21_4.
The other configuration in FIG. 2, the connection relationship between the devices in FIG. 1, and FIGS. 3 to 10 are also applied to this embodiment.
However, in step ST1 shown in FIG. 6, the five optical photographing units 2A simultaneously photograph the same subject with different photographing centers. At that time, each of the five optical imaging units 2A continuously captures N images shown in FIG. 12, and creates one file data F from each of N image data and a total of 5N image data (see FIG. 12). 7 step ST15). At this time, the consciousness of the photographer is recognized as having photographed one image with the central zoom lens 21_0, but a large amount of image data is acquired by automatic continuous photographing inside the camera device 2. The determination and control of secondary storage or discard are the same as the method shown in FIG. 7 of the first embodiment.

FIG. 12 schematically shows the data structure of the file data F. Although the data array is shown in three stages in the figure, the file data F is composed of one data array arranged in one column. Hereinafter, description will be made in order from the top of the data array.
An “optical zoom discrimination flag (fg)” is included at the beginning of the file data F. This is an identifier indicating that the data corresponds to optical zoom by image replacement.
The next “group name” can be arbitrarily set by the user and represents the name of the filed image group.
The next “position number” is automatically given as “5” when photographing with five lenses.
The next “position information X0” to “photo 34” in the third row are repetitions of image data and associated information. The first position information X0, Y0, the variable magnification V0, and the photograph 0 are data relating to the representative screen P (0) acquired by the zoom lens 21_0, for example. The position information X0 and Y0 represent the coordinates of the entire imaging center on the entire screen, the magnification V0 represents a variable corresponding to the optical zoom magnification, and the subsequent image data (photo 0) is centered on the coordinates (X0, Y0). This is image data taken with a zoom of a variable magnification V0. The data arrangement is repeated with this position coordinate, magnification information and image data as one unit. Here, N = 7 and up to the image data of the photograph 6 is the image data for the seven images taken by the zoom lens 21_0 and the accompanying information. The subsequent position coordinates X7 to the image data of the photograph 13 are the image data for the seven images taken by the zoom lens 21_1 and the accompanying information. From the subsequent position coordinate X14 to the image data of the photograph 20 is the image data for the seven images taken by the zoom lens 21_2 and its accompanying information. From the subsequent position coordinate X21 to the image data of the photograph 27 is the image data for the seven images taken by the zoom lens 21_3 and the accompanying information. From the subsequent position coordinate X28 to the image data of the photograph 34 is the image data for the seven images taken by the zoom lens 21_4 and its accompanying information.
An end flag (fe) indicating the end of the file data array is provided at the end.

After step ST2 shown in FIG. 6, the process shown in FIG. 8 is basically executed in the next step ST3.
In step ST21 shown in FIG. 8, the main processor 50 detects the presence of the file data F by detecting the leading optical zoom discrimination flag (fg) shown in FIG.
Thereafter, if there is file data F, optical zoom processing by image replacement is basically performed, and if the file data F is not detected, digital zoom processing itself is the same in this embodiment.

However, in this embodiment, the process of step ST24B can be controlled more finely.
Step ST24B shown in FIG. 8 is a simple replacement from the representative screen to the scaling screen. However, in this embodiment, the image replacement is performed and the image replacement is not performed as indicated by (*) in FIG. There is a flow for performing digital zoom.
As a premise, in step ST23B, the user can arbitrarily set the location of the zoom processing (zoom center position).

  Hereinafter, the arbitrary setting of the zoom center position by the user operation and the control procedure of the processing content according to the position will be described with reference to FIGS.

FIG. 13 shows a state in which the image desired by the photographer, that is, the representative screen P (0) photographed by the central zoom lens 21_0 in FIG. In step ST22B of FIG. 8, the photographer's desired image display is performed.
The image shown in FIG. 13 shows Mt. Fuji and two aircraft and a group of buildings.
In addition, five marks (star marks) M_0 to M_4 indicating the photographing center are displayed on the screen area 61 so as to overlap the image. Here, the center mark M_0 represents the photographing center of the zoom lens 21_0 shown in FIG. 11, and similarly, the other marks M_1 to M_4 represent the photographing centers of the zoom lenses 21_1 to 21_4, respectively.
Note that these five marks M_0 to M_4 are displayed on the monitor display panel 38 shown in FIG. 2 so as to overlap with the desired image even when the desired image is obtained. Therefore, the photographer can determine the composition so that the mark overlaps a subject to be zoomed in with high quality later. In this case, the subject selected by the photographer is Mt. Fuji in the center, an airplane flying over it, and a group of buildings.

When such a desired screen (representative screen of the entire file data F) is displayed on the display device 6, the viewer operates the remote controller 41 and sets the zoom mode in step ST23B of FIG. The zoom center position can be selected by operating the direction key 41A to arbitrarily move the cursor on the screen area 61 and pressing the enter key.
The next steps ST24B and ST25B shown in FIG. 8 are different in this embodiment.

FIG. 14 shows the processing contents executed in this embodiment in place of the next steps ST24B and ST25B shown in FIG.
In the first step ST30, the position selected by the viewer's cursor determination overlaps with the marks M_0 to M_4 shown in FIG. 13, or a predetermined range of several to several tens of pixels in each of the horizontal and vertical directions from each mark end. Determine if it is in.

If not, the process flow proceeds to the next step ST31.
FIG. 15A shows a case where an aircraft at a position away from the mark is selected as an example of this case.
In such a case, in the next step ST31 in FIG. 14, the execution of image data cutting is instructed centering on the selected position, and the center display is performed in the next step ST32. Then, the processing flow is interrupted before step ST24A in FIG.
Thereafter, when there is a zoom display operation (step ST24A), the screen is enlarged and displayed on the entire screen area 61 by digital zoom processing (step ST25A). At this time, the resolution is lowered due to the digital zoom. Thereafter, the process ends through step ST26A.

On the other hand, if it is determined in step ST30 of FIG. 14 that the selected position overlaps the mark (star) or is near the mark, the process flow proceeds to step ST34.
In step ST34, a group of consecutively captured image data (seven in this example) corresponding to the mark (star) is extracted from the file data F (step ST34), and the first representative screen P (0) in it is extracted. Is displayed in the center in the screen area 61 (step ST35). When an enlargement or reduction zoom operation in step ST36 is detected in this state, a single enlarged image is selected in accordance with the enlargement (zoom up) or reduction (zoom down) magnification, as in the first embodiment. Then, the representative screen P (0) is replaced with this, and optical zoom processing by image replacement is executed (see FIGS. 16A and 16B).
Thereafter, when it is determined that the process is ended in the determination of FIG. 8 (step ST26B), the process ends.

According to the present embodiment, as in the first embodiment, zoom-up without a decrease in resolution, or confirmation of the surrounding situation further than the desired image can be made, so it is possible to meet various user requirements with high quality. It becomes.
Further, even when the user can perform zooming around an arbitrary position, high-quality zooming is possible by acquiring a plurality of data groups for image replacement in advance.

Sometimes, a mark is displayed on the monitor screen at the time of imaging, so that a high-quality zoom point can be taken while taking a picture. Since there are many zoom locations on the screen, it is practical enough even when there are a limited number of zoom positions with such high image quality. In addition, because the surrounding situation that is not shown in the desired image is continuously shot in the background at each zoom location, the surrounding situation at the time of shooting at various locations in one screen is searched later. An image display system that provides viewers with an unprecedented new way of enjoying it is possible.
In particular, when the imaging method using the multi-lens of the second embodiment is applied to a surveillance camera and its display system, even if surveillance is overlooked from a high place, only a desired place can be enlarged with high quality later, It is possible to construct a convenient monitoring system that can be displayed when you want to know the situation.

It is a figure which shows the structure of the image display system in connection with 1st Embodiment. It is a block diagram of a camera apparatus. It is a block diagram of a data storage device. (A) is a front view of the data storage device 4, and (B) is a rear view. It is a block diagram of a display apparatus. It is the whole flowchart. It is a detailed flowchart of image data acquisition. It is a detailed flowchart of the display control process regarding 1st Embodiment. It is a rear view of the camera apparatus which shows the example of a representative screen currently displayed on the monitor. It is explanatory drawing of the several image image | photographed continuously. It is a front view of the camera apparatus in connection with 2nd Embodiment. It is explanatory drawing which shows the data structure of file data. It is a figure which shows the example of the representative image displayed on a display apparatus initially. It is a flowchart which shows the characteristic procedure of the process of 2nd Embodiment. (A) And (B) is explanatory drawing in the case of performing a digital zoom process in 2nd Embodiment. (A) And (B) is explanatory drawing in the case of performing an optical zoom process in 2nd Embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Image display system, 2 ... Camera apparatus, 2C ... Camera control part, 3 ... Card-type memory, 4 ... Data storage apparatus, 5 ... Display magnification control part, 6 ... Display apparatus, 21 ... Zoom lens, 22 ... Imaging element 31 ... Built-in memory, 32 ... Memory slot part, 36 ... Zoom operation part, 37 ... Shutter operation part, 38 ... Monitor display panel, 41 ... Remote controller, 50 ... Main processor, 61 ... Screen area, M ... Mark, P (0) ... Representative screen, zoomed image ... P (+ i, -j)

Claims (14)

A camera device;
A display device;
Based on an instruction from the outside, which is incorporated in the display device or in another electrical device connected to the display device, the video content is displayed on a screen area having a certain size of the display device. A display magnification control unit that performs control for changing the display magnification of
Have
The camera device is
An operation unit capable of shutter operation and zoom operation;
An optical photographing unit having an optical zoom function capable of increasing a photographing magnification by the zoom operation;
The optical photographing unit is controlled based on the shutter operation, and a representative image having a desired optical zoom magnification determined by the zoom operation and at least one scaled image having a magnification different from the desired optical zoom magnification are obtained. A camera control unit for acquiring a plurality of images including continuous shooting;
With
When there is no instruction, the display magnification control unit selects the representative image from the plurality of images sent from the camera device and displays the representative image on the screen area of the display device. Is an image display system that performs control to select one scaled image corresponding to the instruction from the plurality of images and to replace the representative image displayed in the screen area. The camera device is
A primary memory section;
A secondary memory section;
Further comprising
The camera control unit controls execution of continuous shooting for acquiring the plurality of images in response to a half operation of the shutter, stores the obtained plurality of image data in the primary memory unit, and then continuously The image display system according to claim 1, wherein when a full operation is detected, control is performed to read the plurality of obtained image data from the primary memory unit and record the read data in the secondary memory unit. The camera control unit discards the plurality of pieces of image data in the primary memory unit when the full operation is not performed even after a predetermined time has elapsed after detecting a half operation of the shutter. The image display system described. The camera control unit converts the data group of the plurality of images into one file data attached with an identifier indicating that the zoomed image is included, and executes control to send to the display magnification control unit,
The display device or the electrical device provided with the display magnification control unit is capable of inputting image data from other than the camera device, and a video processing unit that performs a zoom change of a video zoom display with respect to the image area by digital processing Have
The display magnification control unit tries to detect the presence / absence of the identifier with respect to the input image data, and if the identifier is detected, the display data is displayed on the image area as the file data from the camera device. The video according to claim 1, wherein the magnification change is executed by switching between the representative image and the scaled image, and when the identifier is not detected, the video processing unit is controlled to change the zoom magnification by digital processing. Display system. The image display system according to claim 1, wherein the camera device includes a plurality of the optical photographing units that are arranged so that photographing centers with respect to the same subject are different and are capable of simultaneous photographing. The image display system according to claim 5, wherein the camera device includes a captured image monitor unit capable of displaying a plurality of positions of the imaging centers corresponding to the plurality of optical imaging units. The camera control unit includes a plurality of image data groups acquired by simultaneous photographing of the plurality of optical imaging units, the position information of the imaging center of each image in the coordinates of the whole of the plurality of images attached. Performs control to convert to file data and send to the display magnification control unit,
The display magnification control unit, when displaying each image in the sent file data in the image area of the display device, a plurality of marks representing each imaging center position of the plurality of optical imaging units, The image display system according to claim 5, wherein the display is performed so as to overlap each image. The plurality of marks can be selected by a user operation,
When one mark is selected from the plurality of marks, the display magnification control unit converts one image data group acquired by one optical photographing unit corresponding to the selected mark to the plurality of image data. The image display system according to claim 7, wherein the image display system is selected from a group and used for image display on the display device. The display unit or the electrical device provided with the display magnification control unit can arbitrarily designate the screen center position for changing the display magnification of the video content with respect to the image area according to the cursor position by a user operation. A video processing unit that performs digital processing to change the zoom display magnification of the video with respect to the image area, with the screen center position as the center,
The display magnification control unit controls the video processing unit to execute zoom display by the digital processing when a position in the screen other than the mark is designated by the cursor, and the mark is designated by the cursor. 9. The display magnification change of the video content is controlled by selecting the image data group corresponding to the selected mark and switching between the representative image and the scaled image. Image display system. An operation unit capable of shutter operation and zoom operation;
An optical photographing unit having an optical zoom function capable of increasing a photographing magnification by the zoom operation;
The optical photographing unit is controlled based on the shutter operation, and a representative image having a desired optical zoom magnification determined by the zoom operation and at least one scaled image having a magnification different from the desired optical zoom magnification are obtained. A camera control unit that acquires a plurality of images including continuous imaging, and converts the data group of the plurality of images into one file data attached with an identifier indicating that the zoomed image is included;
A camera device. The camera device according to claim 10, wherein the camera device includes a plurality of the optical photographing units that are arranged so that photographing centers for the same subject are different and are capable of simultaneous photographing. A display processing device capable of changing a display magnification of video content for a screen area having a certain size in a built-in or external display unit,
The scaled image is added to a data group of a plurality of images obtained by continuously capturing a representative image acquired at a desired optical zoom magnification for the same subject and at least one scaled image having a different optical zoom magnification. An image input unit capable of inputting file data created by attaching an identifier indicating inclusion, and image data not including the identifier;
A video processing unit capable of changing the zoom magnification of the input image by digital processing for the image area;
Attempts to detect the presence or absence of the identifier with respect to the image data input to the image input unit, and if the identifier is detected, assuming that the file data is the change in magnification of the video content for the image area, A display magnification control unit that executes by switching to the scaled image and controls the video processing unit when the identifier is not detected, and performs zoom magnification change by digital processing;
A display processing apparatus. A method for changing the display magnification of video content for changing the display magnification of video content for a screen area having a certain size based on an instruction from the outside,
Shooting in which a plurality of images including at least one zoomed image obtained by changing the magnification from the desired optical zoom magnification in addition to the representative image obtained for the same subject at the desired optical zoom magnification are continuously captured. Steps,
When the instruction is not given, the representative image is selected from the plurality of images and displayed on the screen area. When the instruction is given, one of the plurality of scaled images corresponding to the instruction is displayed. A display control step of replacing the representative image displayed in the screen area by selecting from the image of
Display magnification change method including. A method for changing the display magnification of video content for changing the display magnification of video content for a screen area having a certain size based on an instruction from the outside,
The scaled image is added to a data group of a plurality of images obtained by continuously capturing a representative image acquired at a desired optical zoom magnification for the same subject and at least one scaled image having a different optical zoom magnification. An image input step capable of inputting file data created by attaching an identifier indicating inclusion, and image data not including the identifier;
Attempts to detect the presence or absence of the identifier with respect to the input image data, and if the identifier is detected, the file content is changed, and the magnification change of the video content with respect to the image area is changed to the representative image and the scaled image. And when the identifier is not detected, a display control step for performing zoom magnification change for the image area by digitally changing the zoom magnification of the input image; and
Display magnification change method including.

Images