JP2024043561A - How to extract the image of the subject (CROPKEY) - Google Patents

Abstract

[Problem] To provide a method for deleting unnecessary images when acquiring images and obtaining the required image information. [Solution] For each image element of an image element unit of a television camera 14 that acquires images, the image signal of the image element in which the subject appears is sorted based on the measured distance from the subject 8-11 that appears in the image element, and only the image of the entire subject is extracted, thereby deleting unnecessary images and transmitting the image information of the subject. [Selected Figure] Figure 4

Description

A method of extracting images at measured distances as an alternative to the chromakey composition method, which extracts images from the screen shot by a TV camera.

A method based on image recognition from a TV camera and distance measurement using a TOF TV camera, etc.

Patent No. 5508308 Patent No. 5547605 Patent No. 5547670 Patent No. 6719494 Patent No. 7133520

JP2018-119942
Patent application 2018-174323

Patent application 2022-071338
Patent application 2022-133131

Extract images of the subject from the screen captured by television cameras and digital cameras.

Reflection by several measurement elements or several LED light emitting elements for measurement installed at the position of several image elements where the real image of the subject is reflected in the image element unit of the television camera and digital camera. Based on the time difference in light measurement, the image signals at the positions of several image elements where the real image of the subject is reflected are sorted, and the image of the subject is extracted.

In a society where smartphones and remote work are widely used and image information is circulating, this is a method of removing unnecessary information attached to image information in order to prevent information from being lost from images.

Prevent information leakage from images, reduce image data

An explanatory diagram showing the relationship between the position of the surface of the 3 image sensor unit on which the image of a subject photographed by a television camera or digital camera is captured through 2 optical lenses and the 52 distance from the subject. An explanatory diagram showing five images of one subject and the background screen at different distances on the surface of a three-image element unit. An explanatory diagram in which the reflected light from 1 the subject passes through 2 optical lenses and 7 spectrometers, and infrared light for measurement is projected onto 6 TOF photographic element units to measure distance. The reflected light emitted by the 13 infrared emitter for measurement was photographed using the 14 color pixel/TOF pixel television camera to capture the photographic range of the 12 television camera, and the subjects 8, 9, 10, and 11 were A, B, C, and D. An explanatory diagram showing 20 images of 9 subjects sorted by measurement distance from the 19 TV camera monitor screens that are captured and displayed on the TV camera monitor screen. The positions of the image signals of 8, 9, 10, and 11 subjects A, B, C, and D captured by the 14 color pixel/TOF pixel television camera are 21, 22 on the time axis where the distance was measured by the 6 TOF imaging element units. , 23, 24 This is an explanatory diagram showing the reflection time of reflected light, and extracts an image of 22 subject B at a time between 25 hours T-1 and 26 hours T-2. 29 Image signals of 8, 9, 10, and 11 subjects A, B, C, and D reflected on the TOF image element unit are transmitted for 34, 35, 36, and 37 hours T-3, T-4, T-5, and T, respectively. An explanatory diagram for sorting and extracting images of objects using time signals in the -6 range. FIG. 3 is an explanatory diagram of sorting image signals of image elements based on the time measured by a measurement element located at the same position as an image element that captures one object in a 38-pixel measurement unit that captures an image of one object. Explanation of sorting the image signals of image elements based on the time of measuring the reflected light from one object, which is emitted by a light emitting element in the same position as the image element photographing one object in a 51-pixel light emitting unit that takes an image of one object. figure. 12 The 39-pixel light-emitting TV camera photographs subjects 8, 9, 10, 11 subjects A, B, C, and D in the TV camera shooting range.The 45 infrared receiver detects the reflected light from the subjects from the 19 TV camera monitor screen. An explanatory diagram showing 20 selected images of 9 subjects sorted by measured time and displayed on the TV camera monitor screen. 12 The 40-pixel measurement TV camera photographed subjects 8, 9, 10, 11 subjects A, B, C, and D in the TV camera shooting range.The reflected light from the 13 infrared emitter is reflected from the 19 TV camera monitor screen. An explanatory diagram showing 20 selected images of 9 subjects sorted by the measurement time of the photographed position and displayed on the TV camera monitor screen. 41 The TV camera captures 8, 9, 10, 11 subjects A, B, C, D in the 12 TV camera shooting range, and the 43 tracking TV camera captures and detects the image signals of the subjects, 42 Laser distance measurement An explanatory diagram in which 20 images of 9 subjects are extracted and displayed on the TV camera monitor screen, sorted by distance and time from the subject measured by the camera. From the 19 TV camera monitor screen, which is taken of 8, 9, 10, and 11 subjects A, B, C, and D within the 12 television camera shooting range by 41 television camera, and measured by 44 scanner laser distance measuring device, 8, 9, 10, and 11 subjects A, B, C, and D are extracted from the 30, 31, 32, and 33 image screens of subjects A, B, C, and D on the 19 television camera monitor screen, and the image of subject B on the 31 image television camera monitor screen is extracted.

Explanation of matters to be stated Regarding this application, the patents for this application include Patent No. 5547670, Patent No. 5547605, Patent No. 5508308, Patent No. 6719494, and Patent No. This invention is derived from No. 7133520, patent application 2018-174323, and patent application 2022-71338.
The invention is a method of measuring the distance to a subject reflected in an image element, which is recognized as an image on a television camera monitor screen, using a measurement element or a measurement light-emitting element provided at the position of the image element.
Therefore, this invention sorts all the image signals of the images of the object by measuring the distances of the positions of all the image elements of the images in which the object is recognized on the television camera monitor screen.

FIG. 1 is an explanatory diagram showing an image of an object photographed by a television camera, the image of the object being projected onto an image sensor unit of the television camera through the optical lens mechanism of the television camera.
An image of the subject is projected as a real image on the surface of the image element unit, and light of the image at each position of the subject is converted into an image signal by each image element constituting the image element unit.
Each position of the image signal is associated with 52 distances.

Example Figure 2 shows how to measure the distance to the subject of the image that appears at all image element positions on the surface of the three image element unit, and use the measured distance value of the image element position where the subject appears to identify the subject. By sorting the image signals of the image elements that appear in the image, it is possible to extract the image in which the subject is captured.

Example Figure 3 shows an object photographed with a television camera, which is separated into natural light for the television camera and infrared light for distance measurement through the seven optical lens mechanisms and seven spectrometers of the television camera. , the natural light is transferred to 3 image element units and the infrared light is transferred to 6 TOF image pickup element units to capture an image of one subject.
The image signal of the image element at the position of the image of one object of the 3 image element unit through the mechanism of 7 optical lenses, and the image signal of the image element of the image of 1 object of the 6 TOF photographing element unit through the mechanism of the same 7 optical lenses. By sorting by the time signal of the distance measured by the TOF imaging element at the position, it is possible to extract the image of one subject by sorting only the image signal of the image element at the position of the image of one subject in the three image element unit. .

Example Figure 4 shows that 8, 9, 10, and 11 subjects in the 12 TV camera shooting range are photographed by a 14 color pixel/TOF pixel TV camera, and the reflected light for measurement from 13 infrared light emitter is measured from each subject on 19 TV camera monitor screen. The subjects on the TV camera monitor screen can be sorted by sampling 20 values based on the time measured at the positions of 8, 9, 10, and 11 subjects on the 14 color pixel/TOF pixel TV camera.

Example Figure 5 shows the image signals of the image element, which were photographed by a 14 color pixel/TOF pixel television camera, of subjects 8, 9, 10, and 11 in the photographic range of 12 television cameras, and the distance from the subject photographed by the image element. It is displayed on the light reception time axis of the measured reflected light for measurement, and indicates the time position of the image signal of the image element of the subject.
By dividing the image signals of 22 subjects B into 25 T-1 hours and 26 T-2 hours, it is possible to extract only the image signals of 22 subjects B.

Example Figure 6 shows images 30, 31, 32, and 33 images A, B, C, and D that appear on the surface of the 29 TOF image element unit. Images of each subject can be extracted from the screen shot by the TV camera in the 4, T-5, and T-6 time ranges.

Embodiment FIG. 7 shows an example in which a measuring element for measuring reflected light for measurement is provided at the position of the image element of the image element unit of a television camera, and the distance to the subject reflected on the image element is measured. Images of the subject can be sorted using the measurement signals of the measurement elements at the same position.

Embodiment FIG. 8 shows an example in which an infrared light emitting element for measurement is provided at the position of the image element of the image element unit of a television camera, and the distance to the subject reflected in the image element is measured. Images of the subject can be sorted using the measurement signals of the light emitting elements at the same position.

Example Figure 9 shows how a light-emitting element that emits infrared light for measurement is provided at the position of the image element of the image element unit of the television camera, and the reflected light of the emitted infrared light from the subject is sorted by the time measured by an infrared receiver 45, making it possible to extract 20 television camera monitor screens from 19 television camera monitor screens.

Example Figure 10 shows how the infrared light emitted by the 13 infrared light emitters is reflected from the subject through the optical lens of the 40 pixel measurement television camera, and the 38 image measurement element installed in the 40 pixel measurement television camera is used. Using the time measured by the measurement element of the unit, 20 sampled TV camera monitor screens are extracted from 19 TV camera monitor screens by sorting the image signals of the image elements at the same position of the measurement element of the 38 image measurement element unit. be able to.

Example Figure 11 shows images of objects 8, 9, 10, and 11 that have been recognized as images, A, B, C, and D, which are tracked and photographed using a tracking TV camera 42, on a screen shot in the shooting range of 12 TV cameras using a TV camera 41. , 8, 9, 10, 11 Photographed objects A, B, C, D, and recognized the image signals. 8, 9, 10, 11 Subjects A, B, C, D. 42 Laser distance measurement The distance is tracked and measured by the machine, the measured distance is used to sort the image signals, and 20 sampled television camera monitor screens can be extracted from the 19 television camera monitor screens.

Example Figure 12 shows the shooting range of 12 TV cameras, 44 scanner laser distance measuring device, and the measured positions of subjects A, B, C, D, 41 TV cameras. By aligning with the positions of 8, 9, 10, 11 subjects A, B, C, D taken by the camera, 8, 9, 10, 11 subjects A, B, C measured by the 44 scanner laser distance measuring device. , D can be used to sort the subject on the 19 TV camera monitor screen photographed by the 41 TV camera, and extract 20 sample TV camera monitor screens from the 19 TV camera monitor screen.

TV camera for smartphones, TV camera for telework, image processing, real images for metaverse, security images

1 subject
2 optical lenses
3 image element unit
4 reflected light
5 image subject
6 TOF imaging element unit
7 spectrometer
8Subject A
9Subject B
10 Subject C
11 Subject D
12 TV camera shooting range
13 Infrared light emitter
14 color pixels/TOF/pixel TV camera
15 controller
16 console
17 computer
18 image controller
19 TV camera monitor screen
20 Sampling TV camera monitor screen
21 Image signal of subject A
22 Image signal of subject B
23 Image signal of subject C
24 Image signal of subject D
25 T-1 hour
26 T-2 hours
27 time axis
28 reflected light
29TOF image element unit
30 image subject A
31 image subject B
32 image subject C
33 image subject D
34 T-3 hour range
35 T-4 hour range
36 T-5 hour range
37 T-6 hour range
38 image measurement element unit
39 images luminous television camera
40 image measurement TV camera
41 tv camera
42 laser distance measuring machine
43 Tracking TV camera
44 Scanner Laser Distance Measuring Machine
45 Infrared light receiver
46 distance signal
47 drive signal
48 position signal
49 image signal
50 distance range signal
51 image light emitting element unit
52 distance

Claims (3)

A method characterized by extracting an image of a subject on a screen taken by either a television camera or a digital camera using a value obtained by measuring the distance to the subject. 2. The method according to claim 1, wherein the image of the subject is an image detected on the screen. A method according to any of claims 1 and 2, characterized in that the numerical value is a preset numerical value.

Images