WO2017110192A1 - 情報処理装置、情報処理方法、プログラムおよび情報処理システム - Google Patents
情報処理装置、情報処理方法、プログラムおよび情報処理システム Download PDFInfo
- Publication number
- WO2017110192A1 WO2017110192A1 PCT/JP2016/078812 JP2016078812W WO2017110192A1 WO 2017110192 A1 WO2017110192 A1 WO 2017110192A1 JP 2016078812 W JP2016078812 W JP 2016078812W WO 2017110192 A1 WO2017110192 A1 WO 2017110192A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image quality
- cameras
- adjustment value
- information processing
- value
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
- H04N23/662—Transmitting camera control signals through networks, e.g. control via the Internet by using master/slave camera arrangements for affecting the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B43/00—Testing correct operation of photographic apparatus or parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30168—Image quality inspection
Definitions
- the present disclosure relates to an information processing apparatus, an information processing method, a program, and an information processing system.
- the second image quality adjustment value of each of the plurality of cameras based on the first image quality adjustment value of each of the plurality of cameras and the reliability of each of the plurality of cameras acquired from the plurality of cameras.
- An information processing apparatus including an adjustment value determination unit that determines
- the second image quality adjustment value of each of the plurality of cameras based on the first image quality adjustment value of each of the plurality of cameras and the reliability of each of the plurality of cameras acquired from the plurality of cameras.
- the computer is configured to determine the second image quality of each of the plurality of cameras based on the first image quality adjustment value of each of the plurality of cameras acquired from the plurality of cameras and the reliability of each of the plurality of cameras.
- a program for causing an information processing apparatus to function is provided, which includes an adjustment value determination unit that determines an image quality adjustment value.
- An information processing system includes an information processing apparatus including an adjustment value determination unit that determines a second image quality adjustment value.
- FIG. 3 is a block diagram illustrating a functional configuration example of an information processing device according to a first embodiment of the present disclosure.
- FIG. It is a figure which shows the example of the relationship between the reliability of each of several cameras, the image quality adjustment value before adjustment, and the image quality adjustment value after adjustment.
- FIG. It is a block diagram showing an example of functional composition of an information processor concerning a 2nd embodiment of this indication.
- FIG. 3 is a block diagram illustrating a hardware configuration example of an information processing apparatus according to an embodiment of the present disclosure.
- a plurality of constituent elements having substantially the same functional configuration may be distinguished by adding different numerals after the same reference numerals. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given.
- a method of adjusting image quality of each of a plurality of cameras manually by a user is known. That is, in the first method, when the user manually adjusts the image quality of each of the plurality of cameras while visually confirming the images taken by each of the plurality of cameras, the image quality adjustment value is used as a fixed value.
- the image quality of each of the plurality of cameras is reduced. It fluctuates and the quality of the image decreases.
- FIG. 1 is a diagram illustrating a configuration example of an information processing system according to an embodiment of the present disclosure.
- an information processing system 1 includes an information processing apparatus 10 and cameras 20-1 to 20-N (where N is an integer of 2 or more).
- the cameras 20-1 to 20-N image the same subject Bj.
- images of the same subject Bj captured from a plurality of different positions are obtained.
- the subject Bj is a person, but the subject Bj may be an object other than a person.
- the information processing apparatus 10 and the cameras 20-1 to 20-N can communicate via a network (not shown).
- the information processing apparatus 10 determines the image quality adjustment value of the camera 20-1 from the camera 20-1 via a network (not shown) (first image quality adjustment value, hereinafter referred to as “adjusted image quality adjustment value”).
- the image quality adjustment value after adjustment (second image quality adjustment value) is obtained by obtaining the image quality adjustment value.
- the information processing apparatus 10 transmits the adjusted image quality adjustment value to the camera 20-1, thereby performing image quality adjustment using the adjusted image quality adjustment value.
- image quality adjustment is performed by the same procedure as the camera 20-1.
- the information processing apparatus 10 exists outside the cameras 20-1 to 20-N. However, the information processing apparatus 10 is a part of the cameras 20-1 to 20-N or It may exist in the whole. In the example illustrated in FIG. 1, the information processing apparatus 10 is a notebook PC (Personal Computer), but the information processing apparatus 10 is not limited to a notebook PC.
- the information processing apparatus 10 may be a smartphone, a mobile phone, a tablet terminal, or a game machine.
- FIG. 2 is a block diagram illustrating a functional configuration example of the camera 20-1 according to the present embodiment.
- the camera 20-1 includes a lens 210, an aperture 220, an imager 230, a lens / aperture control device 240, a preprocessing unit 250, a detection unit 260, an adjustment value calculation lens control unit 271, and an adjustment value selection.
- the lens 210 is an optical element for refracting and focusing light.
- the diaphragm 220 is a mechanism that adjusts the amount of light entering the lens 210.
- the imager 230 is a semiconductor element that converts the light focused by the lens 210 into an electrical signal.
- the imager 230 may be a CCD (Charge Coupled Device) or a COMS (Complementary Metal Oxide Semiconductor).
- Lens 210 and aperture 220 can affect the resolution of the image.
- the pre-processing unit 250 performs a process of reducing manufacturing variation that occurs between an image captured by the camera and an image captured by another camera. For example, the preprocessing unit 250 adjusts the image output from the imager 230 based on the measurement result of the image quality (for example, the brightness and color of the image) of the imager 230 under a predetermined condition.
- the detection unit 260 performs detection from the imaging result output from the preprocessing unit 250.
- the adjustment value calculation lens control unit 271 calculates an image quality adjustment value before adjustment based on the detection value output from the detection unit 260. Then, the adjustment value calculation lens control unit 271 provides the information processing apparatus 10 with the image quality adjustment value before adjustment and the detection value obtained by the detection performed by the detection unit 260 via a network (not shown). When the information processing apparatus 10 receives the image quality adjustment value and the detection value before adjustment, the information processing apparatus 10 calculates the image quality adjustment value after adjustment based on the received image quality adjustment value and detection value before adjustment. The calculation of the image quality adjustment value after adjustment will be described in detail later.
- the adjustment value calculation lens control unit 271 acquires the adjusted image quality adjustment value from the information processing apparatus 10.
- the adjustment value calculation lens control unit 271 outputs the adjusted image quality adjustment value to the adjustment value selection unit 272.
- the adjustment value calculation lens control unit 271 outputs the adjusted image quality adjustment value to the adjustment value selection unit 273.
- the adjustment value selection unit 272 selects either the adjustment value calculated by the adjustment value calculation lens control unit 271 or the adjusted image quality adjustment value received from the information processing apparatus 10. Then, the adjustment value selection unit 272 outputs the selection result to the lens / aperture control device 240.
- the lens / aperture control device 240 controls the lens 210 or the aperture 220 based on the selection result output from the adjustment value selection unit 272.
- the control of the lens 210 or the diaphragm 220 may be included in the image quality adjustment.
- the adjustment value selection unit 273 selects either the adjustment value calculated by the adjustment value calculation lens control unit 271 or the adjusted image quality adjustment value received from the information processing apparatus 10. Then, the adjustment value selection unit 272 outputs the selection result to the image quality adjustment unit 274.
- the image quality adjustment unit 274 performs image quality adjustment on the image output from the preprocessing unit 250 based on the selection result output from the adjustment value selection unit 273. When the image quality is adjusted, the image quality is directly adjusted.
- the post-processing unit 280 adjusts the size of the image output to the recording / display unit 290 located at the subsequent stage of the post-processing unit 280. Further, the post-processing unit 280 performs recording encoding on the image output to the recording / display unit 290 located at the subsequent stage of the post-processing unit 280.
- the recording / display unit 290 records the image output from the post-processing unit 280 in a storage unit (not shown) or displays it on a display unit (not shown).
- FIG. 3 is a diagram illustrating an example of image quality adjustment. As illustrated in FIG. 3, in the embodiment of the present disclosure, color, brightness, resolution, noise (or texture), and the like are handled as image quality elements. As an image quality adjustment term for adjusting the image quality element “color”, white balance and matrix calculation are assumed.
- an image quality adjustment term for adjusting the image quality element “brightness” an aperture, ISO sensitivity, gamma correction, knee correction, and the like are assumed.
- an image quality adjustment term for adjusting the image quality element “resolution” an aperture and edge enhancement are assumed.
- Noise reduction or the like is assumed as an image quality adjustment term for adjusting the image quality element “noise / texture”.
- the image quality adjustment value before correction may include a value related to at least one of white balance, matrix calculation, aperture, gain, gamma correction, knee correction, contour enhancement, and noise reduction of an image captured by the camera.
- the adjusted image quality adjustment value may include a value related to at least one of white balance, matrix calculation, aperture, gain, gamma correction, knee correction, contour enhancement, and noise reduction of an image captured by the camera.
- the image quality adjustment types include image quality adjustment types according to temporal changes in the imaging area, image quality adjustment types according to user instructions, and the like. Is assumed. In the present specification, the former is sometimes referred to as dynamic image quality adjustment (described as “motion” in FIG. 3), and the latter is referred to as static image quality adjustment (described as “static” in FIG. 3). .
- the correspondence relationship between the image quality adjustment term and the image quality adjustment type (dynamic / static) shown in FIG. 3 is merely an example, and the image quality adjustment term and the image quality adjustment type (dynamic / static) The correspondence relationship is not limited to the example shown in FIG.
- the adjustment value determining unit 130A (FIG. 4) adjusts the image quality after adjustment of each of the plurality of cameras based on the image quality adjustment value before adjustment of each of the plurality of cameras and the reliability of each of the plurality of cameras. Determine the value. Thereby, it is possible to improve the accuracy of image quality adjustment of each of the plurality of cameras.
- the image quality adjustment of each image quality adjustment term (for example, determination of the reliability of each of the plurality of cameras, the threshold value to be compared with the reliability, and the adjusted image quality adjustment value according to the comparison result) Etc.) can be classified into several patterns and made for each pattern.
- the correspondence relationship between the image quality adjustment term and the pattern shown in FIG. 3 is merely an example, and the correspondence relationship between the image quality adjustment term and the pattern is not limited to the example shown in FIG.
- FIG. 4 is a block diagram illustrating a functional configuration example of the information processing apparatus according to the first embodiment of the present disclosure.
- the information processing apparatus 10A according to the first embodiment of the present disclosure includes a data acquisition unit 110A, a reliability acquisition unit 120, and an adjustment value determination unit 130A.
- the information processing apparatus 10A is connected to the cameras 20-1 to 20-N via a network (not shown).
- the static image quality adjustment is an image quality adjustment that reflects the user's will more strongly than when the image quality adjustment is automatically performed by the camera. Therefore, it is natural for the user that the image quality adjustment value after adjustment of each of the cameras 20-1 to 20-N is set to the image quality adjustment value of the camera (reference camera) having the reliability “high” selected by the user. is there. Therefore, in the static image quality adjustment, the image quality adjustment value of another camera is matched with the image quality adjustment value of the camera having the reliability “high”.
- the data acquisition unit 110A acquires images from the cameras 20-1 to 20-N. Further, the reliability acquisition unit 120 acquires the reliability of each of the cameras 20-1 to 20-N. For example, the reliability acquisition unit 120 acquires the reliability of each of the cameras 20-1 to 20-N designated by the user.
- the adjustment value determination unit 130A determines the image quality adjustment value before adjustment of the camera with the highest reliability as the image quality adjustment value after adjustment of each of the cameras 20-1 to 20-N.
- FIG. 5 is a diagram showing an example of the relationship between the reliability of each of the cameras 20-1 to 20-N, the image quality adjustment value before adjustment, and the image quality adjustment value after adjustment.
- “high” is designated by the user as the reliability of the camera 20-1
- “low” is designated by the user as the reliability of each of the cameras 20-2 to 20-N. Therefore, as shown in FIG. 5, the adjustment value determination unit 130A sets the image quality adjustment values after adjustment of the cameras 20-2 to 20-N as the image quality adjustment values before adjustment of the camera 20-1 having the highest reliability. decide.
- the image quality adjustment values after adjustment of the cameras 20-1 to 20-N determined by the adjustment value determination unit 130A are transmitted to the cameras 20-1 to 20-N, respectively.
- image quality adjustment is performed based on the adjusted image quality adjustment value received from the information processing apparatus 10A. Accordingly, the image quality adjustment values of the cameras 20-1 to 20-N are set to the image quality adjustment values of the camera 20-1, so that the accuracy of the image quality adjustment of each of the cameras 20-1 to 20-N is improved.
- FIG. 6 is a block diagram illustrating a functional configuration example of the information processing apparatus according to the second embodiment of the present disclosure.
- the information processing apparatus 10B according to the second embodiment of the present disclosure includes a data acquisition unit 110B, a reliability calculation unit 140, and an adjustment value determination unit 130B.
- the information processing apparatus 10B is connected to the cameras 20-1 to 20-N via a network (not shown).
- the data acquisition unit 110B acquires either or both of the image and the detection value from each of the cameras 20-1 to 20-N. Further, the reliability calculation unit 140 calculates the reliability of each of the cameras 20-1 to 20-N. For example, the reliability calculation unit 140 calculates the reliability of the camera 20-1 based on the image quality adjustment value before adjustment of the camera 20-1. Similarly, the reliability calculation unit 140 calculates the reliability of the cameras 20-2 to 20-N.
- the method for calculating the reliability is not particularly limited.
- the reliability calculation unit 140 may calculate a difference value between an image quality adjustment value before adjustment and a predetermined reference adjustment value as reliability for each camera. In this case, the closer to the reference adjustment value, the higher the reliability, but the smaller the reliability value.
- the reference adjustment value is not particularly limited.
- the reference adjustment value is also referred to as one or a plurality of cameras (hereinafter referred to as “cameras other than the own camera”) excluding the cameras 20-1 to 20-N that use the reference adjustment value for calculation of reliability. ) May be a predetermined representative value.
- the representative value is not particularly limited.
- the representative value may be an intermediate value, an average value, a minimum value, or a maximum value regarding cameras other than the own camera among the cameras 20-1 to 20-N.
- the representative value may be an intermediate value, an average value, a minimum value, or a maximum value regarding the cameras 20-1 to 20-N.
- the adjustment value determination unit 130B determines the image quality adjustment value after adjustment of the camera 20-1 based on the reliability of the camera 20-1. More specifically, the adjustment value determination unit 130B determines the adjusted image quality adjustment value as the reference adjustment value when the reliability exceeds a predetermined threshold (Thresh). On the other hand, when the difference value does not exceed the threshold value (Thresh), the adjustment value determination unit 130B determines the image quality adjustment value after adjustment as the image quality adjustment value before adjustment. Similarly, the adjustment value determining unit 130B determines the image quality adjustment value after adjustment of each of the cameras 20-1 to 20-N.
- the image quality adjustment values after adjustment of the cameras 20-1 to 20-N determined by the adjustment value determination unit 130B are transmitted to the cameras 20-1 to 20-N, respectively.
- image quality adjustment is performed based on the adjusted image quality adjustment value received from the information processing apparatus 10B. Accordingly, the image quality adjustment values of the cameras 20-1 to 20-N are set to the image quality adjustment values of the camera 20-1, so that the accuracy of the image quality adjustment of each of the cameras 20-1 to 20-N is improved.
- FIG. 7 is a flowchart showing a flow of an operation for determining an adjusted image quality adjustment value when white balance is performed as an image quality adjustment term (when coefficient adjustment of a polynomial function is performed as an image quality adjustment pattern).
- W r , W g and W b are gains (image quality adjustment values) determined by image detection.
- C r , C g and C b are offsets determined by image detection.
- ⁇ r , ⁇ g and ⁇ b are correction gains due to manufacturing variations, and
- ⁇ r , ⁇ g and ⁇ b are correction offsets due to manufacturing variations.
- r, g and b are signal values detected in the imager.
- R, G, and B are signal values after white balance is achieved.
- 1 is set to the variable i at the start of the repetition processing of S1 to S17.
- a continuation condition for the iterative process that i is N or less is set.
- a termination process for repeating the process of incrementing i by 1 is set (S11).
- the image quality adjustment vector W i is set to (W ri , W gi , W bi ) (S12), and the vector W ave indicating the average value for cameras other than the own camera is set to (W ri_ave , W gi_ave , W bi_ave ) ( S13).
- the reliability calculation unit 140 sets the variable conf i to 1 when the difference value between the image quality adjustment vector W i and the vector W ave is equal to or less than the threshold value, and sets the variable conf i to 1 when the difference value exceeds the threshold value.
- conf i is set to 0 (S14).
- adjustment value determination unit 130B shifts the operation to S17.
- the adjustment value determining unit 130B updates the image quality adjustment vector Wi with the vector W ave (S16), and performs the operation in S17. Transition.
- FIG. 8 is a diagram illustrating an example of a correspondence relationship between the reliability determination result (conf i ) and the image quality adjustment vectors W i (W r , W g, and W b ) before and after the adjustment.
- a difference value between the image quality adjustment vector W i and the vector W ave is the threshold value or less
- i if is 1, the judgment result (conf 1) is for a 1, the image quality adjustment vector W i is not changed before and after the adjustment.
- the determination result (conf 2 ) is 0 (because the difference value between the image quality adjustment vector W i and the vector W ave exceeds the threshold value)
- the image quality adjustment vector W i. Is updated to the vector W ave .
- FIG. 9 is a flowchart showing a flow of an operation for determining an image quality adjustment value after adjustment when updating the matrix operation as the image quality adjustment term (when performing the matrix operation as the image quality adjustment pattern).
- the reliability S ij may be calculated by Then, the adjustment value determination unit 130B extracts the smallest j in each column from the reliability S ij , obtains the largest j value from the extraction result as k , and gives the adjusted image quality adjustment value for M k A matrix may be used.
- 1 is set to the variable i at the start of the repetition processing of S21 to S27.
- a continuation condition for the iterative process that i is N or less is set.
- a termination process for repeating the process of incrementing i by 1 is set (S21).
- 1 is set to the variable j at the start of the repetition processing of S22 to S26.
- a repetitive processing continuation condition that j is N or less is set.
- a termination process for repeating the process of incrementing j by 1 is set (S22).
- the adjustment value determining unit 130B increments C j by 1 (S25), and the operation proceeds to S26.
- the adjustment value determination section 130B acquires the maximum value between the C 1 to C N as k (S28). Then, Y, U, and V, which are signal values after the matrix operation is updated, are obtained from the matrix Mk (S29). Since this matrix M k is applied to all of the cameras 20-1 to 20-N, it is transmitted from the information processing apparatus 10B to all of the cameras 20-1 to 20-N, and the cameras 20-1 to 20-N are transmitted. All of N are used for image quality adjustment.
- FIG. 10 and FIG. 11 are flowcharts showing the flow of the operation (modification example) for determining the adjusted image quality adjustment value when updating the matrix operation as the image quality adjustment term (when performing the matrix operation as the image quality adjustment pattern). is there.
- the operations from S21 to S27 are executed in the same manner as the operations from S21 to S27 shown in FIG.
- the maximum value k between from C 1 to C N is acquired as H (S28). Subsequently, 1 is set to the variable i at the start of the repetition processing of S31 to S36. In addition, a continuation condition for the iterative process that i is N or less is set. In addition, a termination process for repeating the process of incrementing i by 1 is set (S31).
- the value obtained by summing the difference values of the multiplication results with e 7 (1,1,1) ⁇ 1/3 etc.) from 1 to N is calculated as the reliability SiH (S32).
- the reliability calculation unit 140 sets 1 to the variable conf i when the reliability S iH is less than or equal to the threshold, and sets 0 to the variable conf i when the reliability S iH exceeds the threshold. (S33).
- adjustment value determination unit 130B shifts the operation to S36.
- adjustment value determining unit 130B updates matrix M i with matrix MH (S35), and shifts the operation to S36. .
- FIG. 12 is a flowchart showing a flow of an operation for determining an adjusted image quality adjustment value when performing gamma correction as an image quality adjustment term (when performing image quality adjustment using an exponential function as an image quality adjustment pattern).
- y represents the luminance among the signal values detected by the imager.
- ⁇ is an image quality adjustment value for adjusting the luminance.
- the function f is a function for outputting the changed luminance using the luminance y and the image quality adjustment value ⁇ as input values.
- the reliability calculation unit 140 calculates the integration value for the difference value between the functions f for all combinations of the functions f, thereby increasing the reliability. S ij may be calculated.
- the adjustment value determining unit 130B extracts the smallest j in each column from the reliability S ij , obtains the largest j value from the extraction result as k , and gives f k the adjusted image quality adjustment value. It can be a function.
- 1 is set to the variable i at the start of the repetition process of S41 to S47.
- a continuation condition for the iterative process that i is N or less is set.
- a termination process for repeating the process of incrementing i by 1 is set (S41).
- 1 is set to the variable j at the start of the repetitive processing of S42 to S46.
- a repetitive processing continuation condition that j is N or less is set.
- a termination process for repeating the process of incrementing j by 1 is set (S42).
- the reliability calculation unit 140 calculates an integral value for the difference value between the function f i and the function f j as the reliability S ij (S43).
- the adjustment value determination unit 130B increments C j by 1 (S45), and proceeds to S46.
- the adjustment value determination section 130B acquires the maximum value between the C 1 to C N as k (S48). Then, Y which is a signal value after the image quality adjustment value ⁇ is adjusted is obtained by the image quality adjustment value ⁇ k after adjustment (S49). Since this adjusted image quality adjustment value ⁇ k is applied to all of the cameras 20-1 to 20-N, it is transmitted from the information processing apparatus 10B to all of the cameras 20-1 to 20-N. All of -1 to 20-N are used for image quality adjustment. Similar to the update of the matrix operation may utilize maximum value during the period from C 1 to C N as the reference adjustment value.
- FIG. 13 is a diagram illustrating an example of a function table obtained from each of different function shapes. As shown in FIG. 13, when the function shape is different between the function f (y) and the function g (y), the correspondence relationship between the input value y, the output value f (y), and the output value g (y) Prepared as a table. In the fourth example, this function table is used.
- FIG. 14 is a flowchart showing a flow of operations for performing image quality adjustment using a function table.
- 1 is set to the variable i at the start of the repetition processing of S51 to S57.
- a continuation condition for the iterative process that i is N or less is set.
- a termination process for repeating the process of incrementing i by 1 is set (S51).
- 1 is set to the variable j at the start of the repetitive processing of S52 to S56.
- a repetitive processing continuation condition that j is N or less is set.
- a termination process for repeating the process of incrementing j by 1 is set (S52).
- the reliability calculation unit 140 calculates the integrated value for the difference value from the function f i (y) and the function f j (y) as the reliability S ij (S53).
- the adjustment value determination unit 130B increments C j by 1 (S55), and the operation proceeds to S56.
- the adjustment value determination section 130B acquires the maximum value between the C 1 to C N as k (S58). Then, a function table f k is obtained (S49). Since this function table f k is applied to all of the cameras 20-1 to 20-N, it is transmitted from the information processing apparatus 10B to all of the cameras 20-1 to 20-N, and the cameras 20-1 to 20- 20 All of -N are used for image quality adjustment. Similar to the update of the matrix operation may utilize maximum value during the period from C 1 to C N as the reference adjustment value.
- the predetermined value related to the calculation of the reliability is not particularly changed, but the predetermined value related to the calculation of the reliability may be changed depending on the situation.
- the reliability calculation unit 140 when the subjects imaged by the cameras 20-1 to 20-N are within the same or similar range, and the cameras 20-1 to 20-20 whose detection values exceed a predetermined range.
- a predetermined value related to calculation of reliability in the detected camera may be changed.
- the adjustment value determining unit 130B determines whether the subject imaged by each of the cameras 20-1 to 20-N is within the same or similar range based on the positions and orientations of the cameras 20-1 to 20-N. It may be determined whether or not. More specifically, the adjustment value determining unit 130B calculates the optical axes of the cameras 20-1 to 20-N based on the positions and orientations of the cameras 20-1 to 20-N, and the cameras 20-1 to 20-N. If there are cases where the points on the N optical axes fall within a predetermined space, it may be determined that the subjects imaged by the cameras 20-1 to 20-N are within the same or similar range.
- the reliability calculation unit 140 when the subjects imaged by the cameras 20-1 to 20-N are within the same or similar range, and the cameras 20-1 to 20-20 whose detection values exceed a predetermined range. When -N is detected, the reliability of the detected camera may be decreased.
- FIG. 15 is a flowchart illustrating an example of an operation of reducing the reliability in the detected camera.
- the reliability calculation unit 140 when the subjects imaged by the cameras 20-1 to 20-N are not within the same or similar range, the reliability calculation unit 140 (“No” based on S61). ), The operation is shifted to S64. On the other hand, when the subjects imaged by the cameras 20-1 to 20-N are within the same or similar range (“Yes” based on S61), the reliability calculation unit 140 operates in S62. To migrate.
- the reliability calculation unit 140 shifts the operation to S64 when a camera whose detection value exceeds the predetermined range is not detected (“No” in S62). On the other hand, when a camera whose detected value exceeds a predetermined range is detected (“Yes” in S62), the reliability calculation unit 140 decreases the reliability of the detected camera (S63), and proceeds to S64. When the operation is shifted to S64, the reliability calculation unit 140 determines the adjusted image quality adjustment value using the decreased reliability (S64).
- FIG. 16 is a flowchart illustrating an example of an operation of increasing the detected camera threshold.
- the reliability calculation unit 140 when the subjects imaged by the cameras 20-1 to 20-N are not within the same or similar range, the reliability calculation unit 140 (“No” based on S61). ), The operation is shifted to S64. On the other hand, when the subjects imaged by the cameras 20-1 to 20-N are within the same or similar range (“Yes” based on S61), the reliability calculation unit 140 operates in S62. To migrate.
- the reliability calculation unit 140 shifts the operation to S64 when a camera whose detection value exceeds the predetermined range is not detected (“No” in S62). On the other hand, when a camera whose detected value exceeds a predetermined range is detected (“Yes” in S62), the reliability calculation unit 140 increases the threshold value of the detected camera (S65), and proceeds to S64. When the operation is shifted to S64, the reliability calculation unit 140 determines the adjusted image quality adjustment value by using the increased threshold (S64).
- FIG. 17 is a flowchart illustrating an overall operation example of the information processing system according to the second embodiment of the present disclosure.
- the cameras 20-1 to 20-N perform detection and calculation of image quality adjustment values (S71).
- the cameras 20-1 to 20-N transmit the detection value and the pre-adjustment image quality adjustment value via the transmission line (S72).
- the information processing apparatus 10B When the information processing apparatus 10B receives the detection value and the image quality adjustment value, the information processing apparatus 10B calculates the reliability (S73), determines the magnitude relationship between the reliability and the threshold (S74), and adjusts based on the determination result. An image quality adjustment value is calculated (S75). Subsequently, the information processing apparatus 10B transmits the adjusted image quality adjustment value to the cameras 20-1 to 20-N via the transmission line (S76), and the cameras 20-1 to 20-N transmit the adjusted image quality values. When the adjustment value is received, the image quality adjustment value is set based on the adjusted image quality adjustment value (S77). Thereafter, S71 to S77 are repeatedly executed.
- FIG. 18 is a block diagram illustrating a hardware configuration example of the information processing apparatus 10 according to the embodiment of the present disclosure.
- the information processing apparatus 10 includes a CPU (Central Processing unit) 901, a ROM (Read Only Memory) 903, and a RAM (Random Access Memory) 905.
- the information processing apparatus 10 may include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925.
- the information processing apparatus 10 may include a processing circuit called a DSP (Digital Signal Processor) or ASIC (Application Specific Integrated Circuit) instead of or in addition to the CPU 901.
- DSP Digital Signal Processor
- ASIC Application Specific Integrated Circuit
- the CPU 901 functions as an arithmetic processing device and a control device, and controls all or a part of the operation in the information processing device 10 according to various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 927.
- the ROM 903 stores programs and calculation parameters used by the CPU 901.
- the RAM 905 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like.
- the CPU 901, the ROM 903, and the RAM 905 are connected to each other by a host bus 907 configured by an internal bus such as a CPU bus. Further, the host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.
- PCI Peripheral Component Interconnect / Interface
- the input device 915 is a device operated by the user, such as a mouse, a keyboard, a touch panel, a button, a switch, and a lever.
- the input device 915 may include a microphone that detects the user's voice.
- the input device 915 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device 929 such as a mobile phone that supports the operation of the information processing device 10.
- the input device 915 includes an input control circuit that generates an input signal based on information input by the user and outputs the input signal to the CPU 901. The user operates the input device 915 to input various data to the information processing device 10 or instruct a processing operation.
- An imaging device 933 which will be described later, can also function as an input device by imaging a user's hand movement, a user's finger, and the like. At this time, the pointing position may be determined according to the movement of the hand or the direction of the finger.
- the output device 917 is a device that can notify the user of the acquired information visually or audibly.
- the output device 917 is, for example, a display device such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an organic EL (Electro-Luminescence) display, a projector, an audio output device such as a hologram display device, a speaker and headphones, As well as a printer device.
- the output device 917 outputs the result obtained by the processing of the information processing device 10 as a video such as text or an image, or outputs it as a sound such as voice or sound.
- the output device 917 may include a light or the like to brighten the surroundings.
- the storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 10.
- the storage device 919 includes, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device.
- the storage device 919 stores programs executed by the CPU 901, various data, various data acquired from the outside, and the like.
- the drive 921 is a reader / writer for a removable recording medium 927 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built in or externally attached to the information processing apparatus 10.
- the drive 921 reads information recorded on the attached removable recording medium 927 and outputs the information to the RAM 905.
- the drive 921 writes a record in the attached removable recording medium 927.
- the connection port 923 is a port for directly connecting a device to the information processing apparatus 10.
- the connection port 923 can be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface) port, or the like.
- the connection port 923 may be an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, or the like.
- Various data can be exchanged between the information processing apparatus 10 and the external connection device 929 by connecting the external connection device 929 to the connection port 923.
- the communication device 925 is a communication interface configured with, for example, a communication device for connecting to the communication network 931.
- the communication device 925 can be, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB).
- the communication device 925 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various communication.
- the communication device 925 transmits and receives signals and the like using a predetermined protocol such as TCP / IP with the Internet and other communication devices, for example.
- the communication network 931 connected to the communication device 925 is a wired or wireless network, such as the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.
- the first image quality adjustment value of each of the cameras 20-1 to 20-N acquired from the cameras 20-1 to 20-N and the reliability of each camera.
- an information processing apparatus 10A including an adjustment value determination unit 130A that determines the second image quality adjustment value of each of the cameras 20-1 to 20-N is provided. According to such a configuration, it is possible to improve the accuracy of image quality adjustment of each of the cameras 20-1 to 20-N.
- the following configurations also belong to the technical scope of the present disclosure.
- (1) Determination of an adjustment value for determining a second image quality adjustment value of each of the plurality of cameras based on a first image quality adjustment value of each of the plurality of cameras acquired from a plurality of cameras and a reliability of each of the plurality of cameras. Comprising a part, Information processing device.
- the information processing apparatus includes: A reliability calculation unit that calculates the reliability based on the first image quality adjustment value; The information processing apparatus according to (1).
- the reliability calculation unit calculates a difference value between the first image quality adjustment value and a predetermined reference adjustment value for each camera as the reliability.
- the information processing apparatus according to (2) Determination of an adjustment value for determining a second image quality adjustment value of each of the plurality of cameras based on a first image quality adjustment value of each of the plurality of cameras acquired from a plurality of cameras and a reliability of each of the plurality of cameras.
- Information processing device includes: A reliability calculation unit that calculates the reliability based on
- the adjustment value determination unit determines the second image quality adjustment value as the reference adjustment value when the reliability exceeds a predetermined threshold; The information processing apparatus according to (3). (5) The adjustment value determination unit determines the second image quality adjustment value as the first image quality adjustment value when the difference value does not exceed the threshold. The information processing apparatus according to (4). (6) The reference adjustment value is a predetermined representative value for one or a plurality of cameras excluding a camera that uses the reference adjustment value for calculating the reliability among the plurality of cameras. The information processing apparatus according to any one of (3) to (5).
- the representative value is an intermediate value, an average value, a minimum value, or a maximum value regarding one or a plurality of cameras excluding a camera that uses the reference adjustment value for calculating the reliability among the plurality of cameras.
- the reliability calculation unit calculates a difference value between results obtained by multiplying the matrix by a predetermined vector for all combinations of the matrices. Calculating the reliability, The information processing apparatus according to (2).
- the reliability calculation unit calculates the reliability by calculating an integral value for a difference value between the functions for all combinations of the functions.
- the information processing apparatus according to (2) When the first image quality adjustment value is given as a function, the reliability calculation unit calculates the reliability by calculating an integral value for a difference value between the functions for all combinations of the functions.
- the reliability calculation unit calculates the reliability by calculating a total value for a difference value between corresponding values for all the combinations.
- the reliability calculation unit is configured to detect the detection camera. Changing a predetermined value related to the calculation of the reliability in The information processing apparatus according to (4) or (5).
- the reliability calculation unit decreases the reliability of the detection camera; The information processing apparatus according to (11).
- the reliability calculation unit increases the threshold value of the detection camera; The information processing apparatus according to (11).
- the adjustment value determination unit determines whether or not the subject imaged by each of the plurality of cameras is within the same or similar range based on the positions and postures of the plurality of cameras.
- the information processing apparatus according to any one of (11) to (13).
- the information processing apparatus includes: A reliability acquisition unit for acquiring the reliability of each of the plurality of cameras; The information processing apparatus according to (1).
- the adjustment value determination unit determines the first image quality adjustment value of the camera with the highest reliability as the second image quality adjustment value of each of the plurality of cameras.
- the first image quality adjustment value includes a value related to at least one of white balance, matrix calculation, aperture, gain, gamma correction, knee correction, contour enhancement, and noise reduction of an image captured by the camera.
- the information processing apparatus according to any one of (1) to (16).
- An information processing apparatus comprising a determination unit; An information processing system.
- Information processing system 10 (10A, 10B) Information processing apparatus 110A, 110B Data acquisition part 120 Reliability acquisition part 130A, 130B Adjustment value determination part 140 Reliability calculation part 20 Camera 210 Lens 230 Imager 240 Control apparatus 250 Preprocessing part 260 Detection unit 271 Adjustment value calculation lens control unit 272 Adjustment value selection unit 273 Adjustment value selection unit 274 Image quality adjustment unit 280 Post-processing unit 290 Display unit
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Studio Devices (AREA)
- Details Of Cameras Including Film Mechanisms (AREA)
Abstract
Description
0.背景
1.本開示の実施形態
1.1.システム構成例
1.2.機能構成例
1.3.画質調整項の例
2.第1の実施形態
3.第2の実施形態
4.ハードウェア構成例
5.むすび
まず、本開示の実施形態の背景について説明する。近年、複数のカメラ各々によって撮像された画像を利用する技術が知られている。例えば、複数のカメラ各々によって撮像された画像を合成する技術が開示されている(例えば、特開2004-242047号公報参照)。ここで、複数のカメラ各々によって撮像された画像をより高品位にするためには、複数のカメラ間で画質が揃うように複数のカメラ各々の画質調整がなされるのが望ましい。画質としては、色、明るさ、解像度、ノイズ感および質感などが挙げられる。
[1.1.システム構成例]
続いて、図面を参照しながら、本開示の実施形態に係る情報処理システムの構成例について説明する。図1は、本開示の実施形態に係る情報処理システムの構成例を示す図である。図1に示すように、本開示の実施形態に係る情報処理システム1は、情報処理装置10およびカメラ20-1~20-N(ただし、Nは2以上の整数)を備える。図1に示すように、例えば、カメラ20-1~20-Nは、同一の被写体Bjを撮像する。これによって、異なる複数の位置から撮像された同一の被写体Bjの画像が得られる。なお、図1に示した例では、被写体Bjが人物であるが、被写体Bjは人物以外の対象物であってもよい。
続いて、本開示の実施形態に係るカメラ20-1~20-Nの機能はほぼ同様であるため、カメラ20-1~20-Nを代表して、カメラ20-1の機能構成例について説明する。図2は、本実施形態に係るカメラ20-1の機能構成例を示すブロック図である。図2に示したように、カメラ20-1は、レンズ210、絞り220、イメージャ230、レンズ・絞り制御装置240、前処理部250、検波部260、調整値演算レンズ制御部271,調整値選択部272、調整値選択部273、画質調整部274、後処理部280および記録・表示部290を備える。
続いて、本開示の実施形態に係る画質調整項の例について説明する。図3は、画質調整の例を示す図である。図3に示すように、本開示の実施形態においては、画質要素として、色、明るさ、解像感およびノイズ感(または質感)などを扱う。画質要素「色」を調整する画質調整項としては、ホワイトバランスおよびマトリックス演算などが想定される。
続いて、本開示の第1の実施形態について説明する。本開示の第1の実施形態は、上記した静的な画質調整に相当する。図4は、本開示の第1の実施形態に係る情報処理装置の機能構成例を示すブロック図である。図4に示すように、本開示の第1の実施形態に係る情報処理装置10Aは、データ取得部110Aと、信頼度取得部120と、調整値決定部130Aとを備える。また、図4に示すように、情報処理装置10Aは、図示しないネットワークを介してカメラ20-1~20-Nと接続されている。
続いて、本開示の第2の実施形態について説明する。本開示の第2の実施形態は、上記した動的な画質調整に相当する。図6は、本開示の第2の実施形態に係る情報処理装置の機能構成例を示すブロック図である。図6に示すように、本開示の第2の実施形態に係る情報処理装置10Bは、データ取得部110Bと、信頼度算出部140と、調整値決定部130Bとを備える。また、図6に示すように、情報処理装置10Bは、図示しないネットワークを介してカメラ20-1~20-Nと接続されている。
次に、図18を参照して、本開示の実施形態に係る情報処理装置10のハードウェア構成について説明する。図18は、本開示の実施形態に係る情報処理装置10のハードウェア構成例を示すブロック図である。
以上説明したように、本開示の実施形態によれば、カメラ20-1~20-Nから取得したカメラ20-1~20-N各々の第一の画質調整値とカメラ各々の信頼度とに基づいて、カメラ20-1~20-N各々の第二の画質調整値を決定する調整値決定部130Aを備える、情報処理装置10Aが提供される。かかる構成によれば、カメラ20-1~20-N各々の画質調整の精度を向上させることが可能となる。
(1)
複数のカメラから取得した前記複数のカメラ各々の第一の画質調整値と前記複数のカメラ各々の信頼度とに基づいて、前記複数のカメラ各々の第二の画質調整値を決定する調整値決定部を備える、
情報処理装置。
(2)
前記情報処理装置は、
前記第一の画質調整値に基づいて、前記信頼度を算出する信頼度算出部を備える、
前記(1)に記載の情報処理装置。
(3)
前記信頼度算出部は、カメラごとに前記第一の画質調整値と所定の基準調整値との差分値を前記信頼度として算出する、
前記(2)に記載の情報処理装置。
(4)
前記調整値決定部は、前記信頼度が所定の閾値を超える場合に、前記第二の画質調整値を前記基準調整値に決定する、
前記(3)に記載の情報処理装置。
(5)
前記調整値決定部は、前記差分値が前記閾値を超えない場合に、前記第二の画質調整値を前記第一の画質調整値に決定する、
前記(4)に記載の情報処理装置。
(6)
前記基準調整値は、前記複数のカメラのうち前記基準調整値を前記信頼度の算出に用いるカメラを除く1または複数のカメラに関する所定の代表値である、
前記(3)~(5)のいずれか一項に記載の情報処理装置。
(7)
前記代表値は、前記複数のカメラのうち前記基準調整値を前記信頼度の算出に用いるカメラを除く1または複数のカメラに関する中間値、平均値、最小値または最大値である、
前記(6)に記載の情報処理装置。
(8)
前記信頼度算出部は、前記第一の画質調整値が行列として与えられる場合、前記行列に対して所定のベクトルを掛け合わせた結果同士の差分値を、前記行列の組み合わせ全部について算出することによって前記信頼度を算出する、
前記(2)に記載の情報処理装置。
(9)
前記信頼度算出部は、前記第一の画質調整値が関数として与えられる場合、前記関数同士の差分値に対する積分値を、前記関数の組み合わせ全部について算出することによって前記信頼度を算出する、
前記(2)に記載の情報処理装置。
(10)
前記信頼度算出部は、前記第一の画質調整値が複数の値の組み合わせとして与えられる場合、対応する値同士の差分値に対する合計値を、前記組み合わせ全部について算出することによって前記信頼度を算出する、
前記(2)に記載の情報処理装置。
(11)
前記信頼度算出部は、前記複数のカメラそれぞれによって撮像される被写体が同一または類似の範囲内である場合、かつ、検波値が所定の範囲を超えるカメラを検出カメラとして検出した場合、前記検出カメラにおける前記信頼度の算出に関する所定の値を変化させる、
前記(4)または(5)に記載の情報処理装置。
(12)
前記信頼度算出部は、前記検出カメラの前記信頼度を減少させる、
前記(11)に記載の情報処理装置。
(13)
前記信頼度算出部は、前記検出カメラの前記閾値を増加させる、
前記(11)に記載の情報処理装置。
(14)
前記調整値決定部は、前記複数のカメラの位置および姿勢に基づいて、前記複数のカメラそれぞれによって撮像される前記被写体が同一または類似の範囲内であるか否かを判定する、
前記(11)~(13)のいずれか一項に記載の情報処理装置。
(15)
前記情報処理装置は、
前記複数のカメラそれぞれの信頼度を取得する信頼度取得部を備える、
前記(1)に記載の情報処理装置。
(16)
前記調整値決定部は、前記信頼度の最も高いカメラの前記第一の画質調整値を前記複数のカメラそれぞれの前記第二の画質調整値として決定する、
前記(15)に記載の情報処理装置。
(17)
前記第一の画質調整値は、前記カメラによる撮像画像のホワイトバランス、マトリックス演算、絞り、ゲイン、ガンマ補正、ニー補正、輪郭強調、ノイズリダクションの少なくともいずれか一つに関する値を含む、
前記(1)~(16)のいずれか一項に記載の情報処理装置。
(18)
複数のカメラから取得した前記複数のカメラ各々の第一の画質調整値と前記複数のカメラ各々の信頼度とに基づいて、前記複数のカメラ各々の第二の画質調整値を決定することを含む、
情報処理方法。
(19)
コンピュータを、
複数のカメラから取得した前記複数のカメラ各々の第一の画質調整値と前記複数のカメラ各々の信頼度とに基づいて、前記複数のカメラ各々の第二の画質調整値を決定する調整値決定部を備える、
情報処理装置として機能させるためのプログラム。
(20)
複数のカメラと、
前記複数のカメラから取得した前記複数のカメラ各々の第一の画質調整値と前記複数のカメラ各々の信頼度とに基づいて、前記複数のカメラ各々の第二の画質調整値を決定する調整値決定部を備える、情報処理装置と、
を有する、情報処理システム。
10(10A、10B) 情報処理装置
110A、110B データ取得部
120 信頼度取得部
130A、130B 調整値決定部
140 信頼度算出部
20 カメラ
210 レンズ
230 イメージャ
240 制御装置
250 前処理部
260 検波部
271 調整値演算レンズ制御部
272 調整値選択部
273 調整値選択部
274 画質調整部
280 後処理部
290 表示部
Claims (20)
- 複数のカメラから取得した前記複数のカメラ各々の第一の画質調整値と前記複数のカメラ各々の信頼度とに基づいて、前記複数のカメラ各々の第二の画質調整値を決定する調整値決定部を備える、
情報処理装置。 - 前記情報処理装置は、
前記第一の画質調整値に基づいて、前記信頼度を算出する信頼度算出部を備える、
請求項1に記載の情報処理装置。 - 前記信頼度算出部は、カメラごとに前記第一の画質調整値と所定の基準調整値との差分値を前記信頼度として算出する、
請求項2に記載の情報処理装置。 - 前記調整値決定部は、前記信頼度が所定の閾値を超える場合に、前記第二の画質調整値を前記基準調整値に決定する、
請求項3に記載の情報処理装置。 - 前記調整値決定部は、前記差分値が前記閾値を超えない場合に、前記第二の画質調整値を前記第一の画質調整値に決定する、
請求項4に記載の情報処理装置。 - 前記基準調整値は、前記複数のカメラのうち前記基準調整値を前記信頼度の算出に用いるカメラを除く1または複数のカメラに関する所定の代表値である、
請求項3に記載の情報処理装置。 - 前記代表値は、前記複数のカメラのうち前記基準調整値を前記信頼度の算出に用いるカメラを除く1または複数のカメラに関する中間値、平均値、最小値または最大値である、
請求項6に記載の情報処理装置。 - 前記信頼度算出部は、前記第一の画質調整値が行列として与えられる場合、前記行列に対して所定のベクトルを掛け合わせた結果同士の差分値を、前記行列の組み合わせ全部について算出することによって前記信頼度を算出する、
請求項2に記載の情報処理装置。 - 前記信頼度算出部は、前記第一の画質調整値が関数として与えられる場合、前記関数同士の差分値に対する積分値を、前記関数の組み合わせ全部について算出することによって前記信頼度を算出する、
請求項2に記載の情報処理装置。 - 前記信頼度算出部は、前記第一の画質調整値が複数の値の組み合わせとして与えられる場合、対応する値同士の差分値に対する合計値を、前記組み合わせ全部について算出することによって前記信頼度を算出する、
請求項2に記載の情報処理装置。 - 前記信頼度算出部は、前記複数のカメラそれぞれによって撮像される被写体が同一または類似の範囲内である場合、かつ、検波値が所定の範囲を超えるカメラを検出カメラとして検出した場合、前記検出カメラにおける前記信頼度の算出に関する所定の値を変化させる、
請求項4に記載の情報処理装置。 - 前記信頼度算出部は、前記検出カメラの前記信頼度を減少させる、
請求項11に記載の情報処理装置。 - 前記信頼度算出部は、前記検出カメラの前記閾値を増加させる、
請求項11に記載の情報処理装置。 - 前記調整値決定部は、前記複数のカメラの位置および姿勢に基づいて、前記複数のカメラそれぞれによって撮像される前記被写体が同一または類似の範囲内であるか否かを判定する、
請求項11に記載の情報処理装置。 - 前記情報処理装置は、
前記複数のカメラそれぞれの信頼度を取得する信頼度取得部を備える、
請求項1に記載の情報処理装置。 - 前記調整値決定部は、前記信頼度の最も高いカメラの前記第一の画質調整値を前記複数のカメラそれぞれの前記第二の画質調整値として決定する、
請求項15に記載の情報処理装置。 - 前記第一の画質調整値は、前記カメラによる撮像画像のホワイトバランス、マトリックス演算、絞り、ゲイン、ガンマ補正、ニー補正、輪郭強調、ノイズリダクションの少なくともいずれか一つに関する値を含む、
請求項1に記載の情報処理装置。 - 複数のカメラから取得した前記複数のカメラ各々の第一の画質調整値と前記複数のカメラ各々の信頼度とに基づいて、前記複数のカメラ各々の第二の画質調整値を決定することを含む、
情報処理方法。 - コンピュータを、
複数のカメラから取得した前記複数のカメラ各々の第一の画質調整値と前記複数のカメラ各々の信頼度とに基づいて、前記複数のカメラ各々の第二の画質調整値を決定する調整値決定部を備える、
情報処理装置として機能させるためのプログラム。 - 複数のカメラと、
前記複数のカメラから取得した前記複数のカメラ各々の第一の画質調整値と前記複数のカメラ各々の信頼度とに基づいて、前記複数のカメラ各々の第二の画質調整値を決定する調整値決定部を備える、情報処理装置と、
を有する、情報処理システム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017557743A JPWO2017110192A1 (ja) | 2015-12-24 | 2016-09-29 | 情報処理装置、情報処理方法、プログラムおよび情報処理システム |
US15/780,945 US10742862B2 (en) | 2015-12-24 | 2016-09-29 | Information processing device, information processing method, and information processing system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015-251343 | 2015-12-24 | ||
JP2015251343 | 2015-12-24 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017110192A1 true WO2017110192A1 (ja) | 2017-06-29 |
Family
ID=59089232
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/078812 WO2017110192A1 (ja) | 2015-12-24 | 2016-09-29 | 情報処理装置、情報処理方法、プログラムおよび情報処理システム |
Country Status (3)
Country | Link |
---|---|
US (1) | US10742862B2 (ja) |
JP (1) | JPWO2017110192A1 (ja) |
WO (1) | WO2017110192A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019188573A1 (ja) * | 2018-03-28 | 2019-10-03 | ソニー株式会社 | 演算装置、演算方法およびプログラム |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001320616A (ja) * | 2000-02-29 | 2001-11-16 | Matsushita Electric Ind Co Ltd | 撮像システム |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6972796B2 (en) * | 2000-02-29 | 2005-12-06 | Matsushita Electric Industrial Co., Ltd. | Image pickup system and vehicle-mounted-type sensor system |
WO2012155951A1 (en) * | 2011-05-13 | 2012-11-22 | Valeo Schalter Und Sensoren Gmbh | Camera arrangement for a vehicle and method for calibrating a camera and for operating a camera arrangement |
US9402018B2 (en) * | 2013-12-17 | 2016-07-26 | Amazon Technologies, Inc. | Distributing processing for imaging processing |
-
2016
- 2016-09-29 JP JP2017557743A patent/JPWO2017110192A1/ja not_active Abandoned
- 2016-09-29 WO PCT/JP2016/078812 patent/WO2017110192A1/ja active Application Filing
- 2016-09-29 US US15/780,945 patent/US10742862B2/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001320616A (ja) * | 2000-02-29 | 2001-11-16 | Matsushita Electric Ind Co Ltd | 撮像システム |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019188573A1 (ja) * | 2018-03-28 | 2019-10-03 | ソニー株式会社 | 演算装置、演算方法およびプログラム |
JPWO2019188573A1 (ja) * | 2018-03-28 | 2021-04-01 | ソニー株式会社 | 演算装置、演算方法およびプログラム |
US11381737B2 (en) | 2018-03-28 | 2022-07-05 | Sony Corporation | Arithmetic device and arithmetic method |
JP7363770B2 (ja) | 2018-03-28 | 2023-10-18 | ソニーグループ株式会社 | 演算装置、演算方法およびプログラム |
Also Published As
Publication number | Publication date |
---|---|
US20180288297A1 (en) | 2018-10-04 |
JPWO2017110192A1 (ja) | 2018-10-11 |
US10742862B2 (en) | 2020-08-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6803982B2 (ja) | 光学撮像方法および装置 | |
JP5980294B2 (ja) | データ処理装置、撮像装置、およびデータ処理方法 | |
WO2021047345A1 (zh) | 图像降噪方法、装置、存储介质及电子设备 | |
US8780225B2 (en) | Use of noise-optimized selection criteria to calculate scene white points | |
CN111327824B (zh) | 拍摄参数的选择方法、装置、存储介质及电子设备 | |
JP2020150331A (ja) | 画像処理装置、画像処理装置の制御方法、システム、及び、プログラム | |
US9906732B2 (en) | Image processing device, image capture device, image processing method, and program | |
WO2021104394A1 (zh) | 图像处理方法及装置、电子设备、存储介质 | |
JPWO2017169039A1 (ja) | 画像処理装置、撮像装置、および画像処理方法、並びにプログラム | |
JP6655218B2 (ja) | 撮像装置及び画像処理方法 | |
CN113538223A (zh) | 噪声图像生成方法、装置、电子设备及存储介质 | |
WO2018168222A1 (ja) | 情報処理装置、撮像装置および電子機器 | |
JP2020058014A (ja) | 映像処理装置、ビデオ会議システム、映像処理方法、およびプログラム | |
WO2017110192A1 (ja) | 情報処理装置、情報処理方法、プログラムおよび情報処理システム | |
JP5998483B2 (ja) | 音声信号処理装置、音声信号処理方法、プログラム及び記録媒体 | |
JP2018185586A (ja) | 画像処理装置および画像処理方法、撮像装置 | |
US11523052B2 (en) | Electronic apparatus, control method of electronic apparatus, and non-transitory computer readable medium | |
JP2005142890A (ja) | ホワイトバランス調整方法および画像処理装置 | |
CN112150357B (zh) | 一种图像处理方法及移动终端 | |
JP6514577B2 (ja) | 画像処理装置および画像処理方法ならびに撮像装置 | |
JP6808770B2 (ja) | データ処理装置、撮像装置、およびデータ処理方法 | |
WO2021199366A1 (ja) | 情報処理装置、方法、プログラム、およびモデル | |
JP2018137580A (ja) | 画像処理装置、画像処理方法、及び、プログラム | |
WO2022183876A1 (zh) | 拍摄方法、装置、计算机可读存储介质及电子设备 | |
WO2022244351A1 (ja) | 画像処理装置、画像処理方法、プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16878090 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017557743 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15780945 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16878090 Country of ref document: EP Kind code of ref document: A1 |