DE102016002800A1 - A method of operating an image pickup device and corresponding image pickup device - Google Patents

Abstract

In an image pickup device (1), it is proposed to detect an internal temperature of the image pickup device (1) and automatically perform a measure (22, 23, 24, 25) upon fulfillment of a stored temperature criterion which characterizes overheating, with which one Power consumption of the image pickup device (1) is reduced with continuously continued generating an image data stream.

Description

The invention relates to a method for operating an image recording device, wherein an image data stream is generated with the image recording device.

The invention further relates to an image pickup device.

Such imaging devices are known, for example, from camera heads for endoscopes, from endoscopes and from image sensors in endoscopes.

The invention has for its object to improve the performance characteristics of an image pickup device.

To achieve the object, the features of claim 1 are provided according to the invention. In particular, it is thus proposed according to the invention for achieving the stated object in a method of the type mentioned above that an internal temperature of the image recording device is detected and that a power consumption of the image recording device is automatically reduced with continued generation of an image data stream if the detected temperature fulfills a predetermined criterion. Thus, heat generation in the image pickup device is reducible with continued operation of the image pickup device, particularly with continued provision of an image data stream. This is particularly favorable if the image recording device is used in a narrow, closed space, for example as an endoscope or as part of an endoscope, because then excessive heating can lead to damage of an examination object. Thus, the performance properties are improved. It is particularly favorable if the internal temperature is a temperature of at least one electronic module. Thus, overheating of a potential heat source can be prevented. This allows an extension of the deployment time and / or protection of a user or user of the image capture device.

In one embodiment of the invention can be provided that the predetermined criterion is met when the detected temperature reaches or exceeds a temperature threshold from below. Thus, a computationally easy-to-handle and / or easy-to-monitor criterion can be used. Alternatively or additionally, it may be provided that the predetermined criterion is fulfilled if the detected temperature characterizes a heat development on the electronic module which reaches or exceeds a predetermined thermal threshold value from below. Thus, excessive heat development can be computed directly and avoided.

In one embodiment of the invention can be provided that the power consumption is set to a default value when the temperature meets a second criterion. For example, the power consumption can be set to a maximum value. Thus, a return to a standard operating state, in particular for maximum performance, automatically reachable as soon as a risk of overheating is eliminated or no longer exists. It is particularly advantageous if the second criterion is met when the detected temperature reaches or falls below the already mentioned temperature threshold or a second temperature threshold from above and / or if the detected temperature characterizes a heat development on the electronic module, the or a second predetermined heat threshold reached or exceeded from above. Thus, a return to normal operation is simply computationally detected. Particularly favorable is the use of a second temperature threshold, which is below the first-mentioned temperature threshold. Thus, a hysteresis behavior can be generated, which can help avoid too frequent switching of the power consumption.

In one embodiment of the invention, it can be provided that the power consumption is reduced by changing a parameter that defines a function of the image pickup device. Thus, a computationally easy to handle way to a reduction in power consumption is available. The invention has recognized here that a reduction of a computational effort in an image processing can automatically lead to a reduction in power consumption. Thus, the power consumption in the invention is controllable, for example, by a parameter that directly or indirectly on a currently established computational effort, for example via a temporal or spatial resolution of an image data stream and / or a complexity of image processing, acts.

In an embodiment of the invention it can be provided that an image acquisition rate is used as parameter. Thus, a processor performance in the image processing can be reduced, whereby the power consumption of the image pickup device is reduced overall. Alternatively or additionally, an image resolution can be used. Again, this provides a simple means of reducing processor performance in image processing. Alternatively or additionally, a lighting performance for a lighting of a control element and / or a scene to be recorded be used. Thus, a power consumption at a lighting source can be reduced. For example, the illumination power can be characterized by a luminous intensity. Alternatively or additionally, a logic switch may be used between an interlaced image building method and a frame image building method. Thus, a processing power in the image processing by a transition from a frame-forming method in which, for example, each line in each frame is constructed and processed, to an interlaced image composing method in which, for example, in each frame, only a part of the lines of the frame, in particular every second, third or more than the third row, rebuilt and processed, will be reduced.

In one embodiment of the invention can be provided that is detected as the temperature of an internal temperature in an endoscope handle. Thus, overheating in the endoscope handle of an endoscope can be avoided. Alternatively or additionally, it can be provided that an internal temperature in an endoscope tip is detected as the temperature. Thus, overheating at a distal end of an endoscope can be avoided.

In one embodiment of the invention can be provided that is detected as the temperature of an operating temperature of an image sensor. Thus, overheating on the image sensor can be particularly easily avoided. Alternatively or additionally, it can be provided that an operating temperature of an image processing unit is detected as the temperature. Thus, a damaging influence of heat generation in the image processing can be avoided.

In one embodiment of the invention can be provided that a further stage of reducing the power consumption is set automatically when the detected temperature meets another predetermined criterion. There are so function reductions in stages depending on the strength of a heat development achievable. Preferably, therefore, two or more than two criteria are deposited, which are fulfilled successively with progressively increased heat development. For each of the deposited criteria, a set of measures for a reduction of the power consumption is preferably deposited, which achieves a greater power reduction than a set of measures to a preceding criterion. This can be achieved, for example, by the fact that the set of measures contains all measures relating to a preceding criterion and at least one additional measure. It is particularly simple if, for each criterion, another value of a parameter is stored in a corresponding ascending sequence of power reductions. For example, in this way, a lighting power can be stored progressively from a maximum power to a minimum power.

In one embodiment of the invention can be provided that a fulfillment of the criterion is stored. Thus, for example, can be stored for later maintenance readable that overheating has taken place.

In an embodiment of the invention, it can be provided that the image data stream outside the image recording device is automatically reworked in order to at least partially reduce an effect of reducing the power consumption on the image data stream. Thus, an impairment of image quality is at least partially compensable for a viewer. It is preferably provided here that a treatment method which is applied to the image data stream is modified when the detected temperature meets the predetermined criterion. This can lead to a contrarian increase in power consumption on an external image processing device where overheating is not critical or is virtually unavailable. When using an image recording device according to the invention or the method according to the invention in an endoscope, it can thus be advantageous if the external image processing device is arranged or can be arranged outside a cavity that can be examined with the endoscope.

In order to achieve the stated object, the features of the independent claim directed to an image pickup device are provided according to the invention in an image pickup device. In particular, according to the invention is thus proposed in an image pickup device, a temperature sensor, which is adapted to detect an internal temperature of the image pickup device, in particular a temperature of at least one electronic module, and a control unit, which leads to a reduction of power consumption of the image pickup device detected temperature meets a predetermined criterion, is designed to train. The advantage here is that a power consumption depending on a detected temperature and / or a developed heat is reduced so that overheating can be avoided or at least delayed.

In one embodiment of the invention can be provided that the image pickup device is designed as an endoscope. Thus, overheating, for example, of parts of the image pickup device in a tested cavity is avoidable.

In one embodiment of the invention can be provided that the temperature sensor is arranged in an endoscope tip. This allows easy control and limitation of heat development in a studied cavity into which the endoscope tip is inserted. Alternatively or additionally, it can be provided that the temperature sensor is arranged in an endoscope handle. Thus, impairment of operability of the endoscope due to overheating is avoidable.

In one embodiment of the invention can be provided that the temperature sensor is thermally coupled to an image sensor. Thus, a heat development on the image sensor is easily monitored. Alternatively or additionally, it can be provided that the temperature sensor is thermally coupled to an image processing unit. This allows a control of heat development by image processing, for example due to a processor performance developed or necessary for this purpose.

In one embodiment of the invention, it may be provided that the image recording device comprises means for carrying out a method according to the invention, in particular as described above and / or according to one of the claims directed to a method, and / or for carrying out a method according to the invention, in particular as described above and / or is established according to one of the claims directed to a method, in particular by programming. Thus, an implementation or implementation of the method according to the invention can be achieved by way of example.

The invention will now be described in more detail with reference to embodiments, but is not limited to these embodiments. Further exemplary embodiments result from a combination of the features of individual or several protection claims with one another and / or with one or more features of the exemplary embodiments.

It shows:

1 an image recording device according to the invention in highly schematized, partially cutaway representations,

2 a further image recording device according to the invention in a highly schematized, partially cutaway representation,

3 A third image recording device according to the invention in a highly schematized, partially cutaway representation,

4 a highly simplified flow chart of a method according to the invention and

5 a highly simplified flow chart of another method according to the invention.

1 shows one as a whole 1 designated image pickup device, which as an endoscope with an endoscope shaft 2 and an endoscope handle 3 is trained. Inside the endoscope handle 3 is a temperature sensor 4 arranged with an internal temperature of the image pickup device 1 in the endoscope handle 3 is detectable.

In the endoscope handle 3 is also a control unit 5 formed, which is a measurement signal from the temperature sensor 4 receives, and is to be described in more detail, the power consumption of the image pickup device 1 reduce when the temperature at the temperature sensor 4 meets a given criterion.

In the endoscope handle 3 is also an image sensor 6 arranged with which a via a distal end 7 of the endoscope shaft 2 captured image is receivable.

The temperature sensor 4 is thermally connected to the image sensor 6 coupled so that the temperature sensor 4 a temperature of the image sensor 6 comprehensive electronic assembly 8th detected.

In one the control and regulation unit 5 comprehensive further electronic assembly 9 is an image processing unit 10 formed, with which a picture data stream to the output signals of the image sensor 6 can be generated or transmitted.

The temperature sensor 4 may alternatively or additionally to the image processing unit 10 and / or the control and regulation unit 5 thermally coupled to a temperature of the further electronic assembly 9 capture.

An external image processing device 11 is to the image pickup device 1 connected to generate from the already mentioned image data stream as a raw data stream, a stream of processed images.

This stream of rendered images is at an excluded output device 12 , For example, a monitor, can be output.

In the endoscope handle 3 is also a source of illumination 13 arranged, with which work light to the distal end 7 can be brought.

2 shows a further image pickup device according to the invention 1 , Components and functional units that are functional and / or constructive to components or functional units of the foregoing Embodiment are identical or identical, are denoted by the same reference numerals and not described separately again. The remarks to 1 therefore apply to 2 corresponding.

The embodiment according to 2 differs from the embodiment according to 1 in that the illumination source 13 not in the endoscope handle 3 but outside the image pickup device 1 as external illumination source 13 is trained. The light generated here is through an optical fiber connection 14 in the endoscope 2 coupled and from there to the distal end 7 directed. In this case, coupling losses can occur at the point of introduction, which leads to a heating of the image recording device 1 to lead. This heating is with the temperature sensor 4 detectable.

3 shows a further image pickup device according to the invention 1 , Components and functional units that are identical or identical to the components and / or functional units of the preceding embodiments are not described separately again, but designated by the same reference numerals. The embodiments of the embodiments of the preceding embodiments therefore apply to 3 corresponding.

The embodiment according to 3 differs from the preceding embodiments in that the temperature sensor 4 , the image sensor 6 and the illumination source 13 not in the endoscope handle 3 but in an endoscope tip 15 at the distal end 7 of the endoscope shaft 2 are arranged.

The temperature sensor 4 thus captures the internal temperature in the endoscope tip 15 which is essential through the electronic assembly 8th that the image sensor 6 includes and / or the electronic assembly 26 that the lighting source 13 includes, is determined.

The control and regulation unit 5 In the described exemplary embodiments, the invention is designed to carry out the method according to the invention described below, for example by appropriate programming and / or configuration, for example an FPGA (field programmable gate array, field programmable (logic) gate arrangement).

4 shows a highly simplified flow chart for a computer-implemented, inventive method for operating an image pickup device, in particular one of the image pickup devices according to 1 . 2 and or 3 ,

In the image processing unit 10 is running a main program 16 with which, for example, the already mentioned image data stream from the output signals of the image sensor 6 is formed or processed.

For this main program 16 becomes a subroutine 17 Branched, with which the over the temperature sensor 4 detected temperature is evaluated.

Here are a number of criteria deposited in comparison steps 18 . 19 . 20 . 21 being checked.

This is in the comparison step 18 checked if the with the temperature sensor 4 detected temperature is at or above a temperature threshold T ₁ and below a second temperature threshold T ₂ . If this is not the case, then in a subsequent comparison step 19 tested whether the detected temperature reaches or exceeds a second temperature threshold T ₂ from below and below a third temperature threshold T ₃ .

This continues until a comparison step 20 in which it is checked whether the detected temperature reaches or exceeds a temperature threshold T _x-1 from below and below a temperature threshold T _x . Here, x = 2, 3, 4, 5, ... are valid. Thus, depending on the application, any number of (ascending) temperature threshold values can be set up, stored and / or processed.

Through these comparison steps 18 . 19 . 20 is thus an ascending sequence of temperature thresholds T ₁ <T ₂ <T ₃ <... T _x-1 <T _x Are defined. These temperature thresholds indicate that in each case a heat threshold value of a heat source is exceeded.

These comparison steps 18 . 19 . 20 upstream is another comparison step 21 in which it is checked whether the detected temperature is below the detected temperature threshold T ₁ .

In the schedule according to 4 is shown with a "y" the branch, which is granted if the respective criterion of the comparison step 18 . 19 . 20 . 21 is satisfied and with "n" if the corresponding criterion to the comparison step 18 . 19 . 20 . 21 is not fulfilled.

It can be seen that the subroutine 17 in the case that the first comparison step 21 shows that the temperature is below a (first critical) temperature threshold T ₁ , no further actions are performed, so that the subroutine 17 directly back to the main program 16 leads.

On the other hand, it is the criterion of the comparison step 18 If the detected temperature reaches or exceeds the temperature threshold value T ₁ , then a first measure is achieved 22 Running, the power consumption of the image pickup device 1 reduced with continued generation of the image data stream.

If, on the other hand, the criterion is the comparison step 19 fulfilled, then performs the subroutine 17 a second measure 23 off, the one opposite the first measure 22 greater reduction in power consumption of the image pickup device 1 entails. This can be achieved, for example, by the second measure 23 the first measure 22 and an additional measure for further reduction of power consumption contains.

Accordingly, if the criterion becomes the comparison step 20 is satisfied, the measure 24 executed, all in the sequence of comparison steps 18 . 19 . 20 previous measures 22 . 23 and contains an additional measure.

If the detected temperature exceeds all temperature threshold values T ₁ , T ₂ , T ₃ ,..., T _x-1 , T _x , this becomes a measure 25 executed. The measure 25 also includes all the above measures to reduce power consumption again.

Is the criterion for the comparison step 21 If, therefore, the detected temperature falls below the temperature threshold value T ₁ , the power consumption of the image pickup device becomes 1 set to a default value, which may also be the maximum value.

As the temperature of the temperature sensor 4 a heat development on at least one of the electronic assemblies 8th . 9 . 26 characterized, may be the control and regulation unit 5 the increase of the detected temperature at the temperature sensor 4 through such measures 22 . 23 . 24 . 25 counteract which a power consumption of the respective electronic module 8th . 9 . 26 to reduce. Here is to each of the electronic assemblies 8th . 9 . 26 Defines a parameter that is a function of this electronic assembly 8th . 9 . 26 describes. By automatic modification of this parameter by means of the control unit 5 the desired reduction in power consumption can be achieved.

For example, this parameter can be used in the image processing unit 10 an image acquisition rate and / or an image resolution. Thus, multidimensional parameters can also be used.

In the electronic module 26 the illumination source 13 For example, the parameter may be a lighting power, for example, described by a lighting current.

Alternatively or additionally, the parameter may also be a two-valued logical switch with which the image processing unit 10 between an interlaced scanning method and a frame picture recording method. The full-frame image recording method has the greater power consumption.

If the power reduction occurs in one of the measures 22 . 23 . 24 . 25 by a qualitative deterioration of the image data stream, this can be done in the image processing device 11 outside the image pickup device 1 be at least partially compensated again. For this purpose, a treatment process is applied to the image data stream, wherein the treatment process in dependence on the detected temperature at the temperature sensor 4 is modified accordingly.

5 shows a highly simplified flowchart of another embodiment of the invention for a method for operating an image pickup device 1 , Function blocks that are identical or identical to function blocks of the preceding embodiment of a method according to the invention are denoted by the same reference numerals and not described separately again. The comments on the preceding embodiment of a method according to the invention 4 therefore assert 5 corresponding.

In 5 is again the subroutine 17 which realizes the method according to the invention and which is executed in parallel with or simultaneously with a main program (not shown), wherein the main program generates among other things the picture data stream.

After an initialization step 27 is first in a preparatory step 28 an overtemperature fault flag is cleared.

Subsequently, in a temperature detecting step 29 in the manner already described a temperature with a temperature sensor 4 detected.

In a comparison step 21 it is checked whether the temperature is below a first critical threshold, for example below the already mentioned threshold T ₁ .

If this is the case (alternative "y"), then in a first deletion step 30 an over-temperature flag cleared in a second erase step 31 a security state flag cleared in a reset step 32 a lighting power of a lighting source 13 set to 100%, ie to a maximum value as standard value, and in a third deletion step 33 an overtemperature fault flag is cleared.

The reset step 32 therefore corresponds to the method described above according to 4 in the event that no action 22 . 23 . 24 . 25 is performed.

Is the result of the comparison step 21 , the critical temperature threshold T ₁ is reached or exceeded from below, then moves the subroutine 17 in the alternative "n". First, the mentioned over-temperature flag becomes an over-temperature setting step 40 set. Subsequently, in a comparison step 18 checked whether the detected temperature of the temperature sensor 4 from the temperature detection step 29 is below a second temperature threshold T ₂ . If this is the case, a first criterion is met, namely that the detected temperature is at or above the temperature threshold T ₁ and below the temperature threshold T ₂ , and it becomes a measure 22 executed, in which the lighting power is set to a reduced percentage of the maximum value.

In other words, the measure includes 22 the reduction of the illumination power by a predetermined percentage of the maximum illumination power.

In the comparison step 19 it is checked whether the detected temperature is below a temperature threshold T ₂ . If this is the case (alternative "y"), then the illumination power of the illumination source 13 in a measure 23 according to the measure 22 and additionally in an additional measure by a further percentage of the maximum power.

In the comparison step 20 Finally, it is checked whether the detected temperature is below a temperature threshold T ₃ . If this is the case (alternative "y") so will be in a measure 24 set the lighting power to a lower percentage of maximum power. This corresponds to the measures 22 . 23 and additionally a measure in the form of a further reduction of the illumination power of the illumination source 13 by another percentage of the maximum value.

Is the result of the comparison step 20 negative (alternative "n"), so is in a measure 25 the illumination power of the illumination source 13 set to zero, the illumination source 13 So shut off. This corresponds to the measures 22 to 24 and additionally, further reducing the illumination power by a further percentage of the maximum value.

Following the measure 25 is a safety shutdown flag (safety shutdown step 34 ) and a security shutdown message in an issue step 35 output. In cases where one of the measures 22 . 23 . 24 is executed, on the other hand, the safety shutdown flag in a safety shutdown erase step 39 is cleared and it is checked whether the overtemperature error storage flag is set (see step 36 ). If this is the case (alternative "y"), then the subroutine 17 run again. If this is not the case (alternative "n"), the overtemperature error memory flag is initially set (error memory setting step 37 ) and it is then in an output step 38 an overtemperature message is output. Then the subroutine returns 17 back to the starting point.

The measure 22 is thus carried out when it is met as the first criterion that the detected temperature is at or above the temperature threshold T ₁ and below the temperature threshold T ₂ , the measure 23 on the other hand, if the detected temperature is at or above the temperature threshold T ₂ and below the temperature threshold T 3. The measure 24 On the other hand, it is executed when, as a third criterion, the detected temperature is at or above the third temperature threshold T ₃ and below the temperature threshold T ₄ . The measure 25 is finally executed when the detected temperature is a further criterion above the last stored temperature threshold T ₄ .

In further exemplary embodiments, further temperature threshold values or less than four temperature threshold values are stored. The schedule according to 5 adapts accordingly. In further embodiments of the invention, the measures exist 22 . 23 . 24 . 25 only partially or not at all in a reduction of a lighting power of the illumination source 13 but in a modification of the complexity of the processing of the already mentioned image data stream.

For example, in this case, the image acquisition rate and / or the image resolution can be successively reduced, and / or it is possible to switch between a full-frame image build-up process and a lower-power interlaced image capture process.

The overtemperature flag can be provided for example for external evaluation and / or display on an interface. The overtemperature message and / or the safety shutdown message may be used and / or stored to document a critical condition. Thus, the respectively associated criterion is stored.

In the image pickup device 1 It is proposed an internal temperature of the image pickup device 1 and, upon fulfillment of a stored criterion for the temperature which characterizes overheating, a measure 22 . 23 . 24 . 25 automatically perform, with which a power consumption of the image pickup device 1 is reduced when continuously generating an image data stream.

LIST OF REFERENCE NUMBERS

1

Imaging device

2

endoscope shaft

3

Endoscope handle

4

temperature sensor

5

Control and regulation unit

6

image sensor

7

distal end of 2

8th

electronic assembly

9

another electronic module

10

Image processing unit

11

(external) image processing device

12

output unit

13

lighting source

14

Optical fiber connection

15

endoscope tip

16

main program

17

subroutine

18, 19, 20, 21

comparison step

22, 23, 24, 25

measure

26

electronic assembly

27

initialization

28

preparation step

29

Temperature sensing step

30, 31

erasure step

32

Reset step

33

erasure step

34

Safety shutdown step

35

output step

36

comparison step

37

Fault memory setting step

38

output step

39

Safety shutdown erase step

40

Over-temperature setting step

Claims (12)

Method for operating an image acquisition device ( 1 ), wherein with the image recording device ( 1 ) an image data stream is generated, characterized in that an internal temperature of the image acquisition device ( 1 ), in particular a temperature of at least one electronic assembly ( 8th . 9 . 26 ), the image pickup device ( 1 ) and that a power consumption of the image pickup device ( 1 ) is automatically reduced upon continued generation of an image data stream if the detected temperature meets a predetermined criterion. Method according to the preceding claim, characterized in that the predetermined criterion is met when the detected temperature reaches or exceeds a temperature threshold (T ₁ , T ₂ , T ₃ , T _x-1 , T _x ) from below and / or when the detected temperature a heat generation at the electronic assembly ( 8th . 9 . 26 ), which reaches or exceeds a predetermined thermal threshold from below. Method according to one of the preceding claims, characterized in that the power consumption is set to a standard value, in particular to a maximum value, if the detected temperature fulfills a second criterion, in particular if the detected temperature is the or a second temperature threshold value (T ₁ , T ₂ , T ₃ , T _x-1 , T _x ) is reached from above or falls below and / or if the detected temperature, a heat generation at the electronic assembly ( 8th . 9 . 26 ), which reaches or falls below the or a second predetermined thermal threshold value from above. Method according to one of the preceding claims, characterized in that the power consumption is reduced by using a parameter representing a function of the image sensing device ( 1 ), in particular wherein as parameters an image acquisition rate, an image resolution, an illumination power, in particular an illumination current intensity, for illumination of a control element and / or a scene to be recorded, and / or a logical switch between an interlaced image synthesis method and a Full screen image building method is used. Method according to one of the preceding claims, characterized in that the temperature is an internal temperature in one Endoscope handle ( 3 ) and / or an endoscope tip ( 15 ) and / or an operating temperature of an image sensor ( 6 ) and / or an image processing unit ( 10 ) is detected. Method according to one of the preceding claims, characterized in that a further stage of reducing the power consumption is set automatically when the detected temperature meets another predetermined criterion. Method according to one of the preceding claims, characterized in that a fulfillment of the criterion is stored. Method according to one of the preceding claims, characterized in that the image data stream outside the image recording device ( 1 ) is automatically post-processed to at least partially reduce an effect of reducing power consumption on the image data stream, in particular wherein a rendering process applied to the image data stream is modified when the sensed temperature meets the predetermined criterion. Image pickup device ( 1 ), with a temperature sensor ( 4 ), which for detecting an internal temperature, in particular a temperature of at least one electronic module ( 8th . 9 . 26 ), the image pickup device ( 1 ) and a control and regulation unit ( 5 ), which leads to a reduction of a power consumption of the image recording device ( 1 ) is established when the detected temperature meets a predetermined criterion. Image pickup device ( 1 ) according to the preceding claim, characterized in that the image recording device ( 1 ) is designed as an endoscope. Image pickup device ( 1 ) according to claim 9 or 10, characterized in that the temperature sensor ( 4 ) in an endoscope tip ( 15 ) and / or in an endoscope handle ( 3 ) and / or that the temperature sensor ( 4 ) to an image sensor ( 6 ) and / or to an image processing unit ( 10 ) is thermally coupled. Image pickup device ( 1 ) according to one of claims 9 to 11, characterized in that the image recording device ( 1 ) Comprises means for carrying out a method according to any one of claims 1 to 8 and / or for implementing a method according to one of claims 1 to 8 is arranged.

Images