CN103428432B - Image capturing device and image capturing method - Google Patents

Image capturing device and image capturing method Download PDF

Info

Publication number
CN103428432B
CN103428432B CN201310198318.0A CN201310198318A CN103428432B CN 103428432 B CN103428432 B CN 103428432B CN 201310198318 A CN201310198318 A CN 201310198318A CN 103428432 B CN103428432 B CN 103428432B
Authority
CN
China
Prior art keywords
information
subject
unit
display
specified
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310198318.0A
Other languages
Chinese (zh)
Other versions
CN103428432A (en
Inventor
王浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Alpha Infrared Detection Technology Co ltd
Original Assignee
Hangzhou Alpha Infrared Detection Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Alpha Infrared Detection Technology Co ltd filed Critical Hangzhou Alpha Infrared Detection Technology Co ltd
Priority to CN202010314876.9A priority Critical patent/CN111800562A/en
Priority to CN201310198318.0A priority patent/CN103428432B/en
Publication of CN103428432A publication Critical patent/CN103428432A/en
Application granted granted Critical
Publication of CN103428432B publication Critical patent/CN103428432B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses an image shooting device and an image shooting method, and relates to the field of image shooting devices and application of image shooting. The image shooting device in the prior art selects a shot object to be shot according to the subjective experience of a user, and is low in efficiency and easy to miss. The invention provides an image shooting device and an image shooting method, which specify special shot object information based on the shot object information which is stored in advance and added with a sorting sequence, particularly display the shot object indication information obtained by the special shot object information as the information prompt of the shot object which needs to be shot at present, and then switch and specify the special shot object information according to the sorting sequence when a switching instruction is sent. Therefore, the shooting speed is improved, and omission is not easy to occur.

Description

Image capturing device and image capturing method
Technical Field
The invention discloses an image shooting device and an image shooting method, and relates to the application fields of image shooting devices, image processing devices and image shooting.
Background
In the industrial field where the condition inspection is emphasized, for example, it is important to periodically perform the inspection of the equipment or the like using an imaging device such as a visible light imaging device, a thermal imaging device, or an ultraviolet imaging device.
The image shooting work is quite heavy, taking an electric power 500KV transformer substation as an example, dozens of equipment areas are usually provided, and each equipment area has dozens of objects to be shot, at present, shooting personnel select the objects to be shot according to subjective experience, the detection efficiency is low, the working strength is high, the objects to be shot are easy to be shot by mistake and missed, and the reason is as follows: the number of the objects is large, the number of the same objects is large, the shapes of the objects of different types are similar, and the objects need to be shot from a plurality of angles, so that missing detection or false detection is easy to occur. Since the application of image detection technology, there is no suitable means to conveniently realize information presentation of an object, and users are often confused in shooting, and those skilled in the art have been trying to solve this problem, for example, patent document application no: 200410001328 discloses a camera which can be used to inform the information of the identified object by receiving the wireless tag ID attached to the object, but the wireless tag is inconvenient to attach, increases the cost, and is not suitable for some occasions with large electromagnetic interference; how to guide the user to take a picture is a difficult problem.
Therefore, it is understood that there is a need for an image capturing apparatus that can conveniently provide subject presentation information for a user to capture a subject to perform image capturing. Thus, the problems existing at present are solved.
Further, for portable image capture devices, the size of the screen is limited, typically between 3.5 inches and 6 inches; when the characters of the shot object indication information are more, how to facilitate the observation of a user is also a problem of optimization consideration; when the number of the shot object information is large, how to quickly call the display without occupying the computing resources of the processor of the image shooting device is also a problem of optimization consideration.
Disclosure of Invention
The invention provides an image shooting device and an image shooting method, according to a plurality of object information with sequencing sequence, such as representing the object to be shot and the shooting sequence, the object information as special object information is appointed from the object information during shooting; particularly displaying the shot object indication information obtained by the special shot object information, taking the shot object indication information as the information prompt of the shot object needing shooting currently, and shooting the shot object after distinguishing and checking according to the cognition of the on-site shot object such as an equipment indicator and the like; the information of the shot object is not needed or is easy to search and select, and the operation is simple. Therefore, the purpose of prompting the user of the shot objects which need to be shot at present according to the preset sequencing sequence is achieved. Obviously, the shooting speed is improved, and omission is not easy to occur.
Therefore, the invention adopts the following technical scheme that the image shooting device comprises:
an acquisition unit configured to acquire image data;
an information specifying unit configured to specify subject information as special subject information based on the plurality of subject information added with the sorting order stored in the information storage unit;
a display control unit for controlling the display unit to display the video generated by the video data and displaying the subject instruction information obtained based on the special subject information specified by the information specifying unit in a special display mode;
the information specifying unit switches the specified special object information based on the sort order in response to a switching instruction operation or in accordance with a predetermined switching condition.
Still adopt following technical scheme, image shooting device includes:
an acquisition unit configured to acquire image data; an information specifying section for specifying, based on the plurality of subject information stored by the information storage section, subject information therein as special subject information for obtaining specially displayed subject instruction information; a display control unit for controlling the display unit to display the image generated by the image data or display the object indication information obtained from the special object information specified by the information specifying unit in a special display mode in response to the corresponding display instruction; the information specifying unit switches the specified special subject information in the order of the subject information in response to a switching instruction operation or in accordance with a predetermined switching condition.
Still adopt following technical scheme, image capture device includes:
an acquisition unit configured to acquire image data;
a display control unit for controlling the display unit to display the video generated by the video data and displaying a predetermined number of pieces of subject instruction information in the order of the subject information, based on the plurality of pieces of subject information added with the order stored in the information storage unit;
an information specifying section that specifies subject information as special subject information therein based on a user's selection;
the display control unit displays the subject instruction information obtained based on the special subject information specified by the information specifying unit in a special display mode.
On the basis of adopting the technical scheme, the invention can also adopt the following further technical scheme at the same time:
a task specifying unit for specifying the object information from the object information stored in the information storage unit;
an information specifying unit configured to specify subject information as special subject information from the subject information specified by the task specifying unit;
the information specifying unit switches the specified special object information based on the order of the objects specified by the task specifying unit in response to a switching instruction operation or in accordance with a predetermined switching condition.
The image shooting method of the invention comprises the following steps:
an acquisition step for acquiring image data;
an information specifying step of specifying subject information as special subject information among the plurality of subject information added with the sorting order stored in the information storage section;
a display control step of displaying, in a special display mode, subject instruction information obtained based on the special subject information specified in the information specifying step, while controlling a display unit to display a video generated by the video data;
the information specifying step switches the specified special object information based on the sort order in response to a switching instruction operation or in accordance with a predetermined switching condition.
Further, the present invention provides a computer program to be executed in a video camera, the computer program causing the video camera to execute:
an acquisition step for acquiring image data;
an information specifying step of specifying subject information as special subject information among the plurality of subject information added with the sorting order stored in the information storage section;
a display control step of displaying, in a special display mode, subject instruction information obtained based on the special subject information specified in the information specifying step, while controlling a display unit to display a video generated by the video data;
the information specifying step switches the specified special object information based on the sort order in response to a switching instruction operation or in accordance with a predetermined switching condition.
An embodiment of the present invention further provides a readable storage medium storing a computer program, wherein the computer program causes an image capturing apparatus to execute the steps of:
an acquisition step for acquiring image data;
an information specifying step of specifying subject information as special subject information among the plurality of subject information added with the sorting order stored in the information storage section;
a display control step of displaying, in a special display mode, subject instruction information obtained based on the special subject information specified in the information specifying step, while controlling a display unit to display a video generated by the video data;
the information specifying step switches the specified special object information based on the sort order in response to a switching instruction operation or in accordance with a predetermined switching condition.
Other aspects and advantages of the invention will become apparent from the following description.
Description of the drawings:
fig. 1 is an electrical block diagram of an image capturing apparatus according to an embodiment.
Fig. 2 is an external view of the image capturing device according to the embodiment.
FIG. 3 is a flow chart illustrating one control embodiment of an information schema.
Fig. 4 is a schematic diagram of an example of the subject information to which the sort order is added stored in the information storage section.
Fig. 5 is a schematic diagram of another example of the subject information to which the sorting order is added stored in the information storage section.
Fig. 6 is a display interface diagram showing an example of the subject instruction information switching front and rear display unit 4 which is particularly displayed.
Fig. 7 is a display interface diagram showing an example of the subject instruction information displayed in particular.
Fig. 8 is a display interface diagram of another example of the subject instruction information displayed in particular.
Fig. 9 is a display interface diagram of still another example of the subject instruction information which is displayed in particular.
Fig. 10 is a schematic diagram showing the distribution of objects in the equipment areas 1, 2, 3 in the substation 1 and the shooting route represented in the sorting order according to embodiment 1.
Fig. 11 is a flowchart showing another control embodiment of the information mode.
Fig. 12 is a schematic diagram of one example of a filter condition setting interface.
Fig. 13 is a schematic diagram of another example of the filter condition setting interface.
Fig. 14 is a schematic diagram of one example of the object information stored in the information storage section.
Fig. 15 is a schematic diagram of one example of object information determined according to the filtering condition set by the task.
Fig. 16 is a schematic diagram of a photographing route in which the subject information determined according to the filtering condition set by the task of embodiment 2 is photographed in the order of sorting.
Fig. 17 is a block diagram showing an electrical configuration of an image capturing system in which the image processing apparatus 100 and the image pickup apparatus 101 of embodiment 3 are connected.
Fig. 18 is a schematic diagram of an implementation of an image capturing system in which the image processing device 100 and the image capturing device 101 are connected.
Detailed Description
The following describes an embodiment of the present invention, although in embodiment 1, an image capturing apparatus with an image capturing function (hereinafter, simply referred to as an image capturing apparatus) is exemplified. But may also be applied to an image capturing apparatus that continuously receives image data, such as a personal computer, a personal digital processing apparatus, or other processing apparatus.
The video data is not limited to the AD value data of the video, and may be, for example, data obtained by subjecting the video data to predetermined processing, for example, image data, or compressed data obtained by mixing one or more of these data.
Exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. Note that the following examples are to be described for better understanding of the present invention, so the scope of the present invention is not limited and various forms within the scope of the present invention may be changed.
Fig. 1 is an electrical block diagram of an imaging device according to embodiment 1. Fig. 2 is an external view of the portable imaging device according to embodiment 1.
The imaging device 13 includes an imaging unit 1, an image processing unit 2, a display control unit 3, a display unit 4, a communication I/F5, a temporary storage unit 6, a memory card I/F7, a memory card 8, a flash memory 9, a control unit 10, and an operation unit 11, and the control unit 10 is connected to the above-described relevant parts via a control and data bus 12 and is responsible for overall control of the imaging device 13.
In one embodiment, the image pickup unit 1 is composed of an optical member, a lens driving member, an image sensor, a signal preprocessing circuit, and the like, which are not shown, as an example of a visible light image pickup device. The optical member is composed of an optical lens, and a subject image is incident on the image sensor from the optical member. The lens driving unit drives the lens to perform focusing or zooming operations according to a control signal of the control unit 10, and may be a manually adjusted optical unit. The image sensor is configured by, for example, a CMOS image sensor, and converts an object image passing through an optical component into an electric signal. The signal preprocessing circuit includes a sampling circuit, an AD conversion circuit, and the like, and performs signal processing such as sampling, automatic gain control, AD conversion, and the like on an electric signal generated from the image sensor at a predetermined cycle; as a result of various signal processes, digital video data (video AD value data) is generated. In the present embodiment, the imaging section 1 is an example of an acquisition section for capturing and obtaining (digital) image data. An image processing unit 2 for performing a predetermined process on the video data obtained by the imaging unit 1 to obtain video image data; for example, various image processing such as white balance compensation processing, Y compensation processing, and YC conversion processing is performed to generate image data including a digitized luminance signal and color difference signals. Further, the image processing unit 2 is configured to obtain image data of a video by performing predetermined processing on the video data based on control by the control unit 10, and then record the image data of the video on a recording medium such as the memory card 8. The image processing unit 2 may be implemented by a DSP, another microprocessor, a programmable FPGA, or the like, or may be integrated with or the same as the control unit 10. The image processing section 2 converts digital image data into data suitable for display, recording, and the like in various types of imaging devices, not limited to visible light imaging devices.
When the imaging device 13 is a variety of different types of imaging devices, there are differences in optical components, image sensors, and the like, and differences in image processing methods. In one embodiment, when the imaging device 13 is a thermal imaging device, the imaging unit 1 is configured by an optical component, a lens driving component, an infrared detector, a signal preprocessing circuit, and the like, which are not shown. The optical component is composed of an infrared optical lens for focusing the received infrared radiation to the infrared detector. The lens driving part drives the lens to perform focusing or zooming operation according to a control signal of the control part 10. An infrared detector, such as a refrigeration or non-refrigeration type infrared focal plane detector, converts infrared radiation passing through the optical components into electrical signals. The signal preprocessing circuit includes a sampling circuit, an AD conversion circuit, and the like, performs signal processing such as sampling and automatic gain control on a signal read from the infrared detector at a predetermined cycle, and converts the signal into digital (thermal) image data by the AD conversion circuit. The image processing unit 2 performs predetermined processing on the (thermal) image data obtained by the imaging unit 1, and the image processing unit 2 performs processing for converting the data into data suitable for display, recording, and the like, such as correction, interpolation, pseudo-color, compression, decompression, and the like. In one embodiment, the corresponding pseudo color plate range is determined according to the range of the AD value of the (thermal) image data or the set range of the AD value, and the specific color value corresponding to the AD value of the (thermal) image data in the pseudo color plate range is used as the image data of the corresponding pixel position in the thermal image (infrared thermal image).
These differences do not make a significant difference in the following embodiments. The following embodiments are applicable to general image capturing devices, such as various types of imaging devices, e.g., visible light capturing devices, thermal imaging devices, ultraviolet capturing devices, laser imaging devices, etc., or devices that include more than one capturing function of the above devices, i.e., the image capturing devices may have a plurality of image sensors of the same type or different types.
The display control unit 3 performs display of the image data for display stored in the temporary storage unit 6 on the display unit 4 based on the control of the control unit 10. For example, in the present embodiment, in the normal mode, a video generated from video data obtained by shooting is continuously displayed; in the information mode, the subject instruction information and the video (including the moving video and the still video) to be displayed in particular are displayed at the same time, and in the reproduction mode, the video read out from the memory card 8 and expanded is displayed, and various setting information can be displayed. Specifically, in one embodiment, the display control unit 3 includes a VRAM, a VRAM control means, a signal generation means, and the like, and based on the control of the control unit 10, the signal generation means periodically reads the image data read from the temporary storage unit 6 and stored in the VRAM from the VRAM via the VRAM control means, generates a display signal such as a video signal, outputs the display signal, and displays the display signal on the display unit 4; in the present embodiment, the display section 4 is taken as an example of the display section 4. The display unit 4 may be another display device connected to the imaging device 13, and the imaging device 13 itself may have no display device in its electrical configuration. Obviously, when the display device is not present in the electrical configuration of the video device 13 itself, the control unit 10 may control the output of the image data for display, for example, the image data for display may be output through an image output interface (for example, various wired or wireless image output interfaces such as an AV port and an RJ45 port) (the control unit 10, the display control unit 3, and the like are examples of the display control unit); the display control unit controls the display unit to display the image, including the display output. The display control unit 3 may be integrated with the image processing unit 2 or the control unit 10.
The communication I/F5 is an interface for connecting the video device 13 to an external device such as an external computer, a storage device, or a video device in accordance with a communication specification such as USB, 1394, or a network.
The temporary storage unit 6 is a volatile memory such as a RAM or a DRAM, and functions as a buffer memory for temporarily storing the image data output from the imaging unit 1, and also functions as a work memory for the image processing unit 2 and the control unit 10, and temporarily stores data processed by the image processing unit 2 and the control unit 10. Not limited to this, a memory, a register, or the like included in a processor such as the control unit 10 or the image processing unit 2 may be interpreted as a type of temporary storage unit.
The memory card I/F7 is connected to the memory card I/F7 as an interface of the memory card 8, and the memory card 8 as a rewritable nonvolatile memory is detachably mounted in a card slot of the main body of the video apparatus 13, and data such as video data is recorded under the control of the control unit 10.
The flash memory 9 stores therein a program for control and various data used in control of each part.
An information storage section for storing a plurality of pieces of subject information to which a sort order representing a sort order among the plurality of pieces of subject information is added. The information storage unit may be a storage medium in the imaging device 13, such as a nonvolatile storage medium such as the flash memory 9 and the memory card 8, or a volatile storage medium such as the temporary storage unit 6; the storage medium may be any other storage medium connected to the imaging device 13 by wire or wirelessly, such as a storage medium in another storage device that performs communication by wire or wirelessly connecting to the communication I/F5, another imaging device, or a computer. Preferably, the subject information is stored in advance in the imaging device 13 or in a nonvolatile storage medium connected thereto. It is to be noted that the plurality of pieces of stored subject information to which the sort order is added may be generated by an external computer (for sorting the subject information, or for recording the sort order number) and stored in the information storage unit, or may be completed in the video device (for sorting the subject information, or for recording the sort order number) and stored in the information storage unit.
The subject information is information related to a subject, and includes, for example, information representing a subject location, a type, a number, and the like, and various information related to a subject, such as an attribution unit, a classification level (for example, a voltage level, an importance level, and the like), a model number, a manufacturer, performance, and characteristics, a history of past shooting or inspection, a manufacturing date, and a lifetime.
Preferably, various information in the subject information is configured in a form of information classification, and as an implementation drawing in which the exemplary list representative information storage unit shown in fig. 4 stores subject information, each of the subject information is configured by attribute information of a plurality of predetermined attributes, such as the subject information 400 "substation 1 equipment area 1 device ic phase" having attribute information "substation 1" corresponding to the substation attribute 401, attribute information "equipment area 1" corresponding to the equipment area attribute 402, attribute information "device i" corresponding to the device type attribute 403, and attribute information "C phase" corresponding to the phase attribute 404.
In another embodiment in which the information storage unit represented by the exemplary list shown in fig. 5 stores subject information, the subject information 500 "substation 1 device area 1 ic phase" includes information representing a substation, a device area, a device type, and a phase to which the subject belongs, but does not store the information in the form of information classification as shown by the subject information 400 in fig. 4.
The ordinal numbers of the sort orders in fig. 4 and 5 represent the sort orders to which these pieces of subject information are attached (including associated); the added sort order is, for example, recognizable sort order information such as numerals, letters, codes, and the like, which may be added as attribute information of the subject information; or may be added as index information corresponding to the object information; or storing the subject information at a predetermined address in the data file or in the storage medium, or may be a form to which the sort order information is added; preferably, the added sort order represents the shooting order of the objects corresponding to the object information added with the sort order, and the sort order information may be a sort order representing the shooting order, which is preset in the external computer or the imaging device 13 and is formed by arranging the object information according to the shooting path L10 in fig. 10, for example, the object information with the sort order obtained by inputting the object information according to a predetermined input order, for example, the number representing the sort order is set, and for example, the sort order (for example, a sort rule of time, a sort rule of letters, and the like) is arranged to obtain the object information added with the sort order.
The operation unit 11: the user performs various operations such as a switching instruction operation, a recording instruction operation, or input of setting information, and notifies the control unit 10 of an operation signal, and the control unit 10 executes a corresponding program based on the operation signal from the operation unit 11. For example, the operation unit 11 is configured by the recording key 1 (configured to perform a recording instruction operation), the switching key 2 (configured to perform a switching instruction operation of the object information), the focus key 3, the confirmation key 4, the cross key 5, and the like shown in fig. 2, and is not limited thereto, and may be implemented by the touch panel 6, the voice recognition means, and the like.
The control unit 10 controls the overall operation of the imaging device 13, and the flash memory 9 stores a program for control and various data used for controlling each part. The control program causes the control section 10 to execute control of processing in a plurality of modes, and when the power is turned on, the control section 10 initializes an internal circuit and then enters a standby shooting mode, that is, the shooting section 1 shoots and obtains image data, the image processing section 2 performs predetermined processing on the image data shot and obtained by the shooting section 1 and stores the image data in the temporary storage section 6, and the control section 10 executes control of the display control section 3 to continuously display images on the display section 4 in the form of moving images, and in this state, the control section 10 performs control to continuously monitor whether or not processing in another mode is switched to or shutdown operation is performed according to a predetermined condition, and if so, enters corresponding processing control. The control unit 10 is realized by, for example, a CPU, an MPU, an SOC, a programmable FPGA, or the like.
In the present embodiment, the control section 10, as an information specifying section, displays an example of a control section and a progress statistic section. In this embodiment, a scene in which a user takes images of a subject whose device types are device i, device ii, and device iii in a device area 1(1001), a device area 2(1002), and a device area 3(1003) in a substation 1 shown in fig. 10 is taken as an example; before the main shooting, data files of the subject information to which the sort order is added are stored in advance in the flash memory 9 (or in a storage medium such as the memory card 8 or the temporary storage unit 6). The present embodiment is explained with reference to fig. 3 to 10. Referring to fig. 3, the control steps are as follows:
in step S101, the control unit 10 performs control to continuously detect whether the user selects the information mode through the operation unit 11.
If yes, go to step S102; the control section 10 transfers the subject information (partially or entirely) added with the sort order stored in the flash memory 9 to the temporary storage section 6, and the transferred subject information may be all of the subject information or predetermined partial information, for example, predetermined partial information for obtaining subject instruction information. Further, after the power is turned on, the information may be transferred to the temporary storage unit 6.
In step S102, object information as special object information is specified.
An information specifying unit (control unit 10) for specifying subject information as special subject information based on the subject information added with the sorting order stored in the information storage unit; in a preferred embodiment, the first object information "substation 1 device area 1 device ic phase" in the ranking order is designated as the special object information based on the ranking order, and the process proceeds to step S103.
In another embodiment, the control unit 10 monitors whether or not there is an operation instruction to select the special object information; here, in a case where the operation instruction is confirmed, the subject information corresponding to the selected subject instruction information is designated as special subject information; a display control unit for controlling the display unit to display a predetermined number of pieces of subject instruction information based on the plurality of pieces of subject information added with the sort order stored in the information storage unit; an information specifying unit specifies subject information as special subject information based on a user's selection. For example, in the object instruction information shown in the object information display field in the display interface 601 of fig. 6, the user can select one of the object instruction information through the operation unit 11, and the control unit 10 designates the object information corresponding to the object instruction information as the special object information. In addition, the user can also enter a display interface of new shot object indication information by means of page turning, scroll bar moving and the like, select the shot object indication information and specify special shot object information; further, the subject information as the special subject information may be specified from the starting point of the previously default sorting order, for example, the subject information as the special subject information which was last specified when used last time, and the subject information next to the sorting order thereof as the currently specified starting point.
Step S103 of transferring the image data obtained by the imaging unit 1 to the temporary storage unit 6; the image processing unit 2 performs a predetermined process on the image data captured by the imaging unit 1 to obtain image data of a video, and stores the image data in the temporary storage unit 6.
In step S104, the control unit 10 controls the display unit 4 to display the video generated from the video data and to display the specified subject instruction information obtained from the specified subject specifying information.
Here, the common display of the subject instruction information and the video on the display interface may be superimposed on the video and/or may not be superimposed on the video.
The special display is, for example, as shown in fig. 7, as the object instruction information obtained by displaying only the specified special object information.
The special display is, as when the subject instruction information obtained by the prescribed number of subject information not limited to the special subject information is displayed, wherein the subject instruction information obtained from the specified special subject information is specially displayed in a display manner distinguished from other subject instruction information.
In a preferred embodiment, the display control unit controls the display unit 4 to display the video generated from the video data, and displays the subject instruction information obtained from the specified special subject information in a display manner distinguished from other subject instruction information, based on the subject information added with the sort order stored in the information storage unit (determined by the task determination unit when there is the task determination step), and a predetermined number of pieces of the subject instruction information are displayed in the sort order.
As shown in the display interface 601 in fig. 6, the control unit 10 controls to display object instruction information obtained by displaying a predetermined number of pieces of object information in order, and the underlined mark of "substation 1 equipment area 1 device ic phase" may be distinguished from other pieces of object instruction information, or may adopt a special display mode distinguished from other pieces of object instruction information by a difference in display position, color, background, size, font, caption, or the like which is easily recognized by a user, and perform caption "taking with the object instruction information displayed specially as shown in fig. 8: and a display interface of the 1 equipment zone 1 equipment IC phase of the transformer substation 1.
In another preferred embodiment, the display control unit displays predetermined information for generating the subject instruction information among the subject information in a hierarchical manner, that is, in a predetermined hierarchy and attribute information corresponding to each hierarchy. The hierarchical display is, for example, a tree display, and as shown in a subject information display column 901 in fig. 9, the control section 10 displays the subject instruction information in three layers in predetermined positions in accordance with attribute information of predetermined attributes of a substation, a device area, a device type, and the other; the subject indication information 902 displayed in particular is also superimposed on the image, which is easy for the user to observe.
Specifically, in one embodiment of the display control, the image processing unit 2 is controlled to combine image data of a video created by capturing obtained video data with image data of subject instruction information obtained by specifying particular subject information; storing the synthesized image data in a temporary storage unit 6; then, the display control unit 3 is controlled to display the synthesized image data on the display unit 4. As shown in fig. 7, the composition superimposes the subject instruction information on the video at a predetermined transparency ratio. When there is other predetermined instruction information, the control image processing section 2 combines image data of a video created by capturing the obtained video data, image data of specially displayed object instruction information obtained by specifying the special object information (including image data of a drawn line including a mark when there is a mark to be specially displayed), and image data of other predetermined instruction information; and controls the display control section 3 to display the synthesized image data on the display section 4, and this synthesis combines the subject information display field of the subject instruction information with the video as shown in fig. 6. Other instruction information includes a predetermined number of pieces of subject information, and instruction information such as date and battery capacity displayed on the display unit.
The object instruction information obtained from the object information may be obtained as all or a predetermined part of the object information, and the configuration of the information for obtaining the object instruction information in the object information may be predetermined.
Wherein the control section 10 functions as a progress counting section for counting the shooting progress information on the basis of the number of the subject information to which the sorting order is added (determined based on the task determining section when there is the task determining step) stored in the information storage section and the currently specified special subject information; the control section 10 controls the display of progress information, such as progress information 603 displayed in the display interface 601 and progress information 604 displayed in the display interface 602 in fig. 6; note that, in fig. 6, in the case where the order indication information (number) of the specifically designated subject information has already been displayed, the number may also constitute progress information with the total number "15" of the displayed subject information.
Note that the sort order corresponding to the subject information may be displayed or not, and in fig. 6, order instruction information (serial number) obtained from the sort order information corresponding to the subject information to which the sort order is added stored in the information storage unit (when the task determination unit determines that there is a task determination step), is displayed.
In step S105, the control unit 10 determines whether or not a switching instruction operation is performed, and if not, repeats the steps of steps S103 to S105, and displays the object instruction information together with the continuous moving image, and if a switching instruction operation of the object information is performed, the process proceeds to step S106.
The user takes specially displayed object prompt information 'substation 1 equipment area 1 equipment IC phase' as the prompt information for shooting the current object to check and shoot the corresponding object; when the user finishes shooting the subject, the user presses the switching key 2 (a key representing a switching instruction operation) of the operation section 11 to realize the one-key operation completion of the switching instruction operation, and the user does not need to look at the subject information shown in the display interface 601 in fig. 6 to perform selection or search, so that the operation is simple.
Further, the control unit 10 may be configured to perform the switching operation based on a predetermined switching condition; for example, when it is determined that a predetermined time interval is satisfied, for example, when an analysis value of an image exceeds a predetermined threshold (for example, a temperature in a thermal image exceeds a predetermined threshold), or when a predetermined switching condition such as a trigger signal of a device connected to the imaging device 13, for example, another sensor device is received, the process automatically proceeds to step S106 even if the switching instruction operation of the operation unit 11 is not performed; the predetermined switching condition may include a process of performing a switching designation when another predetermined condition, for example, a predetermined time interval is satisfied, is satisfied even if the switching instruction operation of the operation unit 11 is performed.
In step S106, the control unit 10 determines whether or not the task is completed.
In response to the switching instruction operation, the control section 10 judges whether or not the designation of the last subject information in the sorting order sequence is completed; if not, the process returns to step S102, and at this time, the designated special object information is switched in the order of the order based on the object information to which the order is added, which is stored in the information storage unit. If the operation is finished, the current information mode is finished, characters such as 'task completion' and the like can be displayed on the screen, and then the image device returns to the standby state and waits for the user to enter the operation of other modes. Alternatively, the imaging may be performed by switching to a predetermined starting point of the sort order, for example, the starting point of the sort order.
Specifically, in one embodiment, the information designating unit (control unit 10) adds 1 to the sequence number of the sorting order corresponding to the special subject information designated before the switching, and then determines whether the last one in the sorting order sequence is completed, and if the last one in the sorting order sequence is not completed, searches for and designates the subject information corresponding to the sequence number of the sorting order obtained by adding 1 to the sequence number of the sorting order as the special subject information; and if the operation is finished, exiting. Further, it is not necessary to judge whether or not the designation of the last object information in the sorting order sequence is completed, and it may not be judged that the information mode is ended until a prescribed timing is exceeded or until the control section 10 receives an exit instruction, every time the switching instruction operation is received, that is, the object information corresponding to the sorting order number obtained by adding 1 to the sorting order number is designated as the special object information, and when the special object information is not found, the 1 is continuously added for the search until the prescribed timing is exceeded.
Returning to step S102, the information specifying unit switches the specified special object information based on the sort order. (i.e., switching the specified object information as the special object information).
In a preferred embodiment, the information specifying unit switches the single object information specified as the special object information from the single object information specified as the special object information before switching to the next object information in the sorting order sequence (the sorting order sequence of the object information determined by the task determining unit when there is the task determining step). For example, in this example, the single object information designated as the special object information is switched from the single object information "substation 1 equipment area 1 device ic phase" designated as the special object information before switching to the next object information "substation 1 equipment area 1 device ib phase" in the sorted order "designated as the special object information before switching.
The display control unit controls the display unit to display the video generated by the video data, and displays the subject instruction information obtained by switching the designated special subject information by the information designating unit in a special display mode. As shown in the display interface 602, the subject instruction information "substation 1 equipment area 1 device ib phase" obtained by switching the specified special subject information "substation 1 equipment area 1 device ib phase" by the information specifying unit is displayed in a special display manner. The progress information 603 displayed in the display interface 601 is changed to the progress information 604 displayed in the display interface 602. The user can shoot the corresponding shot object according to the specially displayed shot object indication information of the equipment I B phase of the equipment area 1 of the transformer substation 1. This allows the user to easily perform imaging through the imaging path L10 shown in fig. 10, and thus the user is less likely to miss an object.
The information specifying unit switches the single object information specified as the special object information from the object information specified before switching as the special object information to the object information specified before switching as the last object information in the sorting order. The switching is performed based on the sort order, which may be the order of the sort order sequence or the reverse order, and it may be specified whether the switching is performed in the order of the sort order or the reverse order.
Further, when the information specifying section specifies the subject information as the special subject information as two or more pieces of subject information adjacent in order; the information designating unit sorts the specified specific number of pieces of the adjacent object information by the specific number of pieces of the adjacent object information designated before switching to the specific number of pieces of the adjacent object information starting from the next object information in the sorted order series of the specified object information designated before switching.
For example, when "equipment zone 1 of substation 1, equipment zone 1, equipment ib of substation 1, and" equipment zone 1, equipment ia phase of substation 1 "are designated at the same time, in response to the switching instruction operation, the switching designation" equipment zone 1 of substation 1, equipment ia, equipment zone 1 of substation 1, equipment iib of substation 1, and equipment zone 1, equipment iic phase of substation 1 "are used as the special subject information.
Further, when the information specifying section specifies the subject information as the special subject information as two or more pieces of subject information adjacent in order; there may also be cases where switching is done in reverse order.
It should be noted that in this embodiment, the example is described with a small number of pieces of object information, and in an actual image capturing operation, the number of objects is large, and the effect of the embodiment of the present invention is significant.
Similarly, for complex equipment or the situation that multi-angle shooting is needed, relevant shot object information and the sequencing sequence thereof can be prestored for shot objects (such as components, angles and the like) needing to be shot independently, and omission of shot parts can be avoided.
As described above, the user recognizes the subject or views the device identification plate by specifying the special subject information based on the plurality of pieces of subject information stored in advance and added with the sort order, and displaying the subject instruction information and the image obtained by the special subject information on the display unit 4, and using the specially displayed subject instruction information as the instruction information of the subject currently being photographed, thereby reducing the number of erroneous photographing; when a switching instruction operation is performed, that is, the specified special subject information is switched in the sorting order, and the subject instruction information obtained by switching the specified special subject information by the information specifying section is displayed in a special display manner. The purpose of prompting the user of the shot objects to be shot at present according to the sequencing sequence is achieved, the conditions of wrong paths or disorder are greatly reduced, and omission is avoided; thereby improving the shooting efficiency, reducing the working strength and being simple to operate. Wherein, through the display of the statistical shooting progress information, the user can reasonably arrange the shooting progress. In summary, example 1 is a preferred embodiment, although it is not necessary that all of the above advantages be achieved simultaneously in any one product that embodies the invention.
Example 2
In the present embodiment, in the imaging device 13 having the same configuration as that shown in fig. 1, a control program for setting a filter condition by a user and a control program for specifying object information based on the filter condition are stored in the flash memory 9, and the current shooting task is to shoot an object whose object type is the object i in the substation 1. In the past, when the detection purposes are different, all objects in the whole station are detected, and specific types of objects are also detected, and the specific types of objects are distributed in different equipment areas, so that a user needs to search for the objects, and the detection is very inconvenient.
The present embodiment is explained with reference to fig. 11 to 16.
In step S201, the control unit 10 performs control to continuously monitor whether the user selects the information mode through the operation unit 11, and if so, the process proceeds to step S202.
Step S202, setting filtering conditions;
and a task setting part for setting a filtering condition by a user, wherein the filtering condition is composed of a keyword related to the filtering condition and a filtering logic relation.
The task setting part is provided with a keyword determining unit, a logic determining unit and a filtering condition generating unit, wherein the keyword determining unit is used for determining keywords related to filtering conditions; a logic determination unit for determining a filtering logic relationship of the keywords related to the filtering condition; and a filtering condition generating unit for generating a filtering condition according to the keywords related to the filtering condition and the specified filtering logic relation.
The keyword related to the filtering condition may be one keyword or a plurality of keywords; wherein the plurality of keywords includes representing a range of keywords such as a numeric range, an alphabetical range, a sort order range, a time range, and the like. In addition, when the subject information includes various information such as the attribution unit, classification level (for example, voltage level, importance level, etc.), model, manufacturer, performance, and characteristics, history of past shooting or inspection, date of manufacture, and lifetime, which are related to the subject, the keyword may be determined from the information to set the filtering condition.
A keyword determination unit for determining a keyword related to the filtering condition; for example, one or more of the following embodiments may be combined to determine keywords related to filtering conditions.
One embodiment, for example, pre-stored keywords, determines keywords associated with the filter criteria based on user selection. As when the subject information as shown in fig. 5 is stored in the information storage portion, keywords for selection may be prestored, and the keyword selected by the user is determined as the keyword related to the filter condition.
One embodiment, for example, defaults to one or all of the keywords associated with the filter criteria.
One embodiment, for example, enters keywords by the user, and determines the keywords entered by the user as keywords related to the filter condition.
One embodiment, for example, provides a selection item of the selected keyword attribute, and determines the keyword corresponding to the keyword attribute as the keyword related to the filtering condition based on the keyword attribute selected by the user; this is the case where when some of the subject information has attribute information of a specific attribute, and other portions of the subject information do not have attribute information of the specific attribute, the subject information can be conveniently filtered.
In a preferred embodiment, a keyword for obtaining attribute information of a predetermined attribute in the subject information is searched based on the subject information stored in the information storage unit, and the keyword related to the filter condition is specified based on a selection of a user.
Specifically, the control unit 10 controls the display unit 4 to display a keyword menu item of a keyword query configured to represent attribute information of a predetermined attribute, such as the substation 1203, the device area 1204, and the device type 1205, on the filter condition setting interface illustrated in fig. 12. When the information storage unit stores the subject information as shown in fig. 14, the control unit 10 searches the subject information stored in the information storage unit based on the device type 1205 selected by the user in accordance with the "subject i" shot this time, obtains the keywords "subject i, subject ii, device iii …" of the attribute information of the predetermined attribute (device type), causes the display list 1206 to be displayed, and the user selects "subject i" from among them, and the keyword determination unit determines "subject i" as the keyword related to the filter condition. Here, the display section 4, the operation section 11, and the control section 10 constitute an example of a task setting section; in this embodiment, when the types of keywords of the attribute information of the subject information are large, the operation becomes complicated.
In still another preferred embodiment, the keyword determination unit determines a keyword search condition, searches for a keyword that obtains attribute information of a predetermined attribute in the subject information that matches the keyword search condition based on the subject information stored in the information storage unit, and determines a keyword related to the filter condition based on a user's selection; wherein the keyword query condition is one or more of the keywords related to the filtering condition determined before.
Specifically, when the object information as shown in fig. 14 is stored in the information storage portion, the object information of some other substation is also included, unlike the case of fig. 4. The control unit 10 causes the display unit 4 to display a filter condition setting interface in the setting operation, as shown in the example of fig. 13, and when the user selects the substation 1303 via the operation unit 11, the control unit 10 inquires about keywords of attribute information of attributes of the substation based on the subject information stored in the information storage unit, and causes the list 1306 to be displayed; the user selects "substation 1" from among them, and the control unit 10 determines "substation 1" as a keyword related to the filter condition; then, when the device type 1305 is selected, the control section 10 determines "substation 1" selected by the user as a keyword query condition, and queries a keyword of attribute information that meets the device type attribute of the subject information of "substation 1", so that a list 1307 of "subject i, subject ii, and device iii" is displayed, and the user selects the device type "subject i" from the list; the control unit 10 specifies "the substation 1" and "the object i" as keywords relating to the filtering condition. Obviously, this way, the number of keywords to be selected will be simplified.
A logic determination unit for determining a filtering logic relationship of the keywords related to the filtering condition; the filtering logical relationship may be that when the keyword related to the filtering condition is a keyword, the filtering of the keyword is a non-relationship; when the keywords related to the filtering condition are a plurality of keywords, the keywords are the combination of AND, OR, NOT logical relationship and filtering NOT relationship among the keywords; the logical relationship between the filter non-relationship and the keyword may be a default or may be determined according to user settings.
An example of a keyword, such as a keyword relating to a filtering condition being a keyword "subject i", in fig. 12, the options "yes" 1201 and "no" 1202 of the shooting condition are used to set the filtering non-relation; when yes is selected, the filtering condition generated by combining the keyword 'subject I' is used for subsequent searching and determining subject information meeting the 'subject I' as a shooting task; when 'not' is selected, the filter condition generated in combination with the keyword 'subject i' is used for subsequent search to determine subject information conforming to the 'subject i' that is not. In this case, the logic determination unit determines the filtering non-relationship as "yes" according to the default filtering non-relationship as "yes". When the user specifies the filtering condition through the operation unit 11, the filtering condition generating means (control unit 10) generates the filtering condition by combining the default filtering non-relationship "yes" with the keyword "subject i" selected by the user. At the time of task determination, object information conforming to the keyword "object i" is searched for as determined object information.
Examples of the plurality of keywords such as "substation 1" and "subject i" as the keywords related to the filtering condition, in fig. 13, the logic determination unit determines the filtering non-relationship as "yes" according to the default filtering non-relationship, and determines the logical relationship of the keywords "substation 1" and "subject i" as "and" according to the default logical relationship (the keywords of different attributes are "and" relationship "); when the user specifies the filtering condition through the operation unit 11, the filtering condition generating means (control unit 10) combines the keywords "substation 1" and "subject i" related to the filtering condition with the default logical relationship "and combines the default filtering with the non-relationship" yes "to generate the filtering condition. At the time of task determination, object information conforming to the keyword "substation 1" and conforming to the "object i" will be searched as determined object information.
The generated filter condition is recorded in the temporary storage unit 6 or in the flash memory 9 or the like (for example, a configuration file is generated) for later use.
In step S203, the task determination section determines subject information from the subject information stored in the information storage section, the determined subject information being used to specify the special subject information therefrom, which can be understood as the subject information included in the shooting task.
If "substation 1" and "equipment area 1" are used as the filter conditions, when the information storage section stores the subject information as stored in fig. 14, the subject information that matches the keyword "substation 1" and that matches "subject i" is searched as the determined subject information.
The determined subject information is shown in fig. 15, in which the number of shooting tasks for the other substations, "equipment area 2", and "equipment ii", "equipment iii", is reduced to "6" compared to before the task determination.
Obviously, the shooting path in the specific shooting task is simplified, and the user looks at the information of the equipment area in the shot object indication information, so that the searching work of the equipment I in the equipment area 2 is avoided, and the working strength is reduced.
Further, step S202 is not essential, and the task determination section may determine subject information that meets the filter condition based on a pre-stored filter condition as a default; further, there are embodiments in which the task determination is performed, for example, when a plurality of data files (each including subject information to which a sort order is added) are stored in advance in the flash memory 9 (or the memory card 8), a user is provided to select a data file, and the subject information in the data file selected by the user is determined as the subject information included in the shooting task; further, the object information may be determined based on a user's selection of a plurality of object information.
Step S204 of specifying special subject information; an information specifying unit that specifies subject information as special subject information from the plurality of subject information specified by the task specifying unit.
The control unit 10 controls to designate, as the special object information, the object information "substation 1 equipment area 1 device ic phase" at the top of the added sort order among the plurality of pieces of object information thus determined, and proceeds to step S205.
Step S205 of transferring the image data obtained by the imaging unit 1 to the temporary storage unit 6; the image processing unit 2 performs a predetermined process on the image data captured by the imaging unit 1 to obtain image data of a video, and stores the image data in the temporary storage unit 6.
In step S206, the subject instruction information obtained from the special subject information is displayed on the display unit 4 together with the video.
In step S207, the control unit determines whether or not a switching instruction operation is performed, and if not, the steps S205 to S207 are repeated, and if a switching instruction operation is performed, the process proceeds to step S208.
In step S208, the control unit 10 determines whether or not the task is completed.
If the shooting mode is finished, the current information indicates that the shooting mode is finished, the image device returns to the standby state, and the user waits for entering the operation of other modes. If not, the process returns to step S204, and switches the designated special object information based on the sort order added to the object information determined by the task determination unit.
Specifically, in one embodiment, the information specification unit (control unit 10) adds 1 to the serial number of the sorting order corresponding to the specific object information specified before the switching, and then determines whether the last one of the sorting orders is completed, if not, searches for the object information corresponding to the sorting order serial number obtained by adding 1 to the sorting order serial number (among a plurality of object information determined by the task determination unit shown in fig. 15), specifies the searched object information as the specific object information, and if not, continues adding 1 and continuing the search until the searched object information is found; and so on; and when the judgment is finished, ending.
In another embodiment, the determined object information is added with the serial numbers of 1, 2 and 3 … temporarily according to the sequence order, then the serial number of the appointed object information before switching is added with 1, whether the last one of the temporary serial numbers is finished is judged, if not, the corresponding object information after adding 1 to the serial number is searched and designated as the special object information, and if the judgment is finished, the operation is finished. Similarly to embodiment 1, it is not essential to determine whether or not the designation of the last object information is completed.
Returning to step S204, the information specifying unit switches the specified special object information based on the sort order added to the object information specified by the task specifying unit.
Wherein the specified special subject information is switched; in a preferred embodiment, the information specifying unit switches the single object information specified as the special object information from the single object information specified as the special object information before switching to the next object information in the sorting order sequence (the sorting order sequence of the object information specified by the task specifying unit) of the object information specified as the special object information before switching.
Further, the information specifying unit switches the single object information specified as the special object information from the object information specified before switching as the special object information to the object information that is one of the object information specified before switching in the sorting order sequence (the sorting order sequence of the object information determined by the task determining unit). The switching is performed based on the sorting order, which may be the order of the sorting order sequence or the reverse order.
Further, when the information specifying section specifies the subject information as the special subject information as two or more pieces of subject information adjacent in order; the information specifying unit changes the specified specific number of pieces of the object information to be sorted adjacent to each other, which is specified before the change, from the specified specific number of pieces of the object information to be sorted adjacent to each other, which is specified before the change, to the specified specific number of pieces of the object information to be sorted adjacent to each other, which is starting from the next piece of the object information to be specified before the change in the sorting order sequence (the sorting order sequence of the object information specified by the task specifying unit). Further, there may be a case where switching is performed in the reverse order.
In this embodiment, when the user finishes shooting the device i in the device area 1, the user will go to the device i in the shooting device area 3, and the device i in the device area 2 is prevented from being searched, and the shooting path of the device areas 1(1601), 2(1602), 3(1603) in fig. 16 is changed from L10 in fig. 10 to L16 in fig. 16.
In the embodiment, after entering the information mode, task setting is performed; however, it is also possible to perform task setting separately and then enter the information mode, for example, to record the filter condition or the subject information determined based on the filter condition and the sorting order thereof in the information storage unit, for example, to generate a profile for subsequent use. Further, a plurality of task settings may be performed. Further, the filtering condition setting step and the task determining step are set forth in steps, but may be configured to be an immediate progressive process, that is, when one of the filtering conditions is set, the task determining section determines the subject information in accordance with the filtering condition, and when the setting is completed, the task determining section completes the determination of the subject information in accordance with the filtering condition; when the setting is determined, processing proceeds to a specifying step of the special subject information. It is obvious that many more embodiments can be obtained by different combinations.
As described above, by setting the filtering condition of the subject information in the shooting task, the display of redundant information can be reduced, the displayed subject indication information is more instructive, the shooting path is simplified, and the purposes of reducing strength, improving efficiency and avoiding omission are achieved. Obviously, when various filtering conditions are set, great convenience is brought to shooting of a user. If the object information has the attribute information of the history (such as the past defect situation), the user can quickly find the related information of the defect object by inquiring the defect situation, thereby being convenient for the retest.
Example 3
The present invention is applied to the imaging device 13 having a photographing function in the above-described embodiments, and is also applicable to an image processing device or the like that receives and processes image data from the outside. The present embodiment takes the image processing apparatus 100 as an example of an image capturing apparatus.
In the embodiment, the image capturing device 101 is mounted on the inspection vehicle by a cradle head or the like, and is connected to the image processing device 100 via a communication line such as a dedicated cable or a wired or wireless lan. The user views the subject image through the image processing apparatus 100. The image capturing device 101 is connected to the image processing device 100 to constitute an image capturing system in the embodiment.
Fig. 17 is a block diagram showing an electrical configuration of an embodiment of an image capturing system in which the image processing apparatus 100 and the image pickup apparatus 101 are connected.
The video processing apparatus 100 includes a communication interface 1, an auxiliary storage unit 2, a display control unit 3, a display unit 4, a hard disk 5, a temporary storage unit 6, an operation unit 7, and a CPU8 connected to the above components via a bus to perform overall control. The image processing apparatus 100 may be a computer or a dedicated processing apparatus. The image processing apparatus 100 receives image data output from the image capturing apparatus 101 connected to the image processing apparatus 100 via the communication interface 1 under the control of the CPU 8. The communication interface 1 is used for continuously receiving image data output by the image acquisition device 101; the method comprises the steps of receiving image data (transmitted by the relay device through the image data output by the image acquisition device 101) transmitted by the relay device; meanwhile, the device can also be used as a communication interface for controlling the image acquisition device 101. Here, the communication interface 1 may be various wired or wireless communication interfaces on the image processing apparatus 100, such as a network interface, a USB interface, a 1394 interface, a video interface, and the like. The auxiliary storage unit 2 is a storage medium such as a CD-ROM or a memory card, and a related interface. The display control unit 3 displays a display image on the display unit 4 under the control of the CPU 8. The display unit 4 may be a liquid crystal display, or the image processing apparatus 100 itself may have no display in its electrical configuration. The hard disk 5 stores therein a program for control and various data used in the control. The temporary storage unit 6 is a volatile memory such as a RAM or a DRAM, and functions as a buffer memory for temporarily storing the video data received by the communication interface 1 and as a work memory of the CPU 8. The operation unit 7: for the user to operate. The CPU8 controls the overall operation of the image processing apparatus 100 and executes various related processes. For example, the received video data is subjected to predetermined processing such as correction, interpolation, pseudo-color, synthesis, compression, decompression, and the like, and converted into data suitable for display, recording, and the like. For example, when the received video data is compressed video AD data, predetermined processing such as the CPU8 decompresses the video data received by the acquisition unit and performs corresponding predetermined processing; for example, when the received video data itself is the image data of a compressed video, the image data of the video is decompressed to be obtained. For example, when the communication interface 1 receives an analog video, it AD-converts the received analog video to digital video image data by the AD conversion circuit.
The image capturing device 101 includes a communication interface 10, an imaging unit 20, a flash memory 30, a temporary storage unit 50, an image processing unit 40, a CPU60, and the like. The CPU60 controls the overall operation of the image capturing device 101, and the flash memory 30 stores a control program and various data used for controlling each part. The image capturing unit 20 captures image data, the temporary storage unit 50 temporarily stores processed data, the image processing unit 40 compresses the captured image data, and the CPU60 controls the output of the processed image data via the communication interface 10.
The configuration of the imaging device 13 except for the imaging unit 1 is substantially the same as that of the image processing device 100, and it is obvious that the present embodiment is applied similarly by acquiring image data from an external source. Therefore, the description of the embodiments is omitted. Obviously, the image processing apparatus 100 can be used with various image capturing devices having image capturing functions, such as various handheld image devices.
Other embodiments:
further, the display unit of the display unit 4 may be configured to have more than one display, and there may be a display for displaying an image and a display for displaying the subject information exclusively, and the display control of the simultaneous display by the display control unit may be the simultaneous display on the same display or on different displays.
Preferably, the subject instruction information is displayed simultaneously with the continuous video; not limited to this, for example, a moving image may be displayed on the display unit 4, and when a display instruction of predetermined object instruction information to be displayed in particular is received, the object instruction information and the frozen image may be displayed simultaneously; in addition, the display control unit may switch the display image to display the object indication information obtained from the special object information specified by the information specifying unit in a special display manner in response to an object information display instruction (for example, a button representing the object information display is pressed) and display the object indication information and the image; then, the switching operation can be performed, the switched object indication information is particularly displayed, and the image is displayed in response to the display indication of the image. After the special display, the display may be blanked after a predetermined time or based on a user operation to avoid occupation of the display screen. Further, the user may select the plurality of pieces of subject instruction information displayed in the sorted order without performing the switching operation, and the information specifying unit may specify the subject information as the special subject information based on the selection by the user; in this way, since the subject instruction information is displayed in the order of the order added to the subject information, the user can select the subject instruction information easily and clearly, and the present invention is also configured. Further, the present invention is also applicable to a still imaging image capturing apparatus.
In the above embodiments, the subject application in the power industry is exemplified as a scene, but the present invention is also applicable to various industries for image capturing.
In addition, the processing and control functions of some or all of the components in embodiments of the present invention may also be implemented using dedicated circuits or general purpose processors or programmable FPGAs.
Although the functional blocks in the drawings may be implemented by hardware, software, or a combination thereof, there is generally no need for structures to implement the functional blocks in a one-to-one correspondence; for example, a functional block may be implemented by one software or hardware unit, or a functional block may be implemented by multiple software or hardware units.
The foregoing describes only embodiments of the invention and is presented by way of illustration rather than limitation, and further modifications and variations of the embodiments may be made by persons skilled in the art in light of the foregoing description without departing from the spirit or scope of the invention.

Claims (17)

1. Image capture device includes:
an acquisition unit for acquiring image data based on the subject information specified by the information specification unit;
an information specifying unit configured to specify subject information as special subject information based on the plurality of subject information added with the sorting order stored in the information storage unit; the shot object information is information representing the identity of a shot object and comprises one or a combination of a shot object location, a type and a number; all attribute information or partial attribute information of the object information is specified by an information specifying unit; each attribute information of the object information is configured according to the form of classification information;
a display control unit for displaying the image generated by the image data on the display unit, and displaying the subject indication information obtained from the special subject information matched with the identity information of the subject specified by the information specifying unit in a special display mode based on the sort order of the subject information stored in the information storage unit and the identification of the identity information of the subject to be photographed by the photographer;
the information specifying unit switches the specified special object information based on the sorting order in response to a switching instruction operation or in accordance with a predetermined switching condition;
an information specifying unit that specifies the subject information as the special subject information as two or more pieces of subject information adjacent to each other in order; the information designating unit sorts the specified specific number of pieces of the adjacent object information by the specific number of pieces of the adjacent object information designated before switching to the specific number of pieces of the adjacent object information starting from the next object information in the sorted order series of the specified object information designated before switching.
2. The image capturing apparatus as claimed in claim 1, characterized by comprising a task specifying unit for specifying the subject information from the subject information stored in the information storage unit; an information specifying unit configured to specify subject information as special subject information from the subject information specified by the task specifying unit; the information specifying unit switches the specified special object information based on the order of the objects specified by the task specifying unit in response to a switching instruction operation or in accordance with a predetermined switching condition.
3. The image capturing apparatus as claimed in claim 2, wherein the task specifying unit specifies the subject information that meets the filter condition based on the subject information stored in the information storage unit according to a predetermined filter condition.
4. The image capturing apparatus according to claim 3, characterized in that a task setting section is provided for setting a filtering condition of the subject information.
5. The image capturing apparatus according to claim 4, wherein the task setting section has a keyword determination unit, a logic determination unit, and a filter condition generation unit; wherein, the keyword determining unit is used for determining keywords related to the filtering condition; a logic determination unit for determining a filtering logic relationship of the keywords related to the filtering condition; and the filtering condition generating unit is used for generating the filtering condition according to the keywords related to the filtering condition and the filtering logic relation.
6. The image capturing apparatus of claim 1, wherein the image capturing apparatus is an image capturing apparatus with a capturing function comprising one or more of a visible light capturing apparatus, a thermal imaging apparatus, an ultraviolet capturing apparatus, and a laser imaging apparatus, and has at least one image sensor.
7. The image capturing apparatus as set forth in claim 1, wherein the information designating unit switches the single object information designated as the special object information from the object information designated as the special object information before switching to the object information next in the sorted order series of the object information designated as the special object information before switching in response to the switching instruction operation or in accordance with a predetermined switching condition.
8. The image capturing apparatus according to claim 1, wherein the acquisition unit is configured to continuously acquire image data; the display control unit controls the display unit to display a moving image generated from the continuously acquired image data, and displays the subject instruction information obtained based on the special subject information specified by the information specifying unit in a special display mode.
9. The image capturing apparatus as claimed in claim 8, wherein the display control section controls the display section to display the image generated by the image data, and displays the subject indication information obtained by the specific subject information in a display manner distinguished from other subject indication information, while displaying the subject indication information obtained by the predetermined number of subject information in the order of the subject information.
10. Image capture device includes: an acquisition unit for acquiring image data based on the subject information specified by the information specification unit;
an information specifying section for specifying, as special subject information for obtaining specially displayed subject instruction information, subject information among the plurality of subject information to which the sorting order is added stored by the information storage section; the shot object information is information representing the identity of a shot object and comprises one or a combination of a shot object location, a type and a number; all attribute information or partial attribute information of the object information is specified by an information specifying unit; each attribute information of the object information is configured according to the form of classification information;
a display control section for controlling the display section to display the image generated by the image data or the identification of the identity information of the subject to be photographed by the photographer based on the sorting order of the subject information stored by the information storage section in response to the corresponding display instruction, and displaying the subject instruction information obtained from the special subject information matched with the identity information of the subject to be photographed specified by the information specifying section in a special display manner;
the information specifying unit switches the specified special object information based on the sorting order in response to a switching instruction operation or in accordance with a predetermined switching condition; an information specifying unit that specifies the subject information as the special subject information as two or more pieces of subject information adjacent to each other in order; the information designating unit sorts the specified specific number of pieces of the adjacent object information by the specific number of pieces of the adjacent object information designated before switching to the specific number of pieces of the adjacent object information starting from the next object information in the sorted order series of the specified object information designated before switching.
11. The image capturing apparatus according to claim 1 or 10, wherein the image capturing apparatus includes an information storage unit that stores a plurality of pieces of subject information to which the sort order is added in advance.
12. The image capturing apparatus according to claim 1 or 10, wherein the acquiring unit is configured to capture and acquire image data.
13. The image capturing apparatus as claimed in claim 10, characterized by comprising a task specifying unit for specifying the subject information from the subject information stored in the information storage unit; and a display control unit for controlling the display unit to display the infrared image generated from the image data and display a predetermined number of pieces of subject instruction information in the order of the subject information based on the subject information determined by the task determination unit.
14. The image shooting method comprises the following steps: an acquisition step of acquiring image data based on the subject information specified in the information specifying step;
an information specifying step of specifying subject information as special subject information among the plurality of subject information added with the sorting order stored in the information storage section; the shot object information is information representing the identity of a shot object and comprises one or a combination of a shot object location, a type and a number; all attribute information or partial attribute information of the object information is specified by an information specifying unit; each attribute information of the object information is configured according to the form of classification information;
a display control step of displaying, in a special display manner, subject indication information obtained from special subject information that matches the subject identity information specified in the information specifying step, based on the order of the subject information stored in the information storage unit and the identification of the subject to be photographed by the photographer, while controlling the display unit to display the image generated by the image data;
an information specifying step of switching the specified special subject information based on the sort order in response to a switching instruction operation or in accordance with a predetermined switching condition; when the information appoints the step, appoint as the information of the particular object of shooting the object information, for two or more adjacent object information of ordering; the information specifying step switches the specified specific number of pieces of the object information, which are adjacent to each other in the order, from the specified specific number of pieces of the object information, which are adjacent to each other in the order, which are specified before the switching, to the specific number of pieces of the object information, which are adjacent to each other in the order, which is the next piece of the object information, which is specified before the switching, in the order sequence, as the head.
15. An image capturing method as set forth in claim 14, wherein the acquiring step is for continuously acquiring image data; the display control step is configured to control the display unit to display a moving image generated from the continuously acquired image data, and to display the subject instruction information obtained based on the special subject information specified in the information specifying step in a special display mode.
16. The image shooting method comprises the following steps:
an acquisition step of acquiring image data based on the subject information specified in the information specifying step;
an information specifying step of specifying, as special subject information for obtaining specially displayed subject instruction information, subject information among the plurality of subject information to which the sorting order is added stored by the information storage section; the shot object information is information representing the identity of a shot object and comprises one or a combination of a shot object location, a type and a number; all attribute information or partial attribute information of the object information is specified by an information specifying unit; each attribute information of the object information is configured according to the form of classification information;
a display control step of, in response to a corresponding display instruction, controlling the display section to display the image generated by the image data or the subject indication information obtained from the special subject information matched with the subject identity information specified by the information specifying step in a special display manner based on the sort order of the subject information stored in the information storage section and the identification of the identity information of the subject to be photographed by the photographer;
an information specifying step of switching the specified special subject information in the order of the subject information in response to a switching instruction operation or in accordance with a predetermined switching condition; when the information appoints the step, appoint as the information of the particular object of shooting the object information, for two or more adjacent object information of ordering; the information specifying step switches the specified specific number of pieces of the object information, which are adjacent to each other in the order, from the specified specific number of pieces of the object information, which are adjacent to each other in the order, which are specified before the switching, to the specific number of pieces of the object information, which are adjacent to each other in the order, which is the next piece of the object information, which is specified before the switching, in the order sequence, as the head.
17. The image capturing method according to claim 14 or 16, characterized by comprising a task specifying step of specifying the subject information from the subject information stored in the information storage unit; an information specifying step of specifying object information as special object information from the object information determined by the task determining step; in response to a switching instruction operation or in accordance with a predetermined switching condition, the information specifying step switches the specified special object information based on the sort order added to the object information specified in the task specifying step.
CN201310198318.0A 2012-05-23 2013-05-23 Image capturing device and image capturing method Active CN103428432B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010314876.9A CN111800562A (en) 2012-05-23 2013-05-23 Image capturing device, image processing system, and image capturing method
CN201310198318.0A CN103428432B (en) 2012-05-23 2013-05-23 Image capturing device and image capturing method

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
CN201210167016 2012-05-23
CN201210167095 2012-05-23
CN2012101670957 2012-05-23
CN201210167016.2 2012-05-23
CN201210167095.7 2012-05-23
CN2012101670162 2012-05-23
CN201310198318.0A CN103428432B (en) 2012-05-23 2013-05-23 Image capturing device and image capturing method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202010314876.9A Division CN111800562A (en) 2012-05-23 2013-05-23 Image capturing device, image processing system, and image capturing method

Publications (2)

Publication Number Publication Date
CN103428432A CN103428432A (en) 2013-12-04
CN103428432B true CN103428432B (en) 2020-05-12

Family

ID=49623147

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201310198318.0A Active CN103428432B (en) 2012-05-23 2013-05-23 Image capturing device and image capturing method
CN202010314876.9A Withdrawn CN111800562A (en) 2012-05-23 2013-05-23 Image capturing device, image processing system, and image capturing method

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202010314876.9A Withdrawn CN111800562A (en) 2012-05-23 2013-05-23 Image capturing device, image processing system, and image capturing method

Country Status (2)

Country Link
CN (2) CN103428432B (en)
WO (1) WO2013174286A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1589567A (en) * 2001-11-27 2005-03-02 松下电器产业株式会社 Information-added image pickup method, image pickup apparatus and information delivery apparatus used for the method, and information-added image pickup system
CN101242502A (en) * 2006-12-12 2008-08-13 索尼株式会社 Imaging apparatus, imaging method, reproducing apparatus, reproducing method and program
CN201765696U (en) * 2010-07-26 2011-03-16 广州科易光电技术有限公司 Substation remote temperature image monitoring system

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5732227A (en) * 1994-07-05 1998-03-24 Hitachi, Ltd. Interactive information processing system responsive to user manipulation of physical objects and displayed images
JP4399133B2 (en) * 2000-09-08 2010-01-13 カシオ計算機株式会社 Imaging condition providing device, imaging condition setting system, and imaging condition providing method
US7447418B2 (en) * 2003-01-17 2008-11-04 Matsushita Electric Industrial Co., Ltd. Image reproducing device and image recording/reproducing device
JP4379491B2 (en) * 2007-04-04 2009-12-09 ソニー株式会社 Face data recording device, playback device, imaging device, image playback system, face data recording method and program
JP4752827B2 (en) * 2007-09-04 2011-08-17 ソニー株式会社 MAP INFORMATION DISPLAY DEVICE, MAP INFORMATION DISPLAY METHOD, AND PROGRAM
US9245041B2 (en) * 2007-11-10 2016-01-26 Geomonkey, Inc. Creation and use of digital maps
JP5186903B2 (en) * 2007-11-30 2013-04-24 ソニー株式会社 MAP DISPLAY DEVICE, MAP DISPLAY METHOD, AND IMAGING DEVICE
US8229160B2 (en) * 2008-01-03 2012-07-24 Apple Inc. Systems and methods for identifying objects and providing information related to identified objects
JP4788792B2 (en) * 2009-03-11 2011-10-05 カシオ計算機株式会社 Imaging apparatus, imaging method, and imaging program
KR101778135B1 (en) * 2009-08-24 2017-09-14 삼성전자주식회사 Method for providing object information and image pickup device applying the same
JP5045776B2 (en) * 2010-03-23 2012-10-10 カシオ計算機株式会社 Camera, camera control program, photographing method, and subject information transmission / reception system
JP2011223292A (en) * 2010-04-09 2011-11-04 Sony Corp Imaging apparatus, display control method, and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1589567A (en) * 2001-11-27 2005-03-02 松下电器产业株式会社 Information-added image pickup method, image pickup apparatus and information delivery apparatus used for the method, and information-added image pickup system
CN101242502A (en) * 2006-12-12 2008-08-13 索尼株式会社 Imaging apparatus, imaging method, reproducing apparatus, reproducing method and program
CN201765696U (en) * 2010-07-26 2011-03-16 广州科易光电技术有限公司 Substation remote temperature image monitoring system

Also Published As

Publication number Publication date
CN111800562A (en) 2020-10-20
CN103428432A (en) 2013-12-04
WO2013174286A1 (en) 2013-11-28

Similar Documents

Publication Publication Date Title
JP6272635B2 (en) Infrared recording apparatus and infrared recording method
CN104541501B (en) Infrared shooting device and infrared shooting method
CN103428436B (en) Image recording apparatus and image recording method
CN104541503B (en) Thermal image shooting device and thermal image shooting method
CN103428434B (en) Infrared photographing apparatus and infrared photographing method
CN103428432B (en) Image capturing device and image capturing method
CN105163055A (en) Dynamic recording device, playback device, dynamic recording method and playback method
CN103428433B (en) Image processing device, image processing system and image processing method
CN104796585A (en) Image dynamic recording device, playback device, image dynamic recording method and playback method
CN108848299B (en) Thermal image photographing device and thermal image photographing method
CN109274905B (en) Thermal image recording device and thermal image recording method
WO2013174287A1 (en) Image and video recording device and image and video recording method
WO2013174288A1 (en) Image and video capturing device and image and video capturing method
CN103458163A (en) Device, system and method for image processing
WO2013174292A1 (en) Videography device and videography method
WO2013174294A1 (en) Image and video capturing device and image and video capturing method
CN113984217B (en) Analysis area setting device, processing device, analysis area setting method, and processing method
WO2014190931A1 (en) Infrared dynamic video recording device and infrared dynamic video recording method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant