JP2020095325A - Image identification system - Google Patents

Abstract

To provide an image identification system capable of improving the cognitive capability for objects under bright place such as under day light, and further enhancing reliability and safety of work.SOLUTION: The image identification system includes an imaging device 12 capable of imaging an image containing an object, image processing device 11 connected with the imaging device 12 and processes video data containing color information, and an image display device 13 connected with the image processing device 11 and displays the image. The image processing device 11 performs image processing of: coloring regions that contain one or more colors selected by a user as colors the object has, any one of the color as it is, a prescribed chromatic color, and an enhanced achromatic color; while coloring regions that do not contain the colors selected by the user, monochromatic achromatic color, in the video data input by the imaging device 12, and outputs the video data after the image processing to the image display device 13.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image identification system.

In order for a human to visually recognize an object, either the object is emitting light, or the light emitted from another light emitter is reflected by the object, and it reaches the eyes, which is a stimulus. Is transmitted to the brain, and light stimulation information is highly processed in the brain. During this process, it is essential for the light to reach the eyes, so unless the object is emitting light, it is not possible to recognize the object in the dark and activities in the dark can Some kind of visible light irradiation system such as electric lights and lighting is indispensable.

There is a device that enhances the cognitive ability of an object at night by paying attention to the perception and the processing process of the brain (Patent Document 1). However, it was difficult for the system described in Patent Document 1 to exert its effect clearly unless it was in a dark place.

Patent No. 6202241

If the cognitive ability of an object can be enhanced in a bright place such as during the daytime, the certainty and safety of the work can be enhanced.
The present invention advantageously solves the above problems and provides an image identification system capable of enhancing the cognitive ability of an object in a bright place such as daytime, and thus enhancing the certainty and safety of work. The purpose is to provide.

Regarding the enhancement of the cognitive ability of an object, the processing of stimulus information in the brain is very complicated. Therefore, if a large amount of light stimulus information rushes in in a short time, this processing cannot catch up with it, a phenomenon called so-called oversight. Occurs. Conversely, under the condition that the stimulus information that is not related to observation is minimized, even a very slight optical stimulus can be perceived and recognized by human beings instantly.

The present inventors have conducted research and development to develop a system capable of enhancing the cognitive ability of an object in a bright place such as daytime, based on the system described in Patent Document 1 and the above idea. In order to enhance the cognitive ability of an object in a bright place such as daytime without irradiating light rays as in Patent Document 1, image processing for lowering the lightness of a portion unrelated to the object and lightness of the object itself or The present invention has been completed by finding out that at least one of the image processing for increasing the saturation may be performed, the processed video data may be displayed and input to the eyes as visual information, and the present invention has been completed.

The image identification system of the present invention is as follows.
[1]
An image pickup device capable of picking up an image including an object,
An image processing device that is connected to the imaging device and processes video data including color information;
An image display device connected to the image processing device for displaying an image;
Equipped with
In the image data input from the image pickup device, the image processing device retains a color of an area including one or more colors selected by the user as a color of an object, or a predetermined chromatic color. Or, with an achromatic color that is emphasized, image processing is performed in which the area not including the color selected by the user is monochrome, and the video data after the image processing is output to the image display device.
Image identification system,
[2]
The image processing is a process of changing the hue, brightness or saturation of a region including one or more colors selected by the user, a process of enlarging the region, a process of blinking the region, and an arrow mark on the region. An image identification system according to [1], which includes at least one process of adding
[3]
The image identification system according to [1] or [2], wherein the image processing includes processing for reducing the lightness of the color of a region not including the color selected by the user.
[4]
The image display device is an image identification system according to any one of [1] to [3], which is a head-mounted display;
[5]
The image identification system according to [4], in which the imaging device is mounted on the head mounted display,
[6]
The image identification system according to any one of [1] to [5], wherein the object is at least one of a fishing line, a float, a fishing rod, a lure, a bait, and a fish.
[7]
The image identification system according to claim 1, wherein the object is at least one of a part in a factory, a belt of a belt conveyor, a machine, and safety shoes.
[8]
The image processing device includes a process of measuring a distance or a moving speed of an area including one or more colors selected by a user and outputting a measurement result of the distance or the moving speed to the image display device. Image identification system,
[9]
The image identification system according to [1], including a process of outputting a warning to the image display device when the image processing device detects a color selected by a user as a color that two or more objects have.

According to the image identification system of the present invention, it is possible to enhance the cognitive ability of an object in a bright place such as daytime, and thus enhance the cognitive ability of a fishing rod, a fishing line, etc. in fishing, and enhance the certainty and safety of work. You can

It is a block diagram explaining the image identification system of one embodiment of the present invention. It is a typical perspective view of the image identification system of one embodiment of the present invention.

Briefly speaking, the present invention makes it difficult to see the information other than the observation target, and further gives information to the observation target when it is necessary to give it to a human so that the observation target can be easily found and recognized. It is a system that provides a state that is easy to observe and easy to observe.
Hereinafter, embodiments of the image identification system of the present invention will be described more specifically with reference to the drawings.

(Embodiment 1)
FIG. 1 shows a block diagram of Embodiment 1 of the image identification system of the present invention. In FIG. 1, an image identification system 10 includes an image processing apparatus 11, an image capturing apparatus 12 connected to the image processing apparatus 11, an image display apparatus 13 connected to the image processing apparatus 11, and an image processing apparatus 11. And a user-selected color input operation reception device 14 connected to the. The image identification system 10 can be specifically in the form of a head mounted display 15, a digital camera 16 and a computer 17 incorporated in the head mounted display, and a tablet terminal 18, as shown in FIG. 2 shows an example in which the head mounted display 15 further includes an infrared light projecting device 19 and a headphone 20. The headphone 20 can be a device that can emit a warning sound and read a numerical value of a distance or a speed described later. Further, the computer 17 has a built-in communication function, and is capable of wirelessly or wiredly communicating image data and the like with the transmitting/receiving device 21 provided outside the head mounted display 15 and the tablet terminal 18.

The image processing apparatus 11 includes an input unit 111, a storage unit 112, a calculation unit 113, a control unit 114, and an output unit 115. The input unit 111 can input data from the imaging device 12 and the user-selected color input operation reception device 14. The storage unit 112 is composed of a semiconductor memory, a magnetic disk, or the like, and the data from the input unit 111 and the arithmetic unit 113 is read, stored, and written to the arithmetic unit and the like as necessary. Further, the storage unit 112 stores and reads the program executed by the control unit 114. The calculation unit 113 performs image processing and processes associated with the image processing, and the control unit 114 instructs the calculation unit 113 to perform image processing and the like in the calculation unit 113. The calculation unit 113 and the control unit 114 are composed of circuits. The output unit 115 is capable of outputting video data before being subjected to image processing by the arithmetic unit 113, video data after being subjected to image processing, and other video data, and overlays character information and the like on the video data as necessary. It can be displayed with. Further, the output unit 115 can output a voice signal such as a warning sound as necessary. The image processing device 11 may be a device for displaying virtual reality (VR), augmented reality (AR), or mixed reality (MR) on the image display device 13 based on the image captured by the image capturing device 12. it can. The image processing device 11 can be, for example, a device incorporated in a head mounted display as a specific example of the image display device 13, and is a computer 17 in FIG. 2.

The image pickup device 12 includes an area image sensor in which image pickup elements which receive light reflected from a photographed object through a lens and convert it into an electric signal are arranged two-dimensionally, and the image pickup element receives the light through a color filter. It is possible to photoelectrically convert light and convert it into image information data of the entire screen including color information represented by numerical values of 256 gradations in the RGB color model for each pixel corresponding to the array of the image pickup device. .. This area image sensor can acquire still image information of the entire screen at a predetermined frame rate. The image pickup device 12 is not limited to one capable of photoelectrically converting visible light, and may be one capable of photoelectrically converting light having an infrared wavelength. Further, a light projection device, for example, a visible light projection device or an infrared projection device, is attached to the imaging device 12 or as a device other than the imaging device 12 so that the imaging device can receive light having an infrared wavelength from the object. The image identification system 10 may include The imaging device 12 may be, for example, a device mounted on a head mounted display as a specific example of the image display device 13, and the configuration thereof may use, for example, part or all of a digital camera. Is a digital camera 16. Further, FIG. 2 includes the above-mentioned infrared light projecting device 19. By providing the visible light projection device and the infrared projection device, it becomes a light source when the illuminance is insufficient, and it is possible to assist the imaging. The visible light projection device and the infrared light projection device may be continuous light sources or intermittent light sources. By using intermittent light, power consumption can be suppressed, and it can be expected that the influence on fish during fishing will be reduced.

The image display device 13 can display in color the still image of the entire screen at a predetermined frame rate based on the signal output from the output unit 115. The imaging device 12 can be, for example, a head mounted display as a specific example of the image display device 13. The head mounted display includes a transmissive head mounted display. The image display device 13 is the head mounted display 15 in FIG. The digital camera 16 as the imaging device 12 incorporated in the head mounted display 15 is provided in the vicinity of the screen of the head mounted display 15, for example, at the position of the spectacles (armor) of the spectacles type head mounted display or the position of the bridge. Preferably. Since the digital camera 16 is provided in the vicinity of the screen of the head mounted display 15, in other words, it is provided in a position close to the eyes of the user wearing the head mounted display 15, the deviation from the user's original line of sight is achieved. Is small, eliminating the need for position correction.

The user-selected color input operation reception device 14 allows the user to select an object from an image displayed on the image display device 13 or a device that is separate from the image display device 13 and that can display an image for the user to select a color. This is a device that receives an operation of selecting the color displayed in the image as the displayed color and inputs the color information to the input unit 111 of the image processing device 11. In addition, using the user-selected color input operation reception device 14, an operation of selecting an arbitrary color in order to convert the color that is the color displaying the object into an arbitrary color specified by the user is received. Then, the color information can be input to the input unit 111 of the image processing apparatus 11. The user-selected color input operation reception device 14 is a tablet terminal 18 in FIG.

The user-selected color input operation reception device 14 includes, for example, a touch panel, a mouse, a pointing device such as a controller, an input device such as a line-of-sight input and a voice input, and a color or a color represented by, for example, 256 gradations in the RGB color model. The range of can be directly input by a numerical value, or can be input by a slide bar or an eyedropper tool overlaid on the image display device. The user-selected color input operation reception device 14 can be, for example, a device mounted on a head mounted display as a specific example of the image display device 13 or a device connected to the head mounted display. The tablet terminal 18 of FIG. 2 is wirelessly connected to the computer 17. The tablet-type terminal 18 has a screen that can be displayed on an image like a smartphone, and a touch panel that is provided so as to overlap the screen. The color of the image displayed on the screen can be input by selecting it on the touch panel. The connection between the tablet terminal 18 and the computer 17 is not limited to wireless connection and may be wired connection. The user-selected color input operation receiving device 14 connected to the computer 17 is not limited to a tablet type, and may be a stick type or pad type game controller.

The operation of the image identification system 10 will be described.
When the user captures a visual field including an object with the image capturing device 12, the captured image is photoelectrically converted by the image capturing device 12, and image information of one entire screen is converted into RGB for each pixel corresponding to an array of image capturing elements, for example. As still image data of the entire screen including color information represented by numerical values of 256 gradations in the color model, the still image data is converted into video data recorded at a predetermined frame rate. This still image data can be, for example, numerical data of 256 gradations in the RGB color model arranged corresponding to the arrangement of the image pickup elements. However, the numerical data is not limited to that of 256 gradations. Further, the video data may be compressed and encoded. Since the still image data created by the image pickup device 12 is data that serves as a reference for image processing in the image processing device 11 and image display in the image display device 12, the image pickup device 12 appropriately determines the color of the object as numerical data. Those which can be converted into Further, it is preferable that the image display device 12 is sufficiently calibrated.

The video data is input to the image processing apparatus 11 from the input unit 111 and is subjected to predetermined image processing by the arithmetic unit 113, or is sent to the output unit 115 without being subjected to the image processing and is output to the output unit 115. A moving image is displayed on the connected image display device 13. Further, the still image data extracted from the video data from the input unit 111 is stored in the storage unit 112 as needed for an operation selected by the user as a color of the object.

The presence or absence of image processing in the calculation unit 113 can be switched before and after the operation of the user inputting a selected color. Before the user inputs the selected color, the video data from the imaging device 12 is sent to the output unit 115 without being subjected to image processing. However, it is possible to perform image processing in which the video data is displayed by overlaying character information, icons, and the like.

The user receives the operation of inputting the selected color. In one example, the operation for the user to input the selected color is performed as follows. When the user operates the user-selected color input operation accepting device 14, the still image data stored in the storage unit 112 is displayed on the image display device 13 or an image display device separate from the image display device 13. The user selects the color of the object from the still image displayed on the image display device 13. For example, if the color of the object in the image displayed on the image display device 13 is orange, the orange color is selected. In this selection operation, for each pixel of the still image data, for example, a specific numerical value out of 256 gradations in the RGB color model may be pinpointed. Alternatively, a range of numerical values of an approximate color including the specific numerical value may be selected, which allows the user to select a range of colors visually determined to be an object. For example, as the numerical range of the approximated colors, the difference in numerical values within ±3 to 5% from the specific numerical values in RGB values, in other words, in the case of 256 gradations, is ±8 to 13 gradations approximately. It is possible to store in the storage unit 112 a setting that regards a color having a gradation difference within the range as an approximate color, read the setting from the storage unit 112, and adjust the setting. Further, it may be possible to adjust an arbitrary numerical value range according to user input. Numerical data of the color or color range selected by the infrared imaging device user is input from the user-selected color input operation reception device 14 to the input unit 111 of the image processing apparatus 11 and stored in the storage unit 112.

After the user inputs the selected color, the object has a region in the video data from the image pickup device 12 that includes one or more colors selected by the user as the color of the object. The image data after the image processing is performed by performing image processing with the color as it is, or with a predetermined chromatic color, or with an emphasized achromatic color, and an area not including the color selected by the user is monochrome. It is sent to the output unit 115. The predetermined chromatic color is, for example, a green color of an object, which is an orange color that is easily noticed by the user. This can enhance the cognitive ability of the user. Further, when the sensitivity to light differs depending on the user, the color can be adjusted to have appropriate brightness and saturation according to the sensitivity of the user to light. In addition, for people with color blindness, visually impaired people, and people who can see a yellowish image due to aging, a color of an appropriate hue that can be seen by, or is easily visible to, those with color blindness Can be

In this image processing, the arithmetic unit 113 reads out numerical data of the color or color range selected by the user from the storage unit 112, and in each still image of the video data input from the input unit 111, each pixel is It is determined whether or not there is something included in the numerical data of the selected color or color range. If included, the numerical data of the color of the pixel is not changed as it is, or any chromatic color or enhanced achromatic color whose hue, lightness or saturation is different from the color of the object selected by the user. Replace with the numerical data of. The emphasized achromatic color is an achromatic color whose brightness is higher than that of the achromatic color due to being made monochrome. If it is not included, the numerical data of the pixel is replaced with a numerical value such that the color is a monochrome achromatic color. A known method for converting a color image into a monochrome image can be used for the numerical conversion for replacing the numerical value so that the color becomes a monochrome achromatic color, for example, to convert the color image into gray scale. Method, a method for reducing the saturation of a color image, or a method for binarizing a monochrome image can be used. Further, in the numerical value conversion for replacing the value with a monochrome achromatic color, a process of lowering the lightness may be performed, whereby the cognitive ability of the user can be further enhanced. The process of further reducing the brightness may be a process of forming a frame-shaped or pillar-shaped dark portion on the screen of the image display device. This can be expected to further enhance the user's cognitive ability.

Furthermore, when another object having the same or similar color as the object selected by the user is included in the still image, and the size of the other object in the image is smaller than the size of the object, Assuming that the other object is not an object to be observed by the user, it is possible to perform image processing of changing the color of the other object to monochrome, if necessary. The image processing for another object having the same color or a similar color is, as an example, inputting the image data after the image processing to the calculation unit 113, executing the image recognition program, and executing the image recognition program. Of each still image, the numerical data of each pixel is not changed or is changed to any chromatic or emphasized achromatic numerical data whose hue, brightness or saturation is different from the color of the object selected by the user. The number of replaced objects is counted, and the size of the object and another object in each still image of the video data is calculated by the size of the number, and the size is the overall size of the still image (number of pixels). When the ratio is less than or equal to the specific ratio, it is determined that one less than or equal to the specific ratio is a different object, and image processing is performed by using the numerical data of the pixels with the specific ratio or less as monochrome. The criterion for determining as another object is not limited to a certain ratio or less with respect to the overall size (number of pixels) of the still image, and a size less than or equal to a certain ratio with respect to the size of the target object is determined as another object. It may be performed, or it may be determined by user input. Regarding the setting of the specific ratio, an appropriate ratio may be set in advance and stored in the storage unit 11, or the user may be allowed to set and change the ratio. Further, the set value may be changed according to the color of the object.
In the processing for measuring the size of an object in the image processing apparatus 11, for example, a known image recognition program that executes the processing is stored in the storage unit 11, and the program is read from the storage unit 11 to control the unit. This can be performed by inputting the data to 114, the control unit 114 executing this program, and processing the still image data read from the storage unit 112 by the calculation unit 113.

By the image processing described above, the image identification system 10 of the present embodiment outputs the image output from the output unit 115 and displays the image displayed on the image display device 13 in the area selected by the user as the target object or the color of the target object. It is a chromatic or emphasized achromatic area specified by the user, and the other area is an area displayed with a numerical value of linear luminance by a known gray scale conversion as monochrome, for example, in a so-called part-color image. is there. Therefore, the user can enhance the cognitive ability of the object because the image in which the brightness unrelated to the object is lowered is input to the eyes as visual information, and the user can improve the cognitive ability of the object and the It is possible to improve cognitive ability, which in turn enhances certainty and safety of work.

Further, the above-described image processing is a process of specifying the target object by the color of the target object, and is a known technique, in which a two-dimensional contour of the target object is extracted to specify the target object. Processing load is lighter than processing. Therefore, it is possible to contribute to downsizing and low power consumption of the image identification system, and it is easy to sequentially process a plurality of still image data input at a predetermined frame rate, and thus the movement of the object Since it is possible to observe, it is possible to enhance the cognitive ability of the user, and with a short time lag, it is possible to perform substantially real-time observation.

The image processing in the arithmetic unit 113 can be a derivative processing based on the above-described processing. For example, in the above-described image processing, regarding the numerical data of 256 gradations in the RGB color model arranged corresponding to the arrangement of the image sensor, the numerical data of the color of the pixel included in the numerical data of the color or the color range selected by the user. Is replaced with the numerical data of the original color or any chromatic color or emphasized achromatic color, but it is adjacent to the pixel included in the numerical data of the color or color range selected by the user in a predetermined pixel unit. With respect to the existing pixels, it is possible to perform image processing so as to replace the original color, chromatic color, or emphasized achromatic color numerical data. As a result, in the video displayed on the image display device 13 after the image processing, the area enlarged more than the area selected by the user as the object is the color of the object or the chromatic color specified by the user or the emphasized It is displayed in color. Therefore, for example, when the target object is a thin object such as a thread, the thread can be displayed thicker than the actual thickness to emphasize the object and further enhance the cognitive ability of the object.

In addition, regarding the numerical data of 256 gradations in the RGB color model arranged corresponding to the arrangement of the image sensor, the numerical data of the color of the pixel included in the numerical data of the color or the color range selected by the user is used as it is. Alternatively, after the color data is replaced with chromatic color data or emphasized achromatic color data, image processing for blinking the area of the pixel with time can be performed. The image processing for blinking is performed, for example, on pixels included in the numerical data of the color or color range selected by the user in the still image of the video data input from the input unit 111 to the calculation unit 113 at a predetermined frame rate. Realized by switching between the process of replacing the color data of chromatic color or chromatic color or the emphasized achromatic color data and the process of replacing the numerical data of monochrome or the numerical data of black color (0, 0, 0) at predetermined intervals. it can. As a result, in the image displayed on the image display device 13 after the image processing, the area selected by the user as the target is displayed in a blinking manner. Therefore, for example, when the object is a thin object such as a thread, the thread can be emphasized to further enhance the cognitive ability of the object.

In addition, regarding the numerical data of 256 gradations in the RGB color model arranged corresponding to the arrangement of the above-described image sensor, the numerical data of the color of the pixel included in the numerical data of the color or the color range selected by the user is directly changed. After substituting the color data, the chromatic color, or the emphasized achromatic color numerical data, the image processing in which the arrow symbol is added to the area of the pixel can be performed.

The image identification system 10 of the present embodiment can be expected to have the following effects by forming a part color image by digital processing.
(1) Since an arbitrary color as the color of the object can be extracted from the still image data and made into a part color, it varies depending on the color information of the object to be observed, the weather and the amount of light of the day and the place where the color information is captured. Depending on what can be done, the light of the most suitable color can be freely selected. On the other hand, when an analog bandpass filter is used, only one type of color passes through one filter, so it is necessary to prepare many filters according to the number of colors of the target object. However, it was not preferable in terms of cost and operation.
(2) The actual object can be emphasized (thickened, blinked, added with arrow marks, etc.).
(3) On the contrary, the area other than the object, that is, the background can be greatly weakened.
(4) By selecting a plurality of colors as the color that the user has as the color that the object has, information other than the object can be highlighted (for example, if you want to observe the thread, More than that, highlight where your scaffold is, etc.).
(5) It is also possible to emphasize with a color having a hue, lightness, or saturation different from the actual color of the object.
(6) By combining with other sensing technology, it is possible to automatically change the emphasis preference suitable for the situation.

Further, the image identification system 10 of the present embodiment has the following effects by using a video image captured by an imaging device such as a digital camera as an original image.
(7) By using a high-sensitivity image pickup device or a night-vision image pickup device, the sensitivity can be increased more than that of the human eye (such as night vision).
(8) By using light of a wavelength that is not perceived by human eyes as a light source, it is possible to prevent others from noticing it (ultraviolet rays, infrared rays). If a fluorescent agent is formed on the surface of the object when using a light source of these wavelengths, the effect is more excellent.
(9) Different from the bandpass filter, the colors are identified not by the wavelength but by the ratio of RGB, for example, so that the choice of colors is increased and the color resolution is improved.

The image identification system 10 of the present embodiment can be used for the following purposes.
When the user selects a fishing line or float, the tip of a fishing rod, or a lure as an object, the line, the float, the tip of the fishing rod, or the movement of the lure should be emphasized and observed even in a bright place such as daytime. It is possible to improve fishing results. In addition, white food such as pressed wheat may be mixed with the food to be sprinkled in the water for the purpose of improving visibility, and the user selects the color of this pressed wheat as an object to emphasize the flow of the tide. Can be observed. Furthermore, by selecting a fish in water as an object, the movement of the fish can be emphasized and observed. When the underwater fish is an object, the image pickup device 12 can receive light through a polarization filter. Therefore, the image identification system 10 of the present embodiment can be an image identification system for recognizing a fishing line, an image identification system for recognizing a fishing rod, and an image identification system for recognizing a lure. And an image identification system for bait recognition, and an image identification system for fish recognition.
Further, the user can select the color of the quay as an object and display a warning screen on the image display device if the quay is too close to the quay, which is useful for avoiding danger.

Also, in the industry, when the order of assembly is determined when assembling the parts, the parts are color-coded, and when the installation of one part is completed for each order, the emphasis of the color of the part is stopped and the next By performing image processing that emphasizes color components, it is possible to reduce component assembly errors. In addition, it is also possible to detect the movement of the belt by selecting the color of the belt of the belt conveyor that conveys the components, and to assist the placement of the component at the position where the workability is highest and the placement of the body. Therefore, the image identification system 10 of the present embodiment can be an image identification system for component recognition.
In addition, if the user selects the color attached to the tip of the safety shoes and the color of the machine as the target, and if the safety shoes worn by the user are too close to the machine, display a warning screen on the image display device. It can be useful for avoiding danger.
In addition, if the user selects the color of the work site as the target and the selected color is not input to the camera for too long time, a warning signal is sent from the output unit of the image processing device to the external transmission/reception device. , It is possible to notify the outside when the worker falls or neglects the work.

(Embodiment 2)
Next, a second embodiment of the image identification system of the present invention will be described. The image identification system of the present embodiment has the same basic configuration as the image identification system of the first embodiment, and has the configuration of the block diagram shown in FIG. Therefore, the description will be made with reference to the block diagram shown in FIG. The image identification system of this embodiment has a function of measuring a distance including an object or a moving speed of the object, and displaying a measurement result.
For example, in the case of measuring a distance, the object is a linear object that is marked with a predetermined color at regular intervals, the user selects the color of the marked portion, and the image processing device 11 By counting the number of selected colors, the actual distance from a certain position to a certain position can be measured.

To measure the distance, specifically, when the user captures a visual field including an object with the image capturing device 12, the captured image is photoelectrically converted by the image capturing device 12, and image information of one entire screen is captured, for example. Video data in which the still image data is recorded at a predetermined frame rate as still image data for the entire screen including color information represented by numerical values of 256 gradations in the RGB color model for each pixel corresponding to the array of elements. Is converted to. This still image data can be, for example, numerical data of 256 gradations in the RGB color model arranged corresponding to the arrangement of the image pickup elements. However, the numerical data is not limited to that of 256 gradations. Further, the video data may be compressed and encoded. Since the still image data created by the image pickup device 12 is data that serves as a reference for image processing in the image processing device 11 and image display in the image display device 12, the image pickup device 12 appropriately determines the color of the object as numerical data. Those which can be converted into Further, it is preferable that the image display device 12 is sufficiently calibrated.

The video data is input to the image processing apparatus 11 from the input unit 111 and is subjected to predetermined image processing by the arithmetic unit 113, or is sent to the output unit 115 without being subjected to the image processing and is output to the output unit 115. A moving image is displayed on the connected image display device 13. Further, the still image data extracted from the video data from the input unit 111 is stored in the storage unit 112 as needed for an operation selected by the user as a color of the object.

The presence or absence of image processing in the calculation unit 113 can be switched before and after the operation of the user inputting a selected color. Before the user inputs the selected color, the video data from the imaging device 12 is sent to the output unit 115 without being subjected to image processing. However, it is possible to perform image processing in which the video data is displayed by overlaying character information, icons, and the like.

The user receives the operation of inputting the selected color. In one example, the operation for the user to input the selected color is performed as follows. When the user operates the user-selected color input operation accepting device 14, the still image data stored in the storage unit 112 is displayed on the image display device 13 or an image display device separate from the image display device 13. The user selects the color of the object from the still image displayed on the image display device 13. For example, if the color of the object in the image displayed on the image display device 13 is orange, the orange color is selected. In this selection operation, for each pixel of the still image data, for example, a specific numerical value out of 256 gradations in the RGB color model may be pinpointed. Alternatively, a range of numerical values of an approximate color including the specific numerical value may be selected, which allows the user to select a range of colors visually determined to be an object. For example, as the numerical range of the approximated colors, the difference in numerical values within ±3 to 5% from the specific numerical values in RGB values, in other words, in the case of 256 gradations, is ±8 to 13 gradations approximately. Colors with gradation differences within the range can be regarded as approximate colors. Numerical data of the color or color range selected by the user is input from the user-selected color input operation reception device 14 to the input unit 111 of the image processing apparatus 11 and stored in the storage unit 112.

After the user inputs the selected color, the object has a region in the video data from the image pickup device 12 that includes one or more colors selected by the user as the color of the object. Image processing is performed by leaving the color as it is, or by using an arbitrary chromatic color, or by using an achromatic color that is emphasized, and performing monochrome image processing in an area that does not include the color selected by the user, and then performing the image processing. The data is sent to the output unit 115. The arbitrary chromatic color is, for example, the green color of the object is an orange color that is easily noticeable by the user. This can enhance the cognitive ability of the user.

In this image processing, the arithmetic unit 113 reads out numerical data of the color or color range selected by the user from the storage unit 112, and in each still image of the video data input from the input unit 111, each pixel is It is determined whether or not there is something included in the numerical data of the selected color or color range. If it is included, the numerical data of the color of the pixel is not changed as it is, or a predetermined chromatic color or emphasized achromatic color whose hue, lightness or saturation is different from the color of the object selected by the user. Replace with the numerical data of. If it is not included, the numerical data of the pixel is replaced with a numerical value such that the color is monochrome. A known method for converting a color image into a monochrome image can be used for the numerical conversion for replacing a numerical value such that a color becomes monochrome, for example, a method for converting a color image into grayscale or color. A method of reducing the saturation of the image or a method of binarizing the image can be used. Further, in the numerical value conversion for replacing the numerical value such that the color becomes monochrome, a process of lowering the lightness may be performed, whereby the cognitive ability of the user can be further improved.

The area containing the color selected by the user as the color of the above-mentioned object is left as it is as the color of the object, or is set to any chromatic color, or the emphasized achromatic color The image data after the image processing in which the area not including the color selected by the user is monochrome is input to the calculation unit 113 again, and the image recognition program is executed to count the number of the selected colors. To do. In the process of counting the number of selected colors in the image processing apparatus 11, for example, a known image recognition program that executes the process is stored in the storage unit 11, and the program is read from the storage unit 11. This can be performed by inputting to the control unit 114, the control unit 114 executing this program, and processing the still image data read from the storage unit 112 by the calculation unit 113. Then, the measurement result is output from the output unit 115 to the image display device 13 as a number or graphic information as an overlay on the video data or as a separate screen.

For example, in the case of measuring the moving speed, a linear object that is marked with a predetermined color at a constant interval is used as an object, and the user selects the color of the marked portion to measure the distance. In the same manner as above, the area that includes the color selected by the user as the color that the object has is left as it is or the color that the object has is set as an arbitrary chromatic color or emphasized. Image processing is performed with an achromatic color and an area not including the color selected by the user is changed to monochrome, and the image data after the image processing is input again to the calculation unit 113, and the color selected by executing the image recognition program is executed. To calculate the moving speed of the. The image processing apparatus 11 compares the still image data of a frame at a certain time point with the still image data of the subsequent frame, and by the time between the frames, how far the selected color has moved, Alternatively, it is possible to measure the moving speed (including the angular velocity in the rotational movement) of the object by measuring how much the rotational movement is performed by known image processing. In the process of counting the number of selected colors in the image processing apparatus 11, for example, a known program for executing the process is stored in the storage unit 11, and the program is read from the storage unit 11 to control the unit. This can be performed by inputting the data to 114, the control unit 114 executing this program, and processing the still image data read from the storage unit 112 by the calculation unit 113. Then, the measurement result is output from the output unit 115 to the image display device 13 as a number or graphic information as an overlay on the video data or as a separate screen.

The image identification system of the present embodiment having the function of measuring distance and speed can be used for the following purposes.
In fishing, the depth of water and the distance traveled can be measured and displayed by using a thread that is color-coded every several tens of meters and selecting the color that is color-coded by the user. In addition, the winding speed of the reel, that is, the swimming speed of the lure can be displayed by using the threads colored at equal intervals such as 1 meter. Further, based on the measured value of the speed, an alert can be displayed on the screen or output by voice when the winding speed deviates from the appropriate winding speed. Further, the body length of the caught fish can be measured by using a scale marker or the like having a colored scale.
Further, by selecting the color of the work in the factory by the user, a warning signal can be transmitted to an external transmitting/receiving device when the moving speed of the work is too fast or too slow.

The image display device 13 may display not only the numerical values of the speed and distance and the graphic information described above but also various information such as tide, wind, terrain, temperature/water temperature, and atmospheric pressure.

(Embodiment 3)
Next, a third embodiment of the image identification system of the present invention will be described. The image identification system of the present embodiment has the same basic configuration as the image identification system of the first embodiment, and has the configuration of the block diagram shown in FIG. Therefore, the description will be made with reference to the block diagram shown in FIG. The image identification system of the present embodiment has a function of outputting a warning to the image display device when a color selected by the user as a color possessed by an object is detected.

For example, the target is a door in a case where there is an area where entry is prohibited in the building and a door provided on a wall that partitions the area is colored by a specific color so that a person can enter and exit. The user or the user's administrator selects the door color. When the user comes in front of the door of a specific color to enter the exclusion zone, the image processing device 11 detects the selected color and outputs a warning to the image display device 13. The object is not limited to the door, and the same warning can be issued even if the floor surface of the exclusion zone is colored with a specific color. When the object is a floor surface, it is preferable that the imaging device is attached so that the optical axis faces the floor surface.

The process of detecting the selected color in the image processing apparatus 11 may be, for example, a process in which the calculation unit 113 determines whether or not there is numerical value data of the color. When it is detected, the output unit 115 outputs the warning to the image display device 13 as text information or graphic information as an overlay on the video data or as a separate screen. Further, as shown in FIG. 2, when the head mounted display 15 is provided with the headphones 20 as a speaker, the output unit 115 can emit a warning sound.

Since the image identifying apparatus of the present embodiment enables detection when an attempt is made to enter the exclusion zone by simply color-coding the interior, it is not necessary to provide another contact switch or non-contact switch for detection.
The image identification system of this embodiment can also be used for facility route guidance.

Although the image identification system of the present invention has been described above with reference to the embodiment in which the image display device is a head mounted display, the image display device is not limited to the head mounted display. For example, it may be a head-up display that is projected on the windshield of an automobile to serve as an image display device. INDUSTRIAL APPLICABILITY The present invention provides an image identification system for a vehicle, for example, when driving a car, the landscape is changed to black and white, and a color of an obstacle such as a sign, a brake lamp, or a person is selected and highlighted, so that the driver can drive safely without being tired. Will be possible.

10 Image Identification System 11 Image Processing Device 12 Imaging Device 13 Image Display Device 14 User-Selected Color Input Operation Receiving Device 111 Input Unit 112 Storage Unit 113 Computing Unit 114 Control Unit 115 Output Unit

Claims (9)

An image pickup device capable of picking up an image including an object,
An image processing device that is connected to the imaging device and processes video data including color information;
An image display device connected to the image processing device for displaying an image;
Equipped with
In the image data input from the image pickup device, the image processing device retains a color of an area including one or more colors selected by the user as a color of an object, or a predetermined chromatic color. Or an achromatic color that has been emphasized, image processing is performed in which an area that does not include a color selected by the user is achromatic color that is monochromeized, and the video data after the image processing is output to the image display device. Is,
Image identification system. The image processing is a process of changing the hue, lightness or saturation of a color of a region including one or more colors selected by the user, a process of enlarging the region, a process of blinking the region, and an arrow to the region. The image identification system according to claim 1, further comprising at least one process of adding a symbol. The image identification system according to claim 1 or 2, wherein the image processing includes processing of reducing the brightness of the color of a region not including a color selected by the user. The image identification system according to claim 1, wherein the image display device is a head mounted display. The image identification system according to claim 4, wherein the imaging device is mounted on the head mounted display. The image identification system according to claim 1, wherein the object is at least one of a fishing line, a float, a fishing rod, a lure, a bait, and a fish. The image identification system according to claim 1, wherein the object is at least one of a part in a factory, a belt of a belt conveyor, a machine, and safety shoes. The image processing device includes a process of measuring a distance or a moving speed of an area including one or more colors selected by a user, and outputting a measurement result of the distance or the moving speed to the image display device. Image identification system. The image identification system according to claim 1, wherein the image processing device includes a process of outputting a warning to the image display device when detecting a color selected by a user as a color possessed by two or more objects.

Images