JP7081162B2 - Image processing device, image processing system, and image processing method - Google Patents

Description

The present invention relates to an image processing apparatus, an image processing system, and an image processing method.

In museums and the like, there is a display system that displays images of virtual space (hereinafter referred to as virtual space images) that have been restored from archaeological sites. One of the purposes of such a display system is to deepen the interest in the ruins.
On the other hand, Patent Document 1 discloses a method of changing and enjoying the game content by reflecting various data such as the physical condition of the user and the weather of the day on the virtual space image on the game.

Japanese Unexamined Patent Publication No. 2000-24324

However, the virtual space image obtained by restoring the archaeological site or the like is created based on the contents designed in advance, and only displays a predetermined scene, so that it may be unsatisfactory depending on the viewer. This is because the expression of the ruins does not change with the passage of time and unexpected scenes are not displayed, and the reality is lacking. For this reason, it is required to generate a virtual space image with a sense of reality, as if the ruins continued to exist there.

The present invention has been made in view of such a situation, and is to provide an image processing apparatus, an image processing system, and an image processing method capable of generating a realistic virtual space image.

In order to solve the above-mentioned problems, one aspect of the present invention is an acquisition unit that acquires a measured value measured by an environment sensor as environmental information regarding the environment, and the measured value is changed over time by adding fluctuations to the measured value. It is provided with a generation unit that processes the measured value by changing the measurement value to generate a virtual object according to the situation shown in the processed environment information, and an output unit that outputs an image generated by the generation unit. This is an image processing device characterized by the above.
Further, one aspect of the present invention is an image processing apparatus characterized in that the generation unit processes the environmental information by adding a sine wave having a predetermined amplitude to the measured value.

Further, one aspect of the present invention is characterized in that the acquisition unit acquires the environmental information from at least one of a sensor group that detects the environmental information at a predetermined place and a device that stores the environmental information. It is an image processing device.

Further, one aspect of the present invention is an image processing apparatus characterized in that the generation unit generates an environmental image that changes according to the situation shown in the environmental information based on the environmental information.

Further, in one aspect of the present invention, the acquisition unit acquires line-of-sight information regarding the line of sight of a person, and the generation unit generates an image of the virtual object according to the direction of the line of sight shown in the line-of-sight information. It is an image processing apparatus characterized by.

Further, one aspect of the present invention is an image processing system including the image processing device described above and a display device for displaying an image output by the image processing device via a communication network. ..

Further, one aspect of the present invention is a step in which the acquisition unit acquires the measured value measured by the environment sensor as environmental information regarding the environment, and the generation unit adds fluctuations to the measured value to obtain the measured value over time. It has a step of processing the measured value by changing it to generate a virtual object according to the situation shown in the processed environmental information, and a step of outputting an image generated by the generating unit by the output unit. It is an image processing method characterized by.

According to the present invention, it is possible to generate a realistic virtual space image.

It is a figure which shows an example of the schematic structure of the image processing system 1 of an embodiment. It is a figure which shows an example of the environmental information acquired by the image processing apparatus 5 of an embodiment. It is a figure which shows the other example of the environmental information acquired by the image processing apparatus 5 of an embodiment. It is a figure which shows an example of the virtual space image generated by the image processing apparatus 5 of an embodiment. It is a flowchart which shows the operation example of the image processing apparatus 5 of embodiment.

Hereinafter, the image processing apparatus, the image processing system, and the image processing method of the embodiment will be described with reference to the drawings.

FIG. 1 is a diagram showing an example of a schematic configuration of an image processing system 1 according to an embodiment of the present invention. As shown in FIG. 1, the image processing system 1 includes a display device 2, a communication network 3, an environment sensor group 4, and an image processing device 5.

The display device 2 acquires and displays a virtual space image generated by the image processing device 5 via the communication network 3.
The display device 2 displays, for example, a virtual space image that reproduces an archaeological site. For example, the display device 2 is a display device provided with a display screen such as a liquid crystal display and displaying a virtual space image on the display screen. Further, the virtual space image may be a still image or a moving image.

The communication network 3 may be a transmission line for wireless communication, may be wired communication, or may be a combination of a wireless communication transmission line and a wired communication transmission line.

The environment sensor group 4 includes an environment sensor 40 (environment sensors 40-1 to 40-N, where N is an arbitrary natural number).
The environment sensor 40 detects information about the environment (environmental information). Environmental information may include, for example, information such as wind direction, wind power, temperature, humidity, barometric pressure, or light. For example, the environment sensor 40 is a sensor for detecting the wind direction, an anemometer, a thermometer, a hygrometer, a barometer, an image pickup device for capturing an image of the sky or surrounding scenery (for example, an all-sky image). The environment sensor 40 is installed at a predetermined place where the environmental information to be reflected in the virtual space can be acquired, and detects the environmental information at that place.
The environment sensor group 4 transmits the detected information about the environment to the image processing device 5 via the communication network 3.

The image processing device 5 includes a communication unit 51, a processing unit 52, and a generation unit 53. Here, the communication unit 51 is an example of the “acquisition unit”. The communication unit 51 is also an example of an “output unit”.
The communication unit 51 wirelessly or wiredly communicates with the display device 2 and the environment sensor group 4 via the communication network 3.
The communication unit 51 acquires the environmental information detected by the environment sensor group 4 via the communication network 3. The communication unit 51 may access various servers via the communication network 3 and acquire environmental information such as wind direction and weather. The communication unit 51 outputs the acquired environmental information to the processing unit 52.

The processing unit 52 acquires environmental information from the environment sensor group 4 via the communication unit 51. The processing unit 52 processes the environmental information acquired from the environment sensor group 4. Here, the processing of the environmental information is to process the environmental information so that a virtual space image based on the environmental information can be easily generated.
FIG. 2 is a diagram showing an example of environmental information acquired by the image processing apparatus 5 of the embodiment. Environmental information is hourly values for temperature, precipitation, wind direction, wind speed, sunshine duration, humidity, and barometric pressure.
For example, when the processing unit 52 acquires the environmental information shown in FIG. 2 at 9 o'clock, it calculates a moving average within a predetermined range for a wind speed of 5.9 [m / s] of the environmental information at that time. .. This is intended to remove noise. Further, even when the acquisition interval of the environmental information is long or when noise is generated due to the movement of a person or an object in the vicinity of the environment sensor group 4, the processing unit 52 performs the data complement processing. The processing unit 52 may perform a process of adding a predetermined fluctuation to the acquired information. By adding a predetermined fluctuation to the wind speed, it is possible to suppress the generation of an unrealistic virtual space image in which the same pattern is repeated. For example, the processing unit 52 adds environmental information to the wind speed of 5.9 [m / s] so that the wind speed changes around the wind speed of 5.9 [m / s] by adding a sine wave having a predetermined amplitude. To process.

The generation unit 53 generates a virtual space image according to the situation shown in the environment information based on the environment information processed by the processing unit 52. The generation unit 53 transmits the generated virtual space image to the display device 2 via the communication unit 51 and the communication network 3. Hereinafter, a method in which the generation unit 53 generates a virtual space image will be described with reference to FIGS. 3 and 4.

FIG. 3 is a diagram showing another example of environmental information acquired by the image processing apparatus 5 of the embodiment. In the example of FIGS. 3 (a) to 3 (c), the environmental information is a scene image M (scene images M-1 to M-3) in the sky at a predetermined place at a predetermined place captured by the image pickup apparatus. 3 (a) to 3 (c) show, as an example of environmental information, a scene image M-1 in which a blue sky in summer is captured, a scene image M-2 in which a night in autumn is captured, and a scene in which rainy weather is captured. Images M-3 are shown respectively.
FIG. 4 is a diagram showing an example of a virtual space image generated by the image processing device 5 of the embodiment. FIG. 4A shows an example of the virtual space image G-1 when there is no wind speed or the wind speed is quiet. FIG. 4B shows an example of the virtual space image G-2 when there is a wind speed. FIG. 4C shows another example of the virtual space image G-3 in the presence of wind speed.

As shown in the examples of FIGS. 4A to 4C, the virtual space images G (virtual space images G-1 to G-3) represent, for example, an object image A, which is a main virtual object, and an environment. It is composed of each virtual object of the environment image B (environment image B-1, B-2) which is a virtual object and the background image C which is a virtual object expressing the background.
In the example of FIGS. 4A to 4C, the object image A is an image of a structure that reproduces an archaeological site. In the example of FIGS. 4A and 4B, the environmental image B is an image of trees swaying according to the wind speed and the wind direction.

In the example of FIG. 4A, the generation unit 53 does not shake or shakes only slightly when the environmental information corresponding to the wind speed indicates that "there is no wind speed or is quiet". An environment image B-1 showing the above is generated.
In the example of FIG. 4B, the generation unit 53 generates an environmental image B-1 showing swaying trees when the environmental information corresponding to the wind speed indicates that “there is a wind speed”.

As shown in FIG. 4C, the generation unit 53 may synthesize the icon image D showing the environment with the image showing the virtual object. For example, the icon image D is an image of a fan showing the wind speed. For example, the generation unit 53 synthesizes an icon image D showing that the blades of the electric fan rotate at a rotation speed corresponding to the wind speed with an image showing a virtual object.
The icon image D is not limited to the image of the electric fan as long as it is an image according to the environmental information, and is not limited to the image of the electric fan, the image of the heat haze or ice indicating the temperature, the image of the water droplet indicating the humidity, or the image of the sun or snow indicating the weather. It may be an image or a combination thereof.

Further, when the scene image M of FIG. 3 is shown as environmental information, the generation unit 53 sets the background image C as an image of the sky shown in the scene image M. The generation unit 53 generates the background image C by trimming the scene image M into a shape indicating the region of the background image C, for example.

FIG. 5 is a flowchart showing an operation example of the image processing device 5 of the embodiment.
First, the image processing device 5 acquires environmental information by the communication unit 51 (step S1).
Next, the image processing apparatus 5 determines whether or not to process the environmental information (step S2), and when processing, causes the processing unit 52 to process the environmental information (step S3). For example, the processing unit 52 adds fluctuations to the information indicating the wind speed every hour, and creates environmental information in which the wind speed changes moderately instead of expressing the wind speed in the same tone for one hour.

Next, the image processing device 5 causes the generation unit 53 to generate a virtual space image. First, the generation unit 53 generates the background image C (step S4). The generation unit generates the background image C by trimming the scene image M into the shape of the virtual space image G, for example.
Next, the generation unit 53 generates the object image A (step S5). For example, when the object image A is an object that does not change due to environmental information (for example, a Buddha image), the generation unit 53 refers to the image of the object image A stored in advance. When the object image A is an object that changes depending on the environmental information (for example, weeping cherry blossoms swaying in the wind), the generation unit 53 generates the object image A in consideration of the environmental information.
Next, the generation unit 53 generates the environment image B based on the environment information (step S6).
Then, the generation unit generates the virtual space image G by synthesizing the generated object image A, environment image B, and background image C.

As described above, the image processing device 5 of the embodiment includes a communication unit 51 that acquires environmental information related to the environment, and a generation unit 53 that generates a virtual object according to the situation shown in the environmental information based on the environmental information. A communication unit 51 that outputs a virtual space image G including a virtual object generated by the generation unit 53 is provided.
As a result, the image processing device 5 of the embodiment can generate a realistic virtual space image. This is because the generation unit 53 can generate the virtual space image G that changes according to the environment by using the environment information acquired by the communication unit 51. A realistic virtual space image can be generated by displaying the changing virtual space on the display device 2 in the same manner as the environment in which the viewer is present.

For example, simply displaying the restored image of Edo Castle (which does not exist now) will convert it to an image according to the environmental information such as the current wind speed and sky pattern of Tokyo, even if the viewer is not very interested. By displaying it, you can see how Edo Castle looks like in the current wind speed and sky pattern of Tokyo, more closely and realistically.
In addition, even in a space where people are restricted from entering, such as inside the hall at night, the images inside the hall show the lighting according to the night and the candles in the hall lit. Since the virtual space image can be expressed by the environmental information, the viewer can appreciate the sight that cannot be seen normally, such as the appearance of the Buddha statue illuminated by the candlelight.

By generating the virtual space image based on the actual environment information in this way, the viewer can experience a sense of reality that cannot be obtained with the pre-designed and created image. For example, a viewer who always thought that the inside of the ruins was dark, seemed to be blocked by a tree with many leaves in the summer, and the leaves fell in the winter, so the sunlight was inside the ruins. By showing the inside, you can realize that the inside of the ruins will be so bright.

Further, in the image processing device 5 of the embodiment, the communication unit 51 obtains the environmental information from at least one of the environment sensor group 4 that detects the environmental information at the predetermined place and the device that stores the environmental information at the predetermined place. get. As a result, the image processing device 5 of the embodiment can acquire at least the environmental information detected by the environment sensor group 4 or the environmental information stored in various servers. Therefore, in addition to the above-mentioned effects, various environmental information can be acquired.
Further, in the image processing apparatus 5 of the embodiment, the generation unit 53 generates the background image C based on the environmental information. As a result, the image processing device 5 of the embodiment can change the background image C included in the virtual space image G according to the environment. Therefore, in addition to achieving the above-mentioned effects, it is possible to express changes according to the environment by changing the background.

Further, in the image processing device 5 of the embodiment, the communication unit 51 acquires a scene image M showing a scene in a predetermined area imaged by the image pickup device, and the generation unit 53 obtains all or a part of the scene image M. A virtual space image G as a background image C is generated. As a result, the image processing device 5 of the embodiment can use the background image C as the actually captured background. Therefore, in addition to achieving the above-mentioned effects, it is possible to express changes in the environment that are more realistic.
Further, in the image processing apparatus 5 of the embodiment, the generation unit 53 generates the environment image B based on the environment information. As a result, the image processing device 5 of the embodiment can change the environment image B according to the environment. By making the environment image B an image suitable for expressing the environment such as trees swaying in the wind, it is possible to generate a virtual space image G that makes it easier for the viewer to understand the environment in which the virtual object is placed. It is possible to generate an immersive image.

Further, the image processing device 5 of the embodiment further includes a processing unit 52 that processes environmental information, and the communication unit 51 provides wind speed information indicating the wind speed at a predetermined location detected by the environment sensor 40 that measures the wind speed. Acquired at predetermined time intervals, the processing unit 52 generates information in which fluctuations are added to the wind speed information, and the generation unit 53 generates an environment image B based on the environment information in which fluctuations are added by the processing unit 52. do. As a result, the image processing device 5 of the embodiment can generate a more realistic virtual space image G. This is because the processing unit 52 can generate a virtual space image G that changes appropriately without repeating a constant pattern by adding fluctuations to the wind speed information.
Further, in the image processing apparatus 5 of the embodiment, the generation unit 53 synthesizes the icon image D into the virtual space image G based on the environmental information. As a result, the image processing device 5 of the embodiment can generate a virtual space image G in which the environment in which the virtual object is placed can be more easily understood by the viewer.

Further, the image processing system 1 of the embodiment includes an image processing device 5 and a display device 2 for displaying the virtual space image G output by the image processing device 5. As a result, the image processing system 1 of the embodiment can generate and display a realistic virtual space image.

In the above-described embodiment, an example in which the wind speed or the like is acquired by the communication unit 51 has been described, but the present invention is not limited to this, and for example, the communication unit 51 may acquire information regarding sound. In this case, the image processing system 1 further includes a sound output device (for example, a speaker). Further, as the environment sensor 40, for example, a sound collecting microphone is used.
The communication unit 51 acquires the environmental sound (for example, the sound of the wind, the howling of a dog, etc.) collected by the sound collecting microphone via the communication network 3. The processing unit 52 performs processing for removing noise by filtering environmental sounds as necessary. The communication unit 51 transmits the environmental sound to the sound output device via the communication network 3. The sound output device outputs the environmental sound received from the communication unit 51 via the communication network 3. Here, the sound output device is installed near, for example, the display device 2. By installing the sound output device near the display device 2, the viewer can listen to the environmental sound while viewing the virtual space image G.

Further, in the above-described embodiment, an example in which the generation unit 53 generates a virtual space image based on the wind speed information and the scene image M has been described, but the present invention is not limited to this, and for example, the generation unit 53, the environment. The light source (lighting) in the virtual space image G may be determined based on the information.
The generation unit 53 determines, for example, the position of the light source in the virtual space image G and the amount of light of the light source based on the scene image M shown in FIG. Then, the generation unit 53 generates a virtual space image G with a shadow based on the determined light source. The position and amount of light can be determined based on the scene image M. Thereby, for example, a situation close to reality can be expressed by the virtual space image G. Further, by expressing different facial expressions between the virtual space image G viewed in the morning and the virtual space image G viewed at night, it is possible to prevent the viewer from getting bored.
Alternatively, the generation unit 53 may determine the position of the light source in the virtual space image G and the amount of light of the light source based on the time shown in FIG. 2 and the sunshine duration.

Further, the generation unit 53 may represent rain or snow in the virtual space image G, for example, based on the information indicating the weather acquired via the communication unit 51. The generation unit 53 generates, for example, an image of rain or snow in the virtual space image G based on information indicating the amount of rainfall, the amount of snowfall, and the wind direction.

Further, in the above-described embodiment, an example in which the generation unit 53 generates the virtual space image G based on the current environment information acquired via the communication unit 51 has been described, but the present invention is not limited to this. For example, the generation unit 53 may generate the virtual space image G based on the environment information acquired in the past. For example, the generation unit 53 generates the virtual space image G based on the representative environmental information of each of spring, summer, autumn, and winter, so that the viewer can appreciate the facial expressions of the object image A in each season. In addition, by accumulating and analyzing environmental information acquired in the past, it is possible to reflect it in the environment without losing the sense of reality in the near future. For example, it is possible to generate a virtual space image G when the convectional rain falls after a few minutes.
Further, the generation unit 53 may generate a virtual space image G in which the object image A reflects the environmental information of a place having no connection with the object image A. For example, viewers can be given an unknown experience, such as what an (now non-existent) Edo Castle would look like in Paris.

Further, in the above-described embodiment, the case where an image in which an exhibit in a museum or the like is reproduced is displayed on the virtual space image G has been described as an example, but the present invention is not limited to this, and the virtual space image G is used, for example. , An image showing the state of a tourist attraction in a tourist center or the like may be displayed. By displaying the state of tourist attractions that change according to the environment, there is a possibility that the number of viewers who are interested in tourist attractions will increase. Further, as the virtual space image G, an image showing an electronic advertisement (digital signage) at a station, a shopping mall, or the like may be displayed. By seeing electronic advertisements that change according to the environment, there is a possibility that the number of viewers who are willing to buy will increase.

(Modification 1 of the embodiment)
Next, a modification 1 of the embodiment will be described. In this modification, in addition to the environmental information, the line of sight of the person is reflected in the virtual space image G. The line of sight of the person here is, for example, the line of sight of a local visitor at a place displayed on the virtual space image G. By reflecting the line of sight of the local visitor in the virtual space image G, it is possible to relive the contents experienced by the local visitor through the line of sight of the local visitor.

The environment sensor group 4 of the image processing system 1 of this modification includes a line-of-sight sensor 41 (not shown).
The line-of-sight sensor 41 acquires line-of-sight information about a local visitor at a location displayed on the virtual space image G. The line-of-sight information is information indicating the presence or absence of a visitor, the position of the visitor if present, the orientation of the body, and the line of sight. The line-of-sight sensor 41 is, for example, a camera or an infrared sensor that detects whether or not there is a visitor in the field. Further, the line-of-sight sensor 41 is, for example, a 3D sensor that detects the position, the direction of the body, the line of sight, and the like when there is a visitor.
The environment sensor 40A detects line-of-sight information. The environment sensor 40A transmits the detected information to the image processing device 5 via the communication network 3.

The communication unit 51 of the image processing device 5 acquires the line-of-sight information detected by the environment sensor 40A via the communication network 3. The communication unit 51 outputs the acquired line-of-sight information to the processing unit 52.
The processing unit 52 acquires line-of-sight information from the communication unit 51, and processes the line-of-sight information by removing noise or the like by filtering the acquired line-of-sight information as necessary.
The generation unit 53 generates a virtual space image G based on the line-of-sight information processed by the processing unit 52. Specifically, the generation unit 53 sets the viewpoint position of the virtual object to be displayed on the virtual space image G as the position indicated by the line-of-sight information, and sets the line-of-sight direction of the virtual object as the direction of the line-of-sight indicated by the line-of-sight information. As a result, the generation unit 53 generates the virtual space image G with the same camera angle as the scene actually seen by the visitor at the place displayed on the virtual space image G.

When there are a plurality of visitors in the place displayed on the virtual space image G, the line-of-sight information about each visitor is detected by the environment sensor 40A and is transmitted to the generation unit 53 via the communication unit 51 or the like. To be acquired. When the generation unit 53 acquires the line-of-sight information for each of the plurality of visitors, the generation unit 53 automatically selects a visitor who meets the predetermined conditions from the plurality of persons, and the selected visitor The virtual space image G that reflects the position and the line of sight may be generated.
When the generation unit 53 automatically selects a visitor, for example, a visitor who is in a predetermined range and who is looking at a predetermined range is automatically selected. Select with and generate a virtual space image G that reflects the position and line of sight of the selected visitor.
In addition, when the position where the selected visitor is located deviates from a predetermined range, or the line of sight of the selected visitor deviates from a predetermined range, the generation unit 53 may be used by another visitor. A visitor who meets the conditions may be reselected from the list, or the virtual space image G may be generated based on a preset reference position and line of sight.

When the line-of-sight information for each of the plurality of visitors is acquired, the generation unit 53 is the information input from the input unit (not shown) of the image processing device 5 by the operation of the administrator of the image processing device 5. Based on (that is, manually), a visitor who reflects the position and the line of sight may be selected from the plurality of persons.

As described above, in the image processing device 5 of the modification 1 of the embodiment, the communication unit 51 (an example of the “acquisition unit”) acquires the line-of-sight information regarding the line-of-sight of the person, and the generation unit 53 uses the line-of-sight information. A virtual space image G including a virtual object corresponding to the direction of the indicated line of sight is generated. As a result, in the image processing device 5 of the first modification of the embodiment, it is possible to make the viewer view the scene that the local visitor would have seen by using the line of sight of the local visitor or the like.

In the above-mentioned modification 1, when there is a visitor who visits the site, the case where the line of sight of the visitor is reflected in the virtual space image G has been described as an example, but the present invention is not limited to this. Even if there are no visitors to visit the site, the line of sight of a person may be reflected in the virtual space image G. The image processing device 5 may, for example, have a visitor (cooperator) prepared in advance visit the site and acquire the flow line or the line of sight for each position. For example, a collaborator is asked to wear a head-mounted camera (wearable camera) to tour the site and acquire the line-of-sight information of the collaborator. Then, when there is no visitor to visit the site, the image processing device 5 may reflect the acquired line-of-sight information of the collaborator in the virtual space image G.

Further, in the above-mentioned modification 1, the case where the line of sight of an existing visitor is reflected in the virtual space image G has been illustrated and described, but the present invention is not limited to this. The person who reflects the line of sight in the virtual space image G may be a non-existent person, for example, a historical person who was active in the place displayed in the virtual space image G or a place displayed in the virtual space image G. It may be the main character of a novel on the stage.
In this case, for example, the image processing system 1 includes a line-of-sight information generation unit (not shown). The line-of-sight information generation unit extracts the position and line of sight of a historical person or the hero of a novel based on the records of historical figures, autobiographies, novel contents, etc., and generates line-of-sight information from the extracted contents. .. The line-of-sight information generation unit transmits the generated line-of-sight information to the communication unit 51.

Although some embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and variations thereof are included in the scope of the invention described in the claims and the equivalent scope thereof, as are included in the scope and gist of the invention. For example, it is possible to connect each device by wire without going through the communication network 3.

1 ... Image processing system, 2 ... Display device, 3 ... Communication network, 4 ... Environment sensor group, 5 ... Image processing device, 51 ... Communication unit, 52 ... Processing unit, 53 ... Generation unit.

Claims (7)

As environmental information about the environment, the acquisition unit that acquires the measured value measured by the environment sensor ,
A generator that processes the measured value by adding fluctuations to the measured value and changes the measured value over time, and generates an image of a virtual object according to the situation shown in the processed environmental information.
An image processing apparatus including an output unit that outputs an image generated by the generation unit. The generator processes the environmental information by adding a sine wave having a predetermined amplitude to the measured value.
The image processing apparatus according to claim 1. The acquisition unit is characterized in that it acquires the environmental information from at least one of a group of sensors that detect the environmental information at a predetermined place and a device that stores the environmental information at a predetermined place. Or the image processing apparatus according to claim 2 . The image according to any one of claims 1 to 3 , wherein the generation unit generates an environmental image that changes according to the situation shown in the environmental information based on the environmental information. Processing equipment. The acquisition unit acquires line-of-sight information regarding the line of sight of a person, and obtains the line-of-sight information.
The image processing apparatus according to any one of claims 1 to 4 , wherein the generation unit generates an image of the virtual object according to the direction of the line of sight shown in the line-of-sight information. The image processing apparatus according to any one of claims 1 to 5 .
An image processing system including an image display device that displays an image output by the image processing device. The process of acquiring the measured value measured by the environment sensor as environmental information about the environment by the acquisition unit,
A process in which the generation unit processes the measured value by adding fluctuations to the measured value and changes the measured value over time to generate a virtual object according to the situation shown in the processed environmental information.
An image processing method characterized in that the output unit includes a step of outputting an image generated by the generation unit.

Images