JP5521134B2 - Information processing system, information processing method, and program - Google Patents

Description

  The present invention relates to a technology for presenting augmented reality by combining and superimposing a real space and computer graphics image data.

  In a ski area, it was difficult to know which course was suitable for one's skill in a vast area, or which course and which lift was vacant. Especially when it is snowing in bad weather or heavy fog, the course may be lost, which is dangerous.

  To deal with such a problem, for example, Non-Patent Document 1 discloses a technique for displaying a course guidance in AR (Augmented Reality) when a portable terminal with a camera is held over a ski course. Thereby, the user can know the difficulty level of the course he / she is slipping. Non-Patent Document 2 discloses a goggle including a GPS (Global Positioning System) and a small display.

iPhone, iPod touch, iPad compatible REALSKI, Internet <URL: http: //itunes.apple.com/jp/app/realski/id341922362? mt = 8> found in iTunes App Store Hobby Internet Map Watch 104th: GPS-equipped snow goggles “Recon-Zeal Transcend GPS” wearing report, Internet <http://internet.watch.impress.co.jp/docs/column/chizu/20110217_427462.html>

  However, in the technique disclosed in Non-Patent Document 1, only information stored in advance as program data is displayed, which course, which lift is available, and identification within the course It is not possible to grasp the situation in real time such as where a fault has occurred. For example, it is impossible to know the situation that an injured person has fallen in a part that tends to be a blind spot in the course, which causes a danger. Such a problem can occur not only at ski resorts, but also at places that are susceptible to weather, such as bicycle road races.

  Therefore, an object of the present invention is to make it possible to grasp the congestion state in real time even in an area where visibility is poor.

An information processing system according to the present invention includes an augmented reality presentation device capable of combining and displaying real space and computer graphics image data, a communication device possessed by a user, and an information processing device. In the system, the communication device includes transmission means for transmitting identification information, and the information processing device includes reception means for receiving the identification information transmitted from the communication device possessed by a user, and the identification An acquisition unit configured to acquire information related to the user corresponding to the information; and a transmission unit configured to transmit information related to the user to the augmented reality presentation device , wherein the augmented reality presentation device includes the user The computer graphics image data indicating the related information is combined with the real space and displayed.

  According to the present invention, it is possible to grasp the congestion state in real time even in an area with poor visibility.

It is a figure showing composition of a ski resort guidance system concerning an embodiment of the present invention. It is a figure which shows the hardware constitutions of a ski resort management server. It is a figure which shows the hardware constitutions of goggles. It is a figure which shows the functional structure of a ski resort management server. It is a flowchart which shows a process until a ski resort management server inputs image data from an infrared camera, performs a population density analysis process for every area, and manages those histories. It is a flowchart which shows the process until a ski resort management server inputs image data from an infrared camera, performs the determination process of the presence or absence of an injured person in an injured person frequent area, and manages the log | history. It is a flowchart which shows a process until goggles issues a request and displays the computer graphics image data produced | generated in the ski resort management server by AR. It is a figure which shows the example of AR display in case the skier equipped with goggles is located in the point A of FIG. It is a figure which shows the example of AR display in case the skier equipped with goggles is located in the point B of FIG. It is a figure which shows the example of AR display in case the skier equipped with goggles is located in the point C of FIG. It is a figure which shows the example of the user information management table hold | maintained in a ski resort management server. It is a figure which shows the example of AR display in the goggles of a patrol unit.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a diagram showing a configuration of a ski resort guidance system according to an embodiment of the present invention. As shown in FIG. 1, the ski resort guidance system according to the present embodiment includes goggles 100 worn by a skier, infrared cameras 200a to 200h, and a ski resort management server 300. The infrared cameras 200a, b, d to h are installed at locations where the skiers waiting for the lift order can be photographed at the lift platforms 401 to 406. The infrared camera 200c is installed in a place where an area with frequent injuries 407 such as a sharp curve or a jumping table can be photographed. The infrared camera 200h is installed at a place where the congestion situation in the restaurant 408 can be photographed. The goggles 100 and the infrared cameras 200a to 200h are connected to the ski resort management server 300 via wireless communication lines.

  The goggle 100 is an HMD (head mounted display) capable of presenting an expanded sense of reality by displaying computer graphics image data at a position that matches the real space on a display attached to a frame. . Hereinafter, such display of computer graphics image data that gives an expanded sense of reality may be referred to as AR (Augmented Reality) display. There are various types of HMD such as a non-transmissive type, a video transmissive type, and an optical transmissive type, and any method may be adopted for the goggles 100 in this embodiment. The AR display is to superimpose and display computer graphics image data at a position that matches the real space displayed on the display of the goggles 100 by any of these methods. For example, in the case of the optical transmission type, computer graphics image data is superimposed and displayed on the real space that can be seen through, and in the case of the video transmission type, the computer graphics image data is displayed on the real space captured by the video camera. Is superimposed.

  In this embodiment, a goggle-type AR display device worn by a skier is taken as an example, but the present invention is not limited to this. That is, the present invention may be applied to a mobile terminal type AR display device that is possessed by a user and displays a real space photographed by the imaging unit on a display and displays computer graphics image data in the displayed real space. Furthermore, a head-up display AR that is installed in the line of sight in the driver's seat of a snowmobile, snow vehicle, snow pressure wheel, etc., and displays computer graphics image data in a real space that is optically transmitted and projected. You may apply to a display device.

  When computer graphics image data is displayed in alignment with the real space, the coordinates of the real space object and the computer graphics image data are aligned. As a method of coordinate alignment, based on the position (latitude, longitude) and posture (direction, elevation angle) of the goggles 100, it is estimated where the skier is looking in the real space through the display, and the estimated position is obtained. Computer graphics image data may be combined to match. In addition, a marker is attached to an object in the real space, the marker is photographed by an imaging unit attached to the goggles 100, the position of the marker is detected from the photographed image data, and is matched with the detected position. Alternatively, computer graphics image data may be synthesized at a relative position from the detected marker position. Furthermore, the position of the object in the real space may be detected by analyzing the image data in the real space captured by the imaging unit, and the computer graphics image data may be synthesized so as to match the detected position.

  The infrared cameras 200a to 200h are installed for each predetermined area in the ski resort, such as the lift platforms 401 to 406, the injury frequent occurrence area 407, and the restaurant 408. The infrared cameras 200a to 200h perform a photographing operation at a predetermined timing, and sequentially transmit the photographed image data to the ski resort management server 300. In the present invention, a visible light camera may be used in addition to the infrared camera. However, the visible light camera may not be able to acquire image data clearly depending on the weather. Is preferred. Besides the infrared camera and the visible light camera, a temperature sensor that can detect a skier well even in bad weather may be installed in each area.

  The ski resort management server 300 analyzes the population density of skiers in each area based on image data transmitted from an infrared camera or a visible light camera. As a population density analysis method, for example, a skier is detected from image data by image recognition technology, and the ratio of the number of pixels in the image area of the skier to the total number of pixels of the image data is calculated as the population density. In addition, when calculating the population density using a thermography (heat distribution image) generated by a temperature sensor, an area above a predetermined temperature in the thermography is recognized as a skier, and the skier's image for the total number of pixels of the thermography. The ratio of the number of pixels in the area is calculated as the population density. At this time, the population density can be calculated with higher accuracy by calculating the population density by subtracting the originally existing high temperature region other than the skier. Note that the system configuration shown in FIG. 1 shows one application example of the present invention. Accordingly, the number and location of the infrared cameras, the number of goggles worn by the skier, the number of ski resort management servers, and the like may be arbitrary.

  FIG. 2A is a diagram illustrating a hardware configuration of the ski resort management server 300. The CPU 3001 comprehensively controls each device connected to the system bus. The ROM 3003 or the HD (hard disk) 3006 has a basic input / output system (BIOS) that is a control program of the CPU 3001 and an operating system program, for example, the processing shown in FIGS. 4A and 4B, and the ski resort management among the processing shown in FIG. 4C. A program for processing executed by the server 300 is stored.

  In the example of FIG. 2A, the HD 3006 is arranged inside the ski resort management server 300, but as another embodiment, a configuration corresponding to the HD 3006 is arranged outside the ski resort management server 300. Also good. Further, for example, a program for performing the processing executed by the ski resort management server 300 in the processing shown in FIGS. 4A and 4B according to the present embodiment and the processing shown in FIG. 4C can be read by a computer such as a CD-ROM. It is good also as a structure recorded on a recording medium and supplied from the said recording medium, and good also as a structure supplied via communication media, such as the internet.

  The RAM 3002 functions as a main memory, work area, and the like for the CPU 3001. The HD 3006 functions as an external memory. Specifically, it stores 3D map information of each ski resort. The CPU 3001 implements various operations by loading a program necessary for execution of processing into the RAM 3002 and executing the program. The disk controller 3005 controls access to an external memory such as the HD 3006. A communication I / F controller 3004 is connected to a wireless communication line and controls communication with the outside.

  FIG. 2B is a diagram illustrating a hardware configuration of the goggles 100 according to the present embodiment. The CPU 1001 comprehensively controls each device connected to the system bus. The ROM 1003 stores, for example, a program for processing executed by the goggles 100 among the processing shown in FIG. 4C. In addition, the program for performing the process which goggles 100 performs among the processes shown to FIG. 4C is good also as a structure supplied via communication media, such as the internet.

  The RAM 1002 functions as a main memory, work memory, and the like for the CPU 1001. The CPU 1001 implements various operations by loading a program necessary for execution of processing into the RAM 1002 and executing the program. A communication I / F controller 1004 is connected to a wireless communication line and controls communication with the outside. A display controller 1006 controls image display on the display 1007. In the present embodiment, the display 1007 is a small display mounted on the frame of the goggles 100. Furthermore, a position sensor and a posture sensor for detecting the position and posture of the goggles 100 are provided. Note that, as described above, when performing video transmission type AR display, an imaging unit is also provided (not shown).

  FIG. 3 is a diagram illustrating a functional configuration of the ski resort management server 300. In FIG. 3, an image data input unit 301 inputs (receives) each image data photographed by the infrared cameras 200a to 200h. The population density analysis unit 302 analyzes the population density of the skier for each area based on the image data captured by the infrared cameras 200a, 200b, and dh input by the image data input unit 301. That is, the population density analysis unit 302 detects skiers in each area by using an image recognition technique for each image data photographed by the infrared cameras 200a, 200b, dh, and the entire image data in each area. The ratio of the number of pixels in the skier's image area to the number of pixels is calculated as the population density. The population density analysis unit 302 analyzes the population density at a predetermined time interval (for example, every 10 minutes) and registers the history in the population density management table 304.

  The injured person identifying unit 303 determines the presence or absence of injured persons in the injured person frequent occurrence area 407 based on the image data captured by the infrared camera 200c input by the image data input unit 301. In other words, the injured person identifying unit 303 monitors the movement of the skier by using image recognition technology on the image data captured by the infrared camera 200c, and there is a skier whose movement is not detected for a predetermined time (for example, 10 minutes). If so, the skier is determined as an injured person. The injured person identifying unit 303 determines the presence or absence of an injured person at a predetermined time interval (for example, every 10 minutes), and registers the history in the injured person management table 305.

  The population density management table 304 manages the history of population density analyzed by the population density analysis unit 302 for each area (here, lift platform or restaurant). The injured person management table 305 manages the history of the presence or absence of injured persons determined by the injured person identifying unit 303 for each injured person frequent occurrence area.

  The request reception unit 306 receives a request including the position and posture of the goggles 100 from the goggles 100 worn by the skier. The user view determination unit 307 determines the view of the skier wearing the goggles 100 based on the position and posture of the goggles 100 included in the request received by the request reception unit 306.

  The first data extraction unit 308 determines an area included in the field of view determined by the user field determination unit 307, and the latest population density among the population density history corresponding to the determined area is stored in the population density management table 304. Extract from The second data extraction unit 309 determines an area included in the field of view determined by the user field determination unit 307, and an injured person management table of the presence or absence of the latest injured person in the history of the presence or absence of an injured person corresponding to the determined area Extract from 305. Based on the latest population density extracted by the first data extraction unit 308, the CG generation unit 310 generates computer graphics image data indicating the skier population density in the corresponding area. In addition, when the information extracted by the second data extraction unit 309 (the presence or absence of the latest injured person) indicates that an injured person exists, the CG generating unit 310 indicates that an injured person exists in the corresponding area. The computer graphics image data shown is generated. Then, the CG generation unit 310 transmits the generated computer graphics image data to the goggles 100 that received the request in the request reception unit 306. The goggles 100 AR displays computer graphics image data in alignment with the real space.

  Note that the request reception unit 306 and the image data input unit 301 in FIG. 3 have a configuration corresponding to the communication I / F controller 3004 in FIG. 2A. In addition, the user view determination unit 307, the population density analysis unit 302, the injured person identification unit 303, the first data extraction unit 308, the second data extraction unit 309, and the CG generation unit 310 in FIG. This configuration is realized by loading the RAM 3002 and executing it. The population density management table 304 and the injured person management table 305 have a configuration corresponding to a partial storage area of the RAM 3002.

  Next, processing of the ski resort management server 300 will be described with reference to FIGS. 4A to 4C. FIG. 4A shows a process from when the ski resort management server 300 inputs image data from the infrared cameras 200a, 200b, 200d to 200hh, executes population density analysis processing for each area, and manages their history. It is a flowchart.

  In step S401, the image data input unit 301 determines whether image data has been input (received) from any of the infrared cameras 200a, 200b, and dh. When image data is input, the process proceeds to step S402. On the other hand, if no image data has been input, the process returns to step S401 to wait for input of image data.

  In step S <b> 402, the population density analysis unit 302 analyzes the population density of skiers in a corresponding area based on the image data input in the image data input unit 301. In step S <b> 403, the population density analysis unit 302 registers the population density analysis result in the population density management table 304 in association with the area and population density analysis time. The above-described steps S401 to S403 are processes that are repeatedly executed.

  FIG. 4B is a flowchart showing a process from when the ski resort management server 300 receives image data from the infrared camera 200c, executes a process for determining the presence or absence of injuries in the frequently injured area 407, and manages the history.

  In step S404, the image data input unit 301 determines whether image data has been input (received) from the infrared camera 200c. If image data has been input, the process proceeds to step S405. On the other hand, if no image data has been input, the process returns to step S404 to wait for input of image data.

  In step S <b> 405, the injured person identification unit 303 determines the presence or absence of injuries in the injured person frequent occurrence area 407 based on the image data input in the image data input unit 301. In step S <b> 406, the injured person identification unit 303 registers the determination result regarding the presence or absence of an injured person in the injured person management table 305 in association with the injured person frequent occurrence area 407 and the injured person determination time. The above-described steps S404 to S406 are processes that are repeatedly executed.

  FIG. 4C is a flowchart illustrating a process from when the goggles 100 issues a request until the computer graphics image data generated in the ski resort management server 300 is displayed as an AR.

  In step S410, the goggles 100 issues a request including the position and posture of the goggles 100. By issuing the request in the goggles 100 repeatedly in a short time, the superimposed display content in the AR, which will be described later, becomes information with real-time characteristics. However, in this case, the information processing load on the communication, goggles 100, and ski resort management server 300 may increase. For example, it may be issued only when the skier is stopped. Alternatively, a request may be issued by a switch operation of a skier, or ON / OFF of superimposed display may be switched. The switch may be provided in the goggles 100 or may be provided in stock or a lift ticket (card, IC chip medium, etc.) possessed by the skier. When a switch is provided in a stock or the like, it is preferable to incorporate a wireless communication function in the stock or the like and transmit switch information to and from the goggles 100 by wireless communication.

  In step S <b> 411, the request reception unit 306 of the ski resort management server 300 receives a request from the goggles 100. In step S412, the user field determination unit 307 of the ski resort management server 300 determines the field of view of the skier wearing the goggles 100 based on the position and posture included in the request. Next, the process proceeds to both steps S413 and S415. Hereinafter, although step S413 and S415 are demonstrated separately, this may be processed independently or may be performed simultaneously by parallel processing.

  In step S413, the first data extraction unit 308 determines an area included in the field of view determined by the user field of view determination unit 307, and uses the latest population density among the population density history corresponding to the determined area. Extracted from the density management table 304. In step S414, the CG generation unit 310 generates computer graphics image data indicating the skier population density in the corresponding area based on the latest population density extracted by the first data extraction unit 308.

  In step S415, the second data extraction unit 309 determines an area included in the field of view determined by the user field of view determination unit 307, and the latest injured person in the history of the presence or absence of an injured person corresponding to the determined area. Is extracted from the injured person management table 305. In step S416, the CG generation unit 310 determines whether the information extracted by the second data extraction unit 309 indicates that an injured person exists. If it is indicated that there is an injured person, the process proceeds to step S417. On the other hand, if it is not indicated that there is an injured person, the process skips step S417 and proceeds to step S418. In step S417, the CG generation unit 310 generates computer graphics image data indicating that an injured person exists.

  In step S418, the CG generation unit 310 transmits the computer graphics image data generated in step S414 or the computer graphics image data generated in steps S414 and S417 to the goggles 100. In step S419, the goggles 100 receives computer graphics image data from the ski resort management server 300. In step S420, the goggles 100 AR displays the received computer graphics image data. In this embodiment, computer graphics image data is generated on the ski resort management server 300 side. However, necessary information is given from the ski resort management server 300 to the goggles 100, and the computer graphics image data on the goggles 100 side. May be generated.

  5A to 5C are diagrams illustrating an AR display example in the goggles 100. FIG. More specifically, FIG. 5A shows an AR display example when the skier wearing the goggles 100 is located at the point A in FIG. FIG. 5B shows an example of AR display when the skier wearing the goggles 100 is located at the point B in FIG. FIG. 5C shows an AR display example when the skier wearing the goggles 100 is located at the point C in FIG.

  As shown in FIG. 1, when a skier wearing goggles 100 is present at point A, the lift landing 401 is visible on the right hand in the line of sight (sliding direction) of the skier, and the lift landing 402 is visible on the left hand. The ski resort management server 300 determines that the lift landings 401 and 402 are included in the skier's field of view based on a request (including position and inclination) issued from the goggles 100 when the skier is at the point A. . The ski resort management server 300 acquires the latest population density corresponding to the areas of the lift platforms 401 and 402, and generates computer graphics image data indicating the skier population density at the lift platforms 401 and 402. The generated computer graphics image data is transmitted from the ski resort management server 300 to the goggles 100. Then, as shown in FIG. 5A, the goggles 100 receives computer graphics image data 502 indicating the population density of the skier at the lift platform 401 and computer graphics image data 501 indicating the population density of the skier at the lift platform 402 as AR. indicate.

  As shown in FIG. 5A, in the goggles 100, the computer graphics image data 501 and 502 are combined and displayed at positions matching the real space, so the population density of the lift platform 401 is shown on the right hand side in the skier's line of sight. Computer graphics image data 502 is displayed, and computer graphics image data 501 indicating the population density of the lift platform 402 is displayed on the left hand side of the skier's line of sight. In the example of FIG. 5A, information such as “vacant state” or “crowded” is presented in computer graphics image data indicating the population density, but the ratio of the skier image area to the total number of pixels of the image data is Computer graphics image data representing “busy” is generated when the value is equal to or greater than a predetermined value (for example, 50%), and computer graphics image data representing “free” is generated otherwise. Further, since the request from the goggles 100 includes the position of the goggles 100, information indicating the distance and direction from the position of the goggles 100 to the lift platforms 401 and 402 is presented in the computer graphics image data. Yes. As a result, the density of people or objects in each area can be presented in real time, and even if the field of view is poor, the skier can grasp the congestion status of each area.

  Also, as shown in FIG. 1, when a skier wearing goggles 100 is present at point B, the lift platform 403 is visible on the right hand in the gaze direction (sliding direction) of the skier, and the injury frequent occurrence area 407 is on the left hand. appear. The ski resort management server 300 includes a lift platform 403 and an injury-prone area 407 in the skier's field of view based on a request (including position and inclination) issued from the goggles 100 when the skier is at the point B. Is determined. Then, the ski resort management server 300 acquires the latest population density corresponding to the lift platform 403 and the presence or absence of the latest injured person corresponding to the injured person frequent occurrence area 407. Here, it is assumed that the presence or absence of the latest injured person corresponding to the frequently injured person area 407 indicates that an injured person exists. The ski resort management server 300 generates computer graphics image data 504 indicating the population density of skiers at the lift platform 403 and also generates computer graphics image data 503 indicating that there are injuries in the frequent injury area 407. The generated computer graphics image data is transmitted from the ski resort management server 300 to the goggles 100. Then, as shown in FIG. 5B, the goggles 100 includes computer graphics image data 504 indicating the skier population density at the lift platform 403 and computer graphics image data indicating that injuries are present in the injured person frequent occurrence area 407. 503 and AR are displayed.

  As shown in FIG. 5B, in the goggles 100, the computer graphics image data 503 and 504 are combined and displayed at positions matching the real space, so that the population density of the lift platform 403 is shown on the right hand side of the skier's line of sight. Computer graphics image data 504 is displayed, and computer graphics image data 504 indicating the presence of an injured person is displayed on the left hand side of the skier's line of sight. In the example of FIG. 5B as well, information representing the distance and direction from the position of the goggles 100 to the lift platform 403 and the frequently injured area 407 is presented in the computer graphics image data. Thereby, even if the field of view is poor, the skier can grasp whether or not an injured person is generated in an injured person frequent occurrence area.

  Also, as shown in FIG. 1, when a skier wearing goggles 100 is present at point C, a restaurant 408 can be seen in front of the skier's line-of-sight direction (sliding direction). The ski resort management server 300 determines that the restaurant 408 is included in the skier's field of view based on a request (including position and inclination) issued from the goggles 100 when the skier is at the point C. Then, the ski resort management server 300 acquires the latest population density corresponding to the restaurant 408, and generates computer graphics image data 505 indicating the population density of skiers in the restaurant 408. The generated computer graphics image data 505 is transmitted from the ski resort management server 300 to the goggles 100. Then, as shown in FIG. 5C, in the goggles 100, since the computer graphics image data 505 indicating the population density of the skiers in the restaurant 408 is AR-displayed, the latest population corresponding to the restaurant 408 in front of the skier's line of sight. Computer graphics image data 505 indicating the density is AR-displayed.

  In the embodiment described above, computer graphics image data including information regarding population density and the presence of an injured person is generated and displayed in AR only for an area included in the field of view of a skier wearing the goggles 100. Is not limited to this. That is, it relates to a lift platform and an injured person area in an area indirectly related to the field of view of the skier wearing the goggles 100 (for example, an area that cannot be directly seen by the skier but may be skied). Computer graphics image data may be generated and AR displayed. In addition to the lift platform and restaurant, computer graphics image data indicating the population density may be generated for the course. In addition, it is not necessary to detect only a person such as a skier. For example, even if the snow area in the sliding area has little snow cover and the ground is exposed, an AR display such as “this snow shortage” is displayed. Good. In this case as well, it is sufficient to use a method of determining the snow surface and the ground (grassland or topsoil) by image processing, or detecting a temperature difference using an infrared camera or a temperature sensor. Further, since the population density management table 304 manages the history of population density, and the injured person management table 305 manages the history of the presence or absence of injured persons, the goggles 100 includes computer graphics including information based on the history. Image data may be displayed in AR. For example, by displaying AR of the population density history up to 30 minutes before the present time, the skier can grasp the recent transition state of the population density, which can be used for prediction of future population density. Also, by displaying the history of the presence or absence of an injured person 30 minutes before the present time, the skier can grasp how long the injured person has occurred.

  Next, another embodiment of the present invention will be described. In addition to the ski resort guidance system configuration according to the embodiment described above, the ski resort guidance system according to the present embodiment is installed at an ID transmitter mounted on a lift ticket owned by a skier, and at each point of the ski resort, An ID receiver that receives an ID (user identification information) transmitted from the transmitter. The skier operates the lift ticket ID transmitter in the event of an emergency such as injury, and transmits the ID. The ID transmitted from the ID transmitter is received by the nearest ID receiver. The ID receiver transmits the position information of the ID receiver together with the ID to the ski resort management server 300 in FIG. Upon receiving the ID and the position information of the ID receiver, the ski resort management server 300 searches for user information corresponding to the ID.

  FIG. 6 is a diagram illustrating an example of a user information management table held in the ski resort management server 300. As shown in FIG. 6, in the user information management table, user information (name, sex, weight, height, ski wear color) is managed for each ID. In addition, user information may add arbitrary information in addition to the information listed here. When receiving the ID, the ski resort management server 300 acquires user information managed in association with the ID from the user information management table. The ski resort management server 300 generates computer graphics image data indicating that an emergency has occurred, the acquired user information, and the position information of the ID receiver, and transmits the computer graphics image data to the goggles 100 of the patrol team. Then, the patrol team's goggles 100 AR displays the computer graphics image data received from the ski resort management server 300.

  FIG. 7 is a diagram illustrating an example in which the computer graphics image data received as described above is AR-displayed by the patrol goggles 100. As shown in FIG. 7, the position of the ID receiver as the skier's position (200 m ahead), the fact that an emergency occurred (SOS occurred!), And user information (ID, name, gender, weight, height, Computer graphics image data indicating the color of the skiwear is displayed as an AR. In this way, the position of the ID receiver and the user information of the injured person can be notified to the patrol team, so it becomes possible to grasp the position of the injured person and the attributes of the injured person, and to rescue the injured person immediately. it can. Moreover, by displaying AR together with the population density of each area such as a ski course, it is possible to select a course with a low population density and go to rescue with a snowmobile.

  In this embodiment, each skier is allowed to have an ID transmitter. However, as another embodiment, a GPS portable terminal may be held. By transmitting the skier ID from the GPS portable terminal and the information indicating the position of the GPS portable terminal as information indicating the position of the skier to the ski resort management server 300, the position of the skier is more accurately determined by the patrol team. Can be notified. In this case, it is not necessary to install an ID receiver for relaying the ID at the ski resort.

  In the above, a ski resort has been cited as an example of an environment with poor visibility, but in addition to this, for example, there are many cases where visibility is poor due to the influence of the weather even in bicycle road races, and each athlete in the road race also mentioned above. By wearing such goggles, it becomes possible to grasp information regarding the population density and the presence or absence of injured persons during the race. In addition, when watching a soccer game, it is impossible to grasp the vacant seats in the game venue from the vicinity of the entrance of the game venue. It may be judged whether there is. However, by using the AR display as described above near the entrance of the game hall, it is possible to grasp which side of the spectator seat is vacant without having to go to the place where the spectator seat can actually be seen. It becomes.

In the above-described embodiment, the population density of each area is displayed as AR. However, the present invention is not limited to the population density, and the density of an object such as a car in each area may be similarly analyzed and displayed as AR.
As described above, the superimposed display can be switched between display and non-display by a switch operation of a skier (user). May be used as a switch function. For example, the display / non-display may be switched by a two-time operation.

  100: Goggles (augmented reality presentation device held by a skier), 200a to 200h: Infrared camera, 300: Ski management server, 401 to 406: Lift platform, 407: Injury-prone area, 408: Restaurant

Claims (9)

An information processing system having an augmented reality presentation device capable of combining and displaying real space and computer graphics image data, a communication device possessed by a user, and an information processing device,
The communication device has a transmission means for transmitting identification information,
The information processing apparatus includes:
Receiving means for receiving the identification information transmitted from the communication device possessed by a user;
Obtaining means for obtaining information relating to the user corresponding to the identification information;
Transmission means for transmitting information relating to the user to the augmented reality presentation device ;
The augmented reality presentation device includes:
An information processing system characterized in that computer graphics image data indicating information relating to the user is combined with a real space and displayed. The receiving means receives information indicating the position of the user;
The transmission means of the information processing device transmits information indicating the position of the user to the augmented reality presentation device,
The augmented reality presentation device includes:
The information processing system according to claim 1, wherein computer graphics image data indicating the position of the user is combined with a real space and displayed. The information processing system further includes a receiving device that receives the identification information from the communication device and transmits information indicating the position of the communication device to the information processing device as information indicating the position of the user together with the identification information. Have
The information processing system according to claim 2 , wherein the receiving unit receives the identification information and information indicating the position of the user from the receiving device . The communication device is a GPS mobile terminal,
4. The information processing according to claim 2 , wherein the receiving unit receives information indicating the position of the GPS portable terminal from the GPS portable terminal as information indicating the position of the user together with the identification information. system. The information processing system further includes a plurality of information acquisition devices that sequentially acquire information related to a target area,
The information processing apparatus includes:
Based on information relating to each area acquired by the plurality of information acquisition devices, analysis means for analyzing the density of people or things for each area;
Determination means for determining an area corresponding to the state of the augmented reality presentation device;
The transmitting means transmits information indicating the density of a person or an object in an area corresponding to the state of the augmented reality presentation device to the second augmented reality presentation device,
The augmented reality presentation device includes:
The information processing system according to any one of claims 1 to 4, characterized in that displaying the person or computer graphics image data representing the density of the object by combining the real space. An information processing method executed by an information processing system having an augmented reality presentation device capable of combining and displaying real space and computer graphics image data, a communication device possessed by a user, and an information processing device Because
A first transmission step in which the communication device transmits identification information;
A receiving step in which the information processing device receives the identification information transmitted from the communication device possessed by a user;
The information processing apparatus acquires an information relating to the user corresponding to the identification information; and
A second transmission step in which the information processing apparatus transmits information relating to the user to the augmented reality presentation apparatus;
A display step in which the augmented reality presentation device synthesizes and displays computer graphics image data indicating information related to the user in a real space;
An information processing method comprising: In the receiving step, the information processing apparatus receives information indicating the position of the user,
In the transmission step, the information processing apparatus transmits information indicating the position of the user to the augmented reality presentation apparatus,
The information processing method according to claim 6, wherein, in the display step, the augmented reality presentation device displays computer graphics image data indicating the position of the user by combining it with a real space. An information processing method executed by an information processing system having an augmented reality presentation device capable of combining and displaying real space and computer graphics image data, a communication device possessed by a user, and an information processing device A program for causing a computer to execute
Causing the computer of the communication device to execute a transmission step of transmitting identification information;
In the computer of the information processing apparatus,
A receiving step of receiving the identification information transmitted from the communication device possessed by a user;
An acquisition step of acquiring information relating to the user corresponding to the identification information;
Transmitting information related to the user to the augmented reality presentation device, and
In the computer of the augmented reality presentation device,
A program for executing a step of combining computer graphics image data indicating information on the user with a real space for display. In the receiving step, the information processing apparatus receives information indicating the position of the user,
In the transmission step, the information processing apparatus transmits information indicating the position of the user to the augmented reality presentation apparatus,
9. The program according to claim 8, wherein in the display step, the augmented reality presentation device displays computer graphics image data indicating the position of the user by combining it with a real space.

Images