JP2012195749A - Imaging direction display method for portable terminal, portable terminal with imaging direction display function, and imaging direction display system for portable terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal with an imaging direction display function capable of making correctable and accurate display of imaging directions of imaging various facilities be performed on a display screen under status of geomagnetic disturbances.SOLUTION: A portable terminal 1 comprises: facilities data management means 9 for managing facilities master data acquired from a management server 2; a camera 3 imaging indoor various facilities; a direction sensor 5 detecting an imaging direction; facilities data display means 6 for displaying facilities data superposed on the various facilities on a display screen of a display 4; and portable terminal direction input means 7 for: displaying a portable terminal position on map data and a portable terminal direction toward facilities seen in the imaging direction from the portable terminal position superposed on the map data, when displaying indoor map data of master data; and displaying a portable terminal direction (imaging direction) modified correctly according to input of a look-at point position showing a correct imaging direction by an input operation of the look-at point position after displaying the portable terminal position on the map data, under status of geomagnetic disturbances.

Description

  The present invention relates to a technique for displaying an imaging direction for a portable terminal that is suitable for use mainly during maintenance inspection by imaging various indoor facilities, and more specifically, an imaging direction is detected by a direction sensor using geomagnetism. An imaging direction display method for a mobile terminal and an imaging direction display for making it possible to correct the imaging direction when imaging various facilities installed indoors with a portable terminal, and for accurately performing on the display screen of the attached display unit The present invention relates to a portable terminal with a function and an imaging direction display system for a portable terminal.

  Conventionally, in a system that handles position information for positioning the direction of an operator of a mobile terminal, direction positioning is performed based on geomagnetic data obtained by a direction sensor using geomagnetism mounted on the mobile terminal. In recent portable terminals, there are many types including an imaging unit such as a camera, and the direction sensor in such a case detects the imaging direction of the imaging unit.

  In general, as a well-known technique for detecting the position of an indoor person, for example, an “indoor position detection apparatus and an indoor position detection method for correcting the indoor traveling direction and absolute position information using a magnetic azimuth sensor or a gyro sensor,” for example. (Refer to Patent Document 1), “traveling direction measuring device and traveling direction measuring method” (refer to Patent Document 2) for estimating the moving direction of a person (pedestrian) indoors using geomagnetic detection means and acceleration detection means, Examples include a “computer vision system graphic user interface generation device” (see Patent Document 3) that changes the content or shape of display information in imaging data based on the latitude, longitude, and orientation of a camera.

Japanese Patent No. 3915654 Japanese Patent No. 4515497 Japanese Patent No. 4294093

  The above-described technology for performing direction measurement indoors according to Patent Document 1 and Patent Document 2 uses a direction sensor using geomagnetism, a three-axis acceleration sensor, a gyro sensor, and the like. Depending on the position information, the contents and shape of the information displayed in part of the field area on the imaging data and in the peripheral part are changed. By applying these technologies to mobile terminals, maintenance inspections of various indoor facilities are performed. When used in the above, there is a problem that it becomes difficult for an operator to visually confirm the imaging direction (portable terminal direction) for each facility on the display screen, and to check it properly.

  In particular, in the case of a portable terminal with an imaging function equipped with a direction sensor using geomagnetism, the direction sensor can indicate the imaging direction when used in a situation where geomagnetism is disturbed, for example, when the door is closed with a metal door closed. There is a problem that it is difficult to maintain stable positioning accuracy, for example, image data is erroneously displayed on the display screen without being detected accurately.

  In addition, when estimating the direction using a triaxial acceleration sensor or gyro sensor on a mobile terminal, an error is likely to accumulate, so a geomagnetic sensor is used as a correction means. However, when a geomagnetic sensor is used, As described above, under the situation where the geomagnetism is disturbed, it is difficult to maintain a stable positioning accuracy, such as causing an erroneous display on the image data without properly detecting the imaging direction. There is a problem that it is not possible to accurately measure the direction under disturbed conditions.

  The present invention has been made to solve such problems, and one of the technical problems is that the operator can easily visually display the imaging direction for each facility on the display screen. The present invention provides an imaging direction display method for mobile terminals, a mobile terminal with an imaging direction display function, and an imaging direction display system for mobile terminals that can be confirmed.

  In addition, another technical problem of the present invention is that a mobile phone capable of correcting the display of the imaging direction on the display screen with high accuracy even in a situation where geomagnetism is not detected correctly by the direction sensor. An object is to provide an imaging direction display method for a terminal, a portable terminal with an imaging direction display function, and an imaging direction display system for a portable terminal.

  In order to solve the above technical problem, the first means of the present invention is such that, on the management server side, equipment master data for accumulating and managing equipment master data relating to various data of a plurality of equipment installed in an indoor room The management terminal includes a facility data management step for storing and managing facility data included in the facility master data acquired from the management server, and on the mobile terminal side, the facility master data includes imaging data obtained by imaging a plurality of indoor facilities. When the image data is displayed as image data on the display screen of the display unit provided based on the position data included in the image and the direction of the image detected by the direction sensor using geomagnetism, the facility data A facility data display step for superimposing and displaying indoor layers including a plurality of facilities included in the facility master data on the display screen. Mobile terminal direction for superimposing and displaying the mobile terminal position on the indoor map data and the mobile terminal direction for the equipment that is visible in the imaging direction from the mobile terminal position on the indoor map data. And a display step.

  The second means, in the first means, in the portable terminal direction display step, for the image data on the display screen in the equipment data display step, the geomagnetism in which the equipment data is not superimposed on a plurality of equipment is disturbed, When the operator inputs an attention point position indicating a correct imaging direction after displaying the portable terminal direction on the indoor map data, the portable terminal direction is corrected and displayed in accordance with the input of the attention point position. .

  The third means is the second means wherein the mobile terminal side corrects and displays the mobile terminal direction in the mobile terminal direction display step, and then the corrected image data in which the equipment data is superimposed on a plurality of facilities on the display screen. A modified image data display step for displaying.

  The fourth means divides the image data in the portable terminal direction display step and the indoor map data in the portable terminal direction display step on the display screen in any one of the first means to the fourth means. And displaying them simultaneously.

  The fifth means stores and manages equipment data included in the equipment master data acquired from a management server that stores and manages equipment master data related to various data of a plurality of equipment installed in an indoor room. Equipment data management means, imaging means capable of imaging a plurality of indoor facilities, a direction sensor for detecting an imaging direction by the imaging means using geomagnetism, and imaging data relating to a plurality of indoor facilities by the imaging means When displaying on the display screen of the display unit attached as image data based on the position data included in the master data and the imaging direction detected by the direction sensor, the facility data is superimposed on the plurality of facilities, respectively. Indoor map data showing the indoor layout including the equipment data display means to be displayed and the plurality of equipment included in the equipment master data on the display screen is taken. A portable terminal direction input means for superimposing and displaying a portable terminal position on the indoor map data and a portable terminal direction with respect to equipment that is visible in the imaging direction from the portable terminal position on the indoor map data when displaying based on the direction; It is characterized by that.

  The sixth means is the fifth means in which the portable terminal direction input means is in a situation where the geomagnetism in which the equipment data is not superimposed on a plurality of equipment is disturbed with respect to the image data on the display screen displayed by the equipment data display means. When the operator inputs a gaze point position indicating the correct imaging direction after displaying the mobile terminal direction on the indoor map data, the mobile terminal direction is correctly corrected and displayed according to the input of the gaze point position. And

  The seventh means is the sixth means, wherein the portable terminal direction input means includes a gaze point input processing function for inputting a gaze point position on the indoor map data when the direction sensor cannot correctly detect the imaging direction; And a mobile terminal direction update processing function for updating and displaying the terminal direction in the direction of the gazing point position.

  The eighth means is the sixth means or the seventh means, wherein the equipment data display means corrects and displays the mobile terminal direction by the terminal direction input means, and then superimposes the equipment data on a plurality of equipment on the display screen. The corrected image data is displayed.

  The ninth means is any one of the fifth means to the eighth means. The portable terminal direction input means is a position specifying input for specifying and operating a gaze point position on the indoor map data. It is characterized by having a function.

  The tenth means is any one of the fifth to ninth means, wherein the facility data display means and the portable terminal direction input means divide the image data and the indoor map data on the display screen. It is possible to display simultaneously.

  The eleventh means is an imaging direction display system for a portable terminal comprising a portable terminal with an imaging direction display function according to any one of the fifth to tenth means and a management server. Features.

  According to the present invention, when an indoor facility is imaged by an imaging means with a portable terminal, the direction sensor uses geomagnetism, so that if the geomagnetism is normal, the imaging direction is correctly detected and the display unit On the display screen, the position of the mobile terminal on the indoor map data and the correct mobile terminal direction (imaging direction) facing the equipment actually captured are superimposed and displayed. The operator (operator) can appropriately perform maintenance inspection on the target. Even if the imaging direction is not detected correctly in an abnormal state where the indoor environment is blocked by a metal door or the like and the geomagnetism is disturbed, the gaze point position indicating the correct imaging direction is displayed on the indoor map data on the display screen. If the input operation is performed, the correct mobile terminal direction (imaging direction) is automatically corrected and displayed. Similarly, maintenance and inspection can be appropriately performed on various indoor facilities, which is beneficial to the industry. .

It is the block diagram which showed the whole structure of the imaging direction display system for portable terminals which concerns on Example 1 of this invention. It is the flowchart which showed the operation | movement process of the installation data display means with which the portable terminal with an imaging direction display function of the imaging direction display system for portable terminals shown in FIG. It is the flowchart which showed the operation | movement process of the portable terminal direction input means with which the portable terminal with an imaging direction display function of the imaging direction display system for portable terminals shown in FIG. The non-metallic door which does not disturb the geomagnetism in which the operator who owns the portable terminal of the same function as the portable terminal with the imaging direction display function of the imaging direction display system for portable terminals shown in FIG. It is the schematic diagram which illustrated the usage pattern when entering into a room in closed state. The first equipment displayed on the display screen of the display when the mobile terminal is imaged toward the first equipment under the situation where the geomagnetism described in FIG. 4 is not disturbed, the first equipment data superimposed on the second equipment, The image data containing 2nd equipment data is illustrated. Indoor map data including a mobile terminal position displayed on the display screen of the mobile terminal when the mobile terminal direction input means of the mobile terminal is activated in a situation where the geomagnetism described in FIG. Is illustrated. The operator who owns the mobile terminal having the same function as the mobile terminal with the imaging direction display function of the imaging direction display system for mobile terminals shown in FIG. 1 closes the metal door that disturbs the geomagnetism where the first equipment and the second equipment are installed. It is the schematic diagram which illustrated the usage pattern when entering a room in a state. The position was shifted without being superimposed on the first equipment and the second equipment displayed on the display screen of the display when the mobile terminal was imaged toward the first equipment under the situation where the geomagnetism described in FIG. 7 was disturbed. The image data containing 1st installation data and 2nd installation data is illustrated. The indoor map including the mobile terminal position displayed on the display screen of the mobile terminal when the mobile terminal direction input means of the mobile terminal is activated in the situation where the geomagnetism described in FIG. This is an example of data. In the situation where the geomagnetism described in FIG. 7 is disturbed, the mobile terminal direction input means of the mobile terminal is activated, and after the mobile terminal position is displayed, the operator inputs the gaze point position indicating the correct imaging direction on the display screen of the display. Fig. 4 illustrates indoor map data including a correct mobile terminal direction that is sometimes displayed on a display screen of a display. The first equipment data superimposed on the first equipment and the second equipment displayed and displayed on the display screen of the display by the function of the equipment data display means after inputting the gaze point position indicating the correct imaging direction illustrated in FIG. FIG. 4 illustrates modified image data including second equipment data.

  Hereinafter, an imaging direction display method for a mobile terminal, a mobile terminal with an imaging direction display function, and an imaging direction display system for a mobile terminal according to the present invention will be described in detail with reference to the drawings.

  First, a technical outline of the imaging direction display method for a portable terminal according to the present invention will be briefly described. The imaging direction display method for a portable terminal of the present invention has, on the management server side, an equipment master data management step for accumulating and managing equipment master data related to various data of a plurality of equipment installed in an indoor room, On the mobile terminal side, equipment data management step for accumulating and managing equipment data included in equipment master data acquired from the management server, and position data included in equipment master data for imaging data obtained by imaging a plurality of indoor equipment, In addition, when displaying as image data on the display screen of the display unit provided based on the imaging direction detected at the time of imaging by the direction sensor using geomagnetism, the facility data is displayed by superimposing the facility data on a plurality of facilities, respectively. Indoor map data showing the indoor layout including the display step and the plurality of equipment included in the equipment master data on the display screen A mobile terminal direction display step for superimposing and displaying the mobile terminal position on the indoor map data and the mobile terminal direction with respect to the equipment visible in the imaging direction from the mobile terminal position on the indoor map data. is there.

  However, in the mobile terminal direction display step, the image data on the display screen in the equipment data display step is in a situation where the geomagnetism in which the equipment data is not superimposed on a plurality of equipment is disturbed, and in the mobile terminal direction on the indoor map data. When the operator inputs a gaze point position indicating a correct imaging direction after display, the mobile terminal direction is corrected and displayed in accordance with the input of the gaze point position. Furthermore, the mobile terminal side has a corrected image data display step for displaying corrected image data in which equipment data is superimposed on a plurality of facilities on the display screen after correctly correcting and displaying the mobile terminal direction in the mobile terminal direction display step. It is preferable. In any case, it is preferable that the image data in the mobile terminal direction display step and the indoor map data in the mobile terminal direction display step are divided and displayed simultaneously on the display screen.

  According to such an imaging direction display method for a mobile terminal, the geomagnetism is normal because the direction sensor uses the geomagnetism when the indoor device is imaged by an imaging means such as a camera with the mobile terminal as an imaging target. If it is in a state, the display direction of the display unit attached with the imaging direction correctly detected is superimposed with the position of the mobile terminal on the indoor map data and the correct mobile terminal direction facing the actually captured equipment. Since the information is displayed, the operator (operator) can perform maintenance inspection and the like accurately for various facilities installed indoors. Even if the imaging direction is not detected correctly in an abnormal state where the indoor environment is blocked by a metal door or the like and the geomagnetism is disturbed, the gaze point position indicating the correct imaging direction is displayed on the indoor map data on the display screen. If the input operation is performed, the correct mobile terminal direction is automatically corrected and displayed, so that maintenance and inspections can be appropriately performed on various indoor facilities as well.

  FIG. 1 is a block diagram illustrating an overall configuration of an imaging direction display system for a portable terminal according to Embodiment 1 of the present invention.

  This mobile terminal imaging direction display system is applied to the equipment management server 2 that manages equipment master data related to various data for a plurality of various equipment installed in an indoor room, and the above-described imaging direction display method for mobile terminals. And a portable terminal 1 with an imaging direction display function.

  As is well known, the facility management server 2 and the portable terminal 1 are configured to include a storage device using a CPU, a main memory, an auxiliary storage unit (HDD), a display device, and an input / output device such as a keyboard / mouse. However, the portable terminal 1 is configured such that an input operation unit included in a display device or an input / output device is integrated into a main body unit as a display unit or a key operation unit.

  Here, the portable terminal 1 with an imaging direction display function accumulates and manages equipment data included in the equipment master data acquired from the management server 2 and includes imaging data obtained by imaging various indoor equipment in the equipment master data. When displaying as position data and image data on the display screen of the display unit based on the imaging direction detected at the time of imaging by a direction sensor using geomagnetism, a function of superimposing and displaying equipment data on each facility, When indoor map data indicating an indoor layout including each equipment included in the equipment master data on the display screen is displayed based on the imaging direction, the equipment that can be seen in the imaging direction from the mobile terminal position and the mobile terminal position on the indoor map data And a function of superimposing and displaying the direction of the mobile terminal.

  More specifically, the management server 2 stores the equipment master data database (DB) 13 that stores and stores equipment master data related to various data of a plurality of equipment, and equipment master data in the equipment master data database 13. Equipment master data management means 12 that performs data processing management such as registration, deletion, and update for each equipment data that is included, and equipment master data relating to each equipment in the room where the mobile terminal 1 is located with respect to the mobile terminal 1 And an equipment management server communication means 11 for wireless transmission. The equipment master data here includes indoor map data indicating a layout including each indoor equipment, position data and name data for each equipment.

  The portable terminal 1 includes a portable terminal communication unit 8 that receives the facility master data transmitted by the facility management server communication unit 11 of the facility management server 2 and various facility data included in the facility master data received by the portable terminal communication unit 8. Equipment data management means 9 for managing equipment data database (DB) 10, equipment data database 10 in which various equipment data are accumulated and stored by equipment data management means 9, and installed indoors. A camera 3 as an imaging means for imaging various facilities, a direction sensor 5 for detecting an imaging direction in which an operator points the camera 3 using geomagnetism, and imaging data relating to various facilities by the camera 3 for facility data In the position data included in the equipment master data stored in the database (DB) 10 and the imaging direction detected by the direction sensor 5 Therefore, when displaying on the display screen of the display 4 which is a display unit attached as image data, the equipment data of the equipment data database 10 managed by the equipment data management means 9 is displayed superimposed on various equipments. When the indoor map data indicating the indoor layout including the equipment data display means 6 and the equipment included in the equipment master data on the display screen is displayed based on the imaging direction, the mobile terminal position and the mobile terminal are displayed on the indoor map data. Mobile terminal direction input means 7 that superimposes and displays the mobile terminal direction with respect to the equipment that can be seen from the position in the imaging direction.

  Among these, the portable terminal direction input means 7 is portable on the indoor map data in a situation where the image data on the display screen displayed by the equipment data display means 6 is disturbed by geomagnetism in which equipment data is not superimposed on various equipment. When the operator inputs a gaze point position indicating the correct imaging direction after displaying the terminal direction, the mobile terminal direction is corrected and displayed according to the input of the gaze point position.

  FIG. 2 is a flowchart showing an operation process of the equipment data display means 6 provided in the portable terminal 1.

  The equipment data display means 6 in the portable terminal 1 displays equipment management data when image data relating to various equipment by the camera 3 is displayed as image data on the display screen of the display 4 based on the imaging direction detected by the direction sensor 5. The position on the display screen of the display 4 where the various equipment data managed by the management means 9 is displayed is calculated based on the position data of the portable terminal 1 included in the equipment master data and the imaging direction detected by the direction sensor 5. After performing the equipment data display position calculation process (step S1) to be performed, the camera image display process (step S2) for displaying the image data captured by the camera 3 on the display screen of the display 4 is performed according to the calculation result. Further, thereafter, an equipment data superimposing display process (step S3) for superimposing and displaying equipment data for various equipments at the position calculated by the equipment data display position calculating process (step S1) is performed.

  FIG. 4 shows that the operator 23 who owns the portable terminal 24 having the same function as the portable terminal 1 described above closes the non-metallic door 29 that does not disturb the geomagnetism where the first equipment 21 and the second equipment 22 are installed. The usage pattern when entering the room is illustrated. Further, FIG. 5 is superimposed on the first equipment 21 and the second equipment 22 displayed on the display screen of the display 4 when the mobile terminal 24 is imaged toward the first equipment 21 in a situation where the geomagnetism is not disturbed. The image data containing the 1st installation data 25 and the 2nd installation data 26 which were done is illustrated.

  FIG. 4 shows a case where the operator 23 who owns the portable terminal 24 is in a room in a normal state of geomagnetism closed with the non-metallic door 29 closed, as an indoor environment. 4, the first equipment data 25 is correctly displayed on the first equipment 21 and the second equipment data 26 is correctly displayed on the second equipment 22 as shown in FIG. 5. Is done.

  On the other hand, FIG. 7 shows that the operator 23 who owns the portable terminal 24 having the same function as the portable terminal 1 described above closes the metal door 30 that disturbs the geomagnetism where the first equipment 21 and the second equipment 22 are installed. It is the schematic diagram which illustrated the usage pattern when entering a room. Further, FIG. 8 is superimposed on the first equipment 21 and the second equipment 22 displayed on the display screen of the display 4 when the mobile terminal 24 is imaged toward the first equipment 21 under a situation where the geomagnetism is disturbed. The image data containing the 1st installation data 25 and the 2nd installation data 26 which were displaced without being illustrated is illustrated.

  In FIG. 7, as another indoor environment, the operator 23 who owns the mobile terminal 24 shows a case where the operator 23 is in a room in an abnormal state of geomagnetism that is closed with the metal door 30 closed. In the image data on the display screen of the display 4, as shown in FIG. 8, the first equipment data 25 is not correctly displayed on the first equipment 21 and is misaligned, and the second equipment 22 is also the second. The equipment data 26 is misaligned without being displayed correctly.

  FIG. 3 is a flowchart showing an operation process of the mobile terminal direction input means 7 provided in the mobile terminal 1.

  In the operation process of the portable terminal direction input means 7, the indoor map data indicating the indoor layout including each equipment included in the equipment master data on the display screen is switched from the image data based on the imaging direction, and the display screen of the display 4 is displayed. After the indoor map data display process (step S11) is performed by displaying the mobile terminal, the mobile terminal position display process (step S12) is performed by superimposing the mobile terminal position 27 on the displayed indoor map data. Do. Thereafter, the mobile terminal direction display process (step S13) is performed by superimposing and displaying the imaging direction detected by the direction sensor 5 with respect to the mobile terminal position 27 on the indoor map data as the mobile terminal direction 28.

  FIG. 6 shows the mobile terminal position 27 displayed on the display screen of the display 4 when the mobile terminal direction input means 7 of the mobile terminal 24 is activated in the situation where the geomagnetism described in FIG. The indoor map data including the terminal direction (imaging direction) 28 is illustrated.

  In FIG. 6, since the geomagnetism is not disturbed, the direction sensor 5 detects the correct imaging direction, whereby the mobile terminal direction 28 correctly indicates the direction of the first equipment 21.

  Furthermore, in the operation process of the mobile terminal direction input means 7, the operator changes the imaging direction of the direction sensor 5 or the superposition of the first equipment data 25 and the second equipment data 26 on the first equipment 21 and the second equipment 22. Based on the result of recognizing the condition, it is determined whether or not a terminal direction correction process is necessary (step S14).

  If the terminal direction correction process is not necessary as a result of the determination, the operation process is terminated. If the terminal direction correction process is necessary, the process proceeds to the correction process by the portable terminal direction input means 7.

  FIG. 9 shows the mobile terminal position 27 displayed on the display screen of the display 4 when the mobile terminal direction input means 7 of the mobile terminal 24 is activated in the situation where the geomagnetism described in FIG. The indoor map data including the portable terminal direction (imaging direction) 28 is illustrated.

  In FIG. 9, the direction sensor 5 cannot detect the correct imaging direction due to the geomagnetic disturbance, and the first equipment data 25 is not correctly displayed on the first equipment 21 shown in FIG. 2 shows that the portable terminal direction display process (step S13) is performed as it is when the equipment data 26 is not correctly displayed. In such a case, the direction of the first equipment 21 is actually indicated on the indoor map data. In spite of being directed, since the wrong mobile terminal direction (imaging direction) 28 facing the direction of the second equipment 22 is shown, the terminal direction correction processing is required.

  Therefore, in the portable terminal direction input means 7, when the direction sensor 5 cannot correctly detect the imaging direction and the terminal direction correction processing is necessary, the gazing point position input processing function is used to input the gazing point position on the indoor map data. Mobile terminal direction input processing (step S15) to be performed, and then mobile terminal direction update processing (step S16) is performed to update and display the mobile terminal direction to the direction of the point of interest position by the mobile terminal direction update processing function. Then, the operation process ends.

  FIG. 10 shows that the mobile terminal direction input means 7 of the mobile terminal 24 is activated in the situation where the geomagnetism shown in FIG. 7 is disturbed and the operator 23 is in the correct imaging direction on the display screen of the display 4 after the mobile terminal position 27 is displayed. 6 illustrates indoor map data including a mobile terminal position 27 displayed on the display screen of the display 4 and an appropriate mobile terminal direction (imaging direction) 28 when the gazing point position 31 is input. .

  In FIG. 10, when a correct gaze point position 31 is input on the indoor map data displayed on the display screen of the display 4 by the mobile terminal direction input process (step S15), the mobile terminal direction update process (step S16) is performed. This shows how the correct mobile terminal direction (imaging direction) 28 is updated and displayed (corrected display).

  In such a case, since the portable terminal direction input means 7 transmits to the equipment data display means 6 that the mobile terminal direction 28 has been correctly updated and displayed, the equipment data display means 6 performs equipment data display position calculation processing ( Step S1) is performed again to calculate the correct equipment data display position. As a result, the image data on the display screen is correctly displayed on the first equipment 21 and the second equipment 22 respectively as shown in FIG. Equipment data 25 and second equipment data 26 are superimposed and displayed.

  FIG. 11 shows the first equipment 21 and the second equipment which are displayed on the display screen of the display 4 by the function of the equipment data display means 6 after inputting the gaze point position 31 indicating the correct imaging direction shown in FIG. 22 illustrates modified image data including first equipment data 25 and second equipment data 26 superimposed on 22. In FIG. 11, along with the update display of the correct mobile terminal direction (imaging direction) 28 by the input operation of the gazing point position 31 indicating the correct imaging direction described in FIG. 10, the image data is also corrected on the display screen as corrected image data. It shows how it is displayed.

  Incidentally, the input operation of the gazing point position 31 is performed by a position specifying input function for specifying and inputting the gazing point position 31 on the indoor map data provided in the portable terminal direction input means 7. Specifically, the position specifying input function here is to a predetermined location in the vicinity of the first equipment 21 and the second equipment 22 on the indoor map data when the display screen of the display 4 is constructed by a touch panel type, for example. 10 (in the example shown in FIG. 10, the touch operation near the first equipment 21) may be performed, and when constructed with a coordinate input instruction formula, it may be pressed with the pen tip attached to the portable terminal 24. . Alternatively, the input operation of the gazing point position 31 may be performed by pressing a predetermined key or clicking a mouse on an operation unit attached to the portable terminal 24 for performing a cursor instruction on the indoor map data. Also good.

  In the mobile terminal 1 with the imaging direction display function of the imaging direction display system for mobile terminals according to the first embodiment, the image data by the equipment data display means 6 and the indoor map by the mobile terminal direction input means 7 on the display screen of the display 4. Although the case where the data is switched and displayed has been described, the image data and the indoor map data, which are the results of the processing related to the equipment data display means 6 and the portable terminal direction input means 7, are divided on the display screen and simultaneously displayed. It is also possible.

DESCRIPTION OF SYMBOLS 1,24 Portable terminal 2 Management server 3 Camera 4 Display 5 Direction sensor 6 Equipment data display means 7 Terminal direction input means 8 Portable terminal communication means 9 Equipment data management means 10 Equipment data database (DB)
11 Equipment management server communication means 12 Equipment master data management means 13 Equipment master data database (DB)
21 First equipment 22 Second equipment 23 Operator 25 First equipment data 26 Second equipment data 27 Mobile terminal position 28 Mobile terminal direction 29 Non-metallic door 30 Metal door 31 Point of sight

Claims (11)

On the management server side, there is an equipment master data management step for accumulating and managing equipment master data related to various data of a plurality of equipment installed in an indoor room,
On the portable terminal side, an equipment data management step for accumulating and managing equipment data included in the equipment master data acquired from the management server, and imaging data obtained by imaging the plurality of equipments in the indoors as the equipment master data When displayed as image data on the display screen of the display unit attached based on the position data included and the imaging direction detected at the time of imaging by the direction sensor using geomagnetism, the facility data is respectively displayed on the plurality of facilities. When displaying indoor map data indicating an indoor layout including the plurality of equipments included in the equipment master data on the display screen based on the imaging direction, the equipment data display step for displaying the data in a superimposed manner A mobile terminal for equipment that is visible in the imaging direction from the mobile terminal position and the mobile terminal position on the map data Imaging direction display method for a portable terminal, characterized by having a portable terminal direction display step of displaying by superimposing the direction.   The imaging direction display method for a mobile terminal according to claim 1, wherein, in the mobile terminal direction display step, the facility data is not superimposed on the plurality of facilities for the image data on the display screen in the facility data display step. When the operator inputs a gaze point position indicating the correct imaging direction after displaying the mobile terminal direction on the indoor map data, the portable terminal is input according to the input of the gaze point position. An imaging direction display method for a portable terminal, wherein the direction is corrected and displayed correctly.   The imaging direction display method for a portable terminal according to claim 2, wherein the portable terminal side corrects and displays the portable terminal direction in the portable terminal direction display step, and then displays the plurality of facilities on the display screen. An imaging direction display method for a portable terminal, comprising: a modified image data display step for displaying modified image data on which equipment data is superimposed.   The imaging direction display method for a mobile terminal according to any one of claims 1 to 3, wherein the display screen displays the image data in the mobile terminal direction display step and the indoor map data in the mobile terminal direction display step. An imaging direction display method for a portable terminal, characterized by being divided and displayed simultaneously.   Equipment data management means for accumulating and managing equipment data included in the equipment master data acquired from a management server for accumulating and managing equipment master data related to various data of a plurality of equipment installed in an indoor room; Imaging means capable of imaging the plurality of indoor facilities, a direction sensor for detecting an imaging direction by the imaging means using geomagnetism, and imaging data relating to the plurality of indoor facilities by the imaging means When displaying on the display screen of the display unit provided as image data based on the position data included in the equipment master data and the imaging direction detected by the direction sensor, the equipment data is respectively displayed in the plurality of equipment. The equipment data display means for superimposing and displaying the indoor data including the plurality of equipment included in the equipment master data on the display screen When displaying indoor map data indicating iout based on the imaging direction, the mobile terminal position is displayed on the indoor map data by superimposing the mobile terminal position and the mobile terminal direction with respect to equipment visible in the imaging direction from the mobile terminal position. A portable terminal with an imaging direction display function, comprising: a terminal direction input unit.   6. The portable terminal with an imaging direction display function according to claim 5, wherein the portable terminal direction input unit superimposes the facility data on the plurality of facilities for the image data on the display screen displayed by the facility data display unit. In a situation where the geomagnetism is not disturbed, when an operator inputs a gaze point position indicating a correct imaging direction after displaying the mobile terminal direction on the indoor map data, the operator inputs the gaze point position according to the input of the gaze point position. A mobile terminal with an imaging direction display function, wherein the mobile terminal direction is corrected and displayed correctly.   7. The mobile terminal with an imaging direction display function according to claim 6, wherein the mobile terminal direction input means inputs the gazing point position on the indoor map data when the direction sensor cannot correctly detect the imaging direction. A mobile terminal with an imaging direction display function, comprising: a position input processing function; and a mobile terminal direction update processing function for updating and displaying the mobile terminal direction toward the gazing point position.   8. The portable terminal with an imaging direction display function according to claim 6 or 7, wherein the equipment data display means corrects and displays the mobile terminal direction by the terminal direction input means, and then displays the plurality of equipment on the display screen. A portable terminal with an imaging direction display function, which displays corrected image data on which the facility data is superimposed.   The mobile terminal with an imaging direction display function according to any one of claims 5 to 8, wherein the mobile terminal direction input means specifies a position for specifying and inputting the position of the point of interest on the indoor map data. A portable terminal with an imaging direction display function characterized by having an input function.   The portable terminal with an imaging direction display function according to any one of claims 5 to 9, wherein the facility data display means and the portable terminal direction input means store the image data and the indoor map data on the display screen. A portable terminal with an imaging direction display function, characterized in that it can be divided and displayed simultaneously.   An imaging direction display system for a portable terminal, comprising: the portable terminal with an imaging direction display function according to any one of claims 5 to 10; and the management server.

Images