JP6575221B2 - Display control method, information processing apparatus, and display control program - Google Patents

Description

  The present invention relates to a display control method, an information processing apparatus, and a display control program.

  Conventionally, when object data registered in association with a position in an area specified according to the position and orientation of a mobile terminal is detected, AR (Augmented Reality) for displaying the detected object data on a display Technology is known.

  If AR technology is used, for example, even in an unknown place such as a travel destination, object data (AR content) registered in association with a position in an area corresponding to the position and orientation of the mobile terminal is automatically displayed on the display of the mobile terminal. Since it is displayed, the user can obtain various types of information from each object data in the image.

JP 2011-128220 A Special table 2013-507777 gazette

  However, for example, when performing position registration (authoring) of object data, if the position detection accuracy of the mobile terminal is low, the object data cannot be registered at an accurate position, and then the object data is displayed on the display. In this case, the display position of the object data on the display may be shifted. That is, even when object data is associated with a specific building, for example, when the object data is displayed thereafter, the object data may be displayed at a position shifted from the building. In such a case, the user needs to move the displayed object data to an appropriate position on the display by, for example, a drag operation and associate the object data with the appropriate position.

  However, when the displacement of the display position of the object data is large, if the position and orientation of the mobile terminal are set to the position and orientation where the object data is displayed on the display, the position where the object data should be associated with may be out of view. become. This makes it difficult to move the object data on the display.

  An object of one aspect is to make it possible to easily perform an operation of associating object data with a position.

According to one aspect, in the display control method for displaying the object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected. in Rukoto receives designation of a first state of the terminal to be used for changing the position registered in association with the object data displayed on the display, to erase the display of the object data on the display, the display In the second state of the terminal used for changing the position registered in association with the object data displayed on the display , the object data whose display has been deleted is displayed at the position indicated on the display , Based on the difference in position and orientation of the terminal in the first state and the second state , The position is registered in association with the object data, the change in position of the area corresponding to the designated position on the display, characterized in that processing the computer executes.

  An operation for associating object data with a position can be easily performed.

It is a figure which shows an example of the whole structure of AR content display system. It is a figure which shows an example of a display of the image imaged with the portable terminal, and AR content. It is a figure for demonstrating the map which shows the relationship between the position of a portable terminal, the position of AR content, and the imaging range of a portable terminal. It is a figure which shows an example of the hardware constitutions of a portable terminal. It is a figure which shows an example of a function structure of a portable terminal. It is a figure which shows an example of AR content management information stored in a portable terminal. It is a figure for demonstrating the map of a world coordinate system, and the map of a screen coordinate system. It is a 1st figure which shows the detailed functional structure of AR content edit part. It is a figure which shows transition of the positional information at the time of the edit process by AR content edit part. It is a figure which shows transition of the positional information at the time of the edit process by AR content edit part. It is a 1st flowchart of the edit process by AR content edit part. It is a figure which shows the transition of the display screen of the conventional portable terminal at the time of performing the edit process which matches AR content with predetermined position information. It is a figure which shows the transition of the display screen of the conventional portable terminal at the time of performing the edit process which matches AR content with predetermined position information. It is a figure which shows the transition of the display screen of the conventional portable terminal at the time of performing the edit process which matches AR content with predetermined position information. It is a 1st figure which shows the transition of the display screen at the time of the edit process by AR content edit part. It is a 1st figure which shows the transition of the display screen at the time of the edit process by AR content edit part. It is a 2nd figure which shows the detailed functional structure of AR content editing part. It is a 2nd figure which shows the transition of the display screen at the time of the edit process by AR content edit part. It is a 2nd figure which shows the transition of the display screen at the time of the edit process by AR content edit part. It is a 2nd flowchart of the edit process by AR content edit part.

  Each embodiment will be described below with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.

[First Embodiment]
First, an AR content display system including a mobile terminal that displays AR content, which is an example of object data, and a server device that provides AR content to the mobile terminal will be described. FIG. 1 is a diagram illustrating an example of the overall configuration of an AR content display system.

  As illustrated in FIG. 1, the AR content display system 100 includes a mobile terminal 110 and a server device 120, and the mobile terminal 110 and the server device 120 are connected via a network 130.

  The portable terminal 110 is an information processing apparatus that includes an imaging function and a position detection function. A display control program is installed in the portable terminal 110. The mobile terminal 110 executes the display control program, for example, AR content registered in association with the imaging range specified according to the position and orientation of the mobile terminal 110 detected by the position detection function. Obtained from the server device 120. In addition, the mobile terminal executes the display control program, for example, stores the acquired AR content and superimposes the acquired AR content on a corresponding position on the real-world image captured by the imaging function. To display.

  The server device 120 is a device that provides AR content information to the mobile terminal 110 in response to a request from the mobile terminal 110. A content providing program is installed in the server device 120, and the server device 120 functions as the content providing unit 121 by executing the program.

  The content providing unit 121 receives an AR content request from the mobile terminal 110 via the network 130. The AR content request includes information regarding the imaging range (area) of the mobile terminal 110 specified according to the position and orientation of the mobile terminal 110. The content providing unit 121 searches the AR content information DB 122 based on information regarding the imaging range extracted from the received AR content request. Thereby, among the AR content information registered in the AR content information DB 122, AR content information (AR content information including the AR content registered in association with the position in the area) having the position information included in the imaging range is obtained. To detect.

  In addition, the content providing unit 121 transmits the detected AR content information to the mobile terminal 110 that is the request source of the AR content request.

  Next, a display example of the display screen (display) of the mobile terminal 110 in which AR content is superimposed and displayed at a corresponding position in a real-world image captured by the imaging function will be described. FIG. 2 is a diagram illustrating an example of display of an image captured by a mobile terminal and AR content.

  As shown in FIG. 2, an image 220 of the real world 200 being captured is displayed on the display screen 210 of the mobile terminal 110. The mobile terminal 110 has a position detection function, and acquires the position and orientation of the mobile terminal 110. For this reason, when the user issues an AR content display instruction, the mobile terminal 110 acquires the current position and orientation, and specifies an imaging range (area) according to the acquired position and orientation. Further, the mobile terminal 110 transmits an AR content request including information regarding the identified imaging range to the server device 120, and acquires AR content information having position information included in the imaging range from the server device 120.

  The AR content 230 superimposed on the image 220 displayed on the display screen 210 is AR content included in the AR content information acquired from the server device 120 when the mobile terminal 110 transmits an AR content request.

  The AR content information includes at least the AR content and position information associated with the AR content (for example, position information in the world coordinate system such as latitude and longitude) (note that the AR content information further includes information other than the position information). May be) The mobile terminal 110 calculates the display position of the AR content on the image 220 based on the imaging range specified according to the current position and orientation and the position information associated with the AR content. The acquired AR content is displayed at the display position.

  Next, the relationship between the current position of the mobile terminal 110, the imaging range specified by the current position and orientation of the mobile terminal 110, and the position of the AR content associated with the position information included in the imaging range will be described. To do.

  FIG. 3 is a diagram showing a map representing the relationship between the position of the mobile terminal, the position of the AR content, and the imaging range of the mobile terminal.

  As shown in FIG. 3, the map 300 is represented by a circular shape centered on the current position of the mobile terminal 110, and a symbol 301 indicating the AR content 230 is displayed. In addition, the imaging range 302 specified by the current position and orientation of the mobile terminal 110 is displayed with shading. In this manner, by displaying the imaging range 302 with shading, it is possible to distinguish between the imaging range (inside the area) and the outside of the imaging range (outside the area) in the map 300.

  The position of the symbol 301 is specified by position information associated with the AR content 230, and is included in the imaging range 302 in the example of FIG. For this reason, as shown in FIG. 2, the AR content 230 is superimposed on the image 220 displayed on the display screen 210 of the mobile terminal 110.

  Next, the hardware configuration of the mobile terminal 110 will be described. FIG. 4 is a diagram illustrating an example of a hardware configuration of the mobile terminal.

  As illustrated in FIG. 4, the mobile terminal 110 includes a CPU 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, an auxiliary storage unit 404, and a communication unit 405. The mobile terminal 110 includes an operation unit 406, an imaging unit 407, a display unit 408, a GPS unit 409, and a sensor unit 410. Note that the units of the mobile terminal 110 are connected to each other via a bus 411.

  The CPU 401 is a computer that executes various programs (for example, a display control program) installed in the auxiliary storage unit 404. The ROM 402 is a nonvolatile memory. The ROM 402 functions as a main storage unit that stores various programs, data, and the like necessary for the CPU 401 to execute various programs stored in the auxiliary storage unit 404. Specifically, the ROM 402 stores a boot program such as a basic input / output system (BIOS) or an extensible firmware interface (EFI).

  The RAM 403 is a volatile memory such as a DRAM (Dynamic Random Access Memory) or an SRAM (Static Random Access Memory), and functions as a main storage unit. The RAM 403 provides a work area that is expanded when various programs stored in the auxiliary storage unit 404 are executed by the CPU 401.

  The auxiliary storage unit 404 stores various programs installed in the mobile terminal 110, data used when executing the various programs, and the like.

  The communication unit 405 is a device for the mobile terminal 110 to communicate with the server apparatus 120 via the network 130.

  The operation unit 406 is a device for the user to input various instructions to the mobile terminal 110. The imaging unit 407 is a device that images the real world 200 and generates an image 220, and realizes the imaging function of the mobile terminal 110.

  The display unit 408 includes the display screen 210 illustrated in FIG. 2 and displays the image 220 captured by the imaging unit 407. Further, the display unit 408 displays the AR content (for example, the AR content 230) included in the AR content information acquired from the server device 120 via the communication unit 405.

  The GPS unit 409 is a device that acquires the current position (latitude, longitude, altitude) of the mobile terminal 110 from GPS (Global Positioning System). The mobile terminal 110 identifies the current position based on the latitude, longitude, and altitude acquired via the GPS unit 409, and generates current position information.

  The sensor unit 410 includes a geomagnetic sensor that detects geomagnetism and an acceleration sensor that detects acceleration. The mobile terminal 110 identifies the current orientation of the mobile terminal 110 based on the detection results of the geomagnetic sensor and the acceleration sensor, and generates current orientation information.

  The GPS unit 409 and the sensor unit 410 generate current position information and current direction information, thereby realizing a position detection function of the mobile terminal 110.

  Next, functions realized by the mobile terminal 110 by executing the display control program will be described. FIG. 5 is a diagram illustrating an example of a functional configuration indicating functions realized in the mobile terminal by executing the display control program. As illustrated in FIG. 5, the functions realized by executing the display control program include an imaging information display unit 501, a current position information acquisition unit 502, and a current direction information acquisition unit 503. Further, an imaging range calculation unit 504, an AR content display unit 505, and an AR content editing unit 506 are included.

  The imaging information display unit 501 acquires the image 220 generated by the imaging unit 407 imaging the real world 200 and displays it on the display unit 408.

  The current position information acquisition unit 502 acquires the current position information generated by the GPS unit 409 and notifies the imaging range calculation unit 504.

  The current direction information acquisition unit 503 acquires the current direction information generated by the sensor unit 410 and notifies the imaging range calculation unit 504 of the current direction information.

  The imaging range calculation unit 504 captures an imaging range (area) captured by the imaging unit 407 based on the current position information notified from the current position information acquisition unit 502 and the current direction information notified from the current direction information acquisition unit 503. ). In addition, the imaging range calculation unit 504 notifies the AR content display unit 505 of information regarding the specified imaging range.

  The AR content display unit 505 generates an AR content request including information regarding the imaging range notified from the imaging range calculation unit 504, and transmits the AR content request to the server device 120. Further, the AR content display unit 505 receives AR content information from the server device 120 in response to transmission of the AR content request, and stores the AR content information in the AR content management DB 511. Furthermore, the AR content display unit 505 displays the position on the image 220 on which the AR content 230 is displayed based on the positional information included in the received AR content information and the information regarding the imaging range notified from the imaging range calculation unit 504. Identify. Furthermore, the AR content display unit 505 superimposes and displays the AR content 230 included in the received AR content information at a position on the identified image 220.

  The AR content editing unit 506 edits the AR content information acquired from the server device 120 and stored in the AR content management DB 511. In the present embodiment, the AR content editing unit 506 performs editing to change position information included in the AR content information. When the AR content editing unit 506 includes an error in the position information included in the AR content information acquired from the server device 120 and the AR content 230 is displayed on the display screen 210, the AR content editing unit 506 is not displayed at an appropriate position. The position information can be changed. Accordingly, it is possible to associate appropriate position information with the AR content included in the AR content information acquired from the server device 120, and thereafter, the AR content can be displayed at an appropriate position.

  Next, the AR content management DB 511 that stores the AR content information acquired from the server device 120 will be described. FIG. 6 is a diagram illustrating an example of AR content management information stored in the AR content management DB of the mobile terminal.

  As shown in FIG. 6, the AR content management information 600 includes “AR content name”, “AR content position information”, and “display content” as information items.

  In the “AR content name”, information for identifying the AR content is stored. “AR content position information” stores the position information of the AR content information. The “display content” stores the AR content displayed on the display screen 210.

  Next, a coordinate system used when the AR content editing unit 506 changes position information associated with AR content will be described. In the present embodiment, the AR content editing unit 506 uses a world coordinate system and a screen coordinate system to change the position information associated with the AR content. FIG. 7 is a diagram for explaining a map in the world coordinate system and a map in the screen coordinate system.

  FIG. 7A shows a map 710 in the world coordinate system. In the world coordinate system, position information is represented by latitude, longitude, and altitude. In the example of FIG. 7A, the position information A of the mobile terminal 110 is expressed as A = (La1, Lo1, Al1). The position information B associated with the AR content is represented as B = (La2, Lo2, Al2). Furthermore, the position information C associated with the edited AR content is expressed as C = (La3, Lo3, Al3).

  On the other hand, FIG. 7B is a diagram showing a map 720 of the screen coordinate system. In the map 720 of the screen coordinate system, the position information is represented by XY coordinates. A map 720 shown in FIG. 7B shows position information (XY coordinates) when the position information of each position in the world coordinate system of FIG. 7A is expressed in the screen coordinate system. It is shown in the position corresponding to.

  For example, the position information A ′ when the position information A in the world coordinate system of the mobile terminal 110 is expressed in the screen coordinate system is A ′ = (x1, y1), and the position corresponding to the position information A in the world coordinate system. Shown in Further, the position information B ′ when the position information B in the world coordinate system associated with the AR content is represented in the screen coordinate system is B ′ = (x2, y2), and the position information B in the world coordinate system is Shown in the corresponding position.

  Note that the position information in the screen coordinate system is a relative value that changes depending on the position and orientation of the mobile terminal 110, and the position information can be expressed in the screen coordinate system only for AR content within the imaging range.

  Next, detailed functions of the AR content editing unit 506 will be described. FIG. 8 is a diagram showing a detailed functional configuration of the AR content editing unit. As illustrated in FIG. 8, the AR content editing unit 506 includes an editing target reception unit 801, a cut operation reception unit 802, a paste position reception unit 803, a vector calculation unit 804, an AR content paste unit 805, and a position adjustment unit 806.

  The editing target reception unit 801 identifies the AR content (AR content 230 in this case) selected as the target (editing target) whose position information is to be changed from the AR content displayed on the display screen 210. Specifically, the edit target receiving unit 801 identifies the AR content at the position tapped by the user among the AR content on the display screen 210 as the AR content selected as the edit target.

  In addition, when the editing target receiving unit 801 identifies the AR content selected as the editing target, the editing target receiving unit 801 displays an editing menu on the display screen 210.

  The cut operation accepting unit 802 accepts a user when the user selects a cut process from various edit contents included in the edit menu displayed by the edit target accepting unit 801. When the cut operation accepting unit 802 accepts the selection of the cut processing by the user, the cut operation accepting unit 802 holds the position information associated with the AR content to be edited in the RAM 403 and deletes the display of the AR content to be edited from the display screen 210. .

  The paste position accepting unit 803 is a state where the user changes the position and orientation of the mobile terminal 110 (second state) after the cut operation accepting unit 802 accepts selection of the cutting process by the user, and the user can display the display screen 210. This is accepted when a predetermined position is tapped.

  Further, the paste position receiving unit 803 identifies a position (referred to as “paste position”) where the user performs a tap operation on the display screen 210, and position information of the paste position on the display screen 210 (position information of the screen coordinate system). ) To the vector calculation unit 804.

  The vector calculation unit 804 includes the current position information (world coordinate system) of the mobile terminal 110 acquired by the current position information acquisition unit 502 and the current direction information (world coordinates of the mobile terminal 110 acquired by the current direction information acquisition unit 503. System).

  Further, the vector calculation unit 804 specifies the current position information in the screen coordinate system of the mobile terminal 110 and acquires the position information (screen coordinate system) of the paste position notified from the paste position reception unit 803. Further, the vector calculation unit 804 calculates a difference vector between the current position and the paste position in the screen coordinate system, and converts the calculated difference vector in the screen coordinate system into a difference vector in the world coordinate system. A method for converting the difference vector in the screen coordinate system to the difference vector in the world coordinate system will be described later.

  Further, the vector calculation unit 804 determines the position information (world coordinate system) of the paste position based on the current position information (world coordinate system), the current orientation information (world coordinate system), and the difference vector (world coordinate system). Is calculated. The vector calculation unit 804 rewrites the position information held in the RAM 403 by using the position information (world coordinate system) of the calculated paste position.

  The AR content paste unit 805 displays an edit menu on the display screen 210 when the paste position receiving unit 803 receives a tap operation. The AR content paste unit 805 accepts a case where the user selects a paste process from the edit contents included in the edit menu displayed on the display screen 210. When the AR content paste unit 805 receives selection of paste processing by the user, the AR content paste unit 805 displays the AR content to be edited at the paste position.

  In addition, the AR content paste unit 805 holds, in the RAM 403, position information associated with the AR content to be edited among the position information stored in “AR content position information” of the AR content management information 600. Change the location information after rewriting. As a result, among the position information stored in “AR content position information” of the AR content management information 600, the position information associated with the AR content to be edited is changed to appropriate position information. .

  The position adjustment unit 806 receives the adjustment operation when the user finely adjusts the position of the AR content displayed at the paste position by the AR content paste unit 805 on the display screen 210. When the adjustment operation by the user is received and the position of the AR content is adjusted, the position adjustment unit 806 calculates position information (world coordinate system) corresponding to the adjusted position. Furthermore, the position adjustment unit 806 uses the position information (world coordinate system) corresponding to the adjusted position, and stores the position information (position after change) stored in “AR content position information” of the AR content management information 600. Information) is further changed.

  Next, specific processing contents when the AR content editing unit 506 changes the position information stored in the “AR content position information” will be described. FIGS. 9 and 10 are diagrams showing the transition of the position information stored in the “position information of AR content” during the editing process by the AR content editing unit. The map 710 and the screen of the world coordinate system shown in FIG. A description will be given in association with the coordinate system map 720.

In the present embodiment, it is assumed that the relationship between the position information stored in each position on the map 710 in the world coordinate system and each position on the map 720 in the screen coordinate system is approximated as follows.
0.00001 [degree] in the screen coordinate system = 1 [m] in the world coordinate system
D ′ [pixel] in the screen coordinate system = D [m] in the world coordinate system
Therefore, 1 [pixel] in the screen coordinate system is approximated as D / D ′ [m] in the world coordinate system, and 1 [pixel] in the screen coordinate system is D / D ′ × 0.00001 [in the world coordinate system. Degree].

  FIG. 9A shows a map 720 in a state where the AR content 230 is displayed at (x2, y2) on the display screen 210 and the editing target receiving unit 801 identifies the displayed AR content 230 as an editing target. Show. At this time, it is assumed that the AR content 230 associated with the location information B = (La2, Lo2, Al2) is stored in the “AR content location information” of the AR content management information 600.

  FIG. 9B shows a map 720 in a state (first state) in which the cut operation accepting unit 802 accepts selection of a cut process. As shown in FIG. 9B, since the AR content 230 is erased from the display screen 210 by accepting the selection of the cut processing, the symbol indicating the AR content 230 is also erased in the map 720. At this time, B = (La2, Lo2, Al2), which is position information associated with the AR content 230, is held in the RAM 403.

  FIG. 9C shows a state (second state) in which the user changes the position and orientation of the mobile terminal 110 after accepting the selection of the cutting process by the user. When the user changes the position and orientation of the mobile terminal 110, the imaging range changes.

  FIG. 10A shows a map 720 in a state where the paste position receiving unit 803 receives a tap operation and identifies the paste position. The paste position receiving unit 803 identifies position information C ′ = (x3, y3) as the paste position, and specifies position information A ′ = (x1, y1) in the screen coordinate system of the mobile terminal 110.

In FIG. 10A, the vector calculation unit 804 calculates a difference vector V _{CA ′} between the position information (screen coordinate system) C ′ of the paste position and the position information (screen coordinate system) A ′ of the mobile terminal 110. A map 720 of the calculated state is shown.

If the position information (screen coordinate system) of the paste position is C ′ = (x3, y3) and the position information (screen coordinate system) of the mobile terminal 110 is A ′ = (x1, y1), the difference The vector (screen coordinate system) V _{CA ′} can be expressed by the following equation.

In FIG. 10B, the vector calculation unit 804 obtains the current position information (world coordinate system) A of the mobile terminal 110 and uses the difference vector (screen coordinate system) V _{CA ′} as the difference vector (world coordinate system). shows a map 710 of a state converted to V _CA.

As described above, 1 [pixel] in the screen coordinate system is approximated by D / D ′ × 0.00001 [degrees] in the world coordinate system. Therefore, the difference vector (screen coordinate system) V _{CA ′} can be converted into the difference vector (world coordinate system) V _CA by using the following expression.

FIG. 10C shows the position information (world coordinates) of the paste position based on the current position information (world coordinate system) A of the mobile terminal 110 and the difference vector (world coordinate system) V _CA. System) C is calculated. As shown in FIG. 10C, the position coordinate (world coordinate system) C of the paste position is obtained by adding a difference vector (world coordinate system) V _{CA to} the current position information (world coordinate system) A and current direction information of the mobile terminal 110. Can be calculated by adding.

  When the position information (world coordinate system) C = (La3, Lo3, Al3) of the paste position is calculated, the vector calculation unit 804 rewrites the position information B = (La2, Lo2, Al2) held in the RAM 403.

  In response to this, the AR content paste unit 805 changes the “AR content location information” in the AR content management information 600 based on the rewritten location information (C = (La3, Lo3, Al3)) (FIG. 10 (c)).

  Next, the flow of editing processing by the AR content editing unit 506 will be described. FIG. 11 is a flowchart of the editing process by the AR content editing unit. The flowchart illustrated in FIG. 11 is started when the image 220 acquired by the imaging information display unit 501 is displayed on the display screen 210 of the mobile terminal 110 and the AR content 230 is displayed.

  In step S <b> 1101, the edit target receiving unit 801 receives a selection of AR content to be edited and displays an edit menu on the display screen 210.

  In step S1102, the cut operation reception unit 802 determines whether cut processing has been selected in the edit menu. If it is not determined in step S1102 that the cut process has been selected, the process returns to step S1101.

  On the other hand, if it is determined in step S1102 that the cut process has been selected, the process proceeds to step S1103. In step S1103, the cut operation reception unit 802 holds the position information associated with the selected AR content in the RAM 403, and deletes the display of the AR content from the display screen 210.

  In step S <b> 1104, the paste position receiving unit 803 determines whether the user has performed a tap operation on a predetermined position on the display screen 210 in a state (second state) in which one or both of the position and orientation of the mobile terminal 110 have changed. Determine whether. If it is determined in step S1104 that there is no tap operation, the process proceeds to step S1110.

  On the other hand, if it is determined in step S1104 that there is a tap operation, the process proceeds to step S1105. In step S <b> 1105, the paste position receiving unit 803 acquires position information (screen coordinate system) of the paste position tapped on the display screen 210.

In step S1106, the vector calculation unit 804 determines the difference vector V _{CA ′} (screen coordinates) based on the position information A ′ (screen coordinate system) of the mobile terminal 110 and the position information C ′ (screen coordinate system) of the paste position. System).

In step S1107, the vector calculation unit 804 converts the difference vector V _{CA ′} (screen coordinate system) into the difference vector V _CA (world coordinate system).

In step S1108, the vector calculation unit 804 determines the position of the paste position based on the current position information (world coordinate system) and current direction information (world coordinate system) of the mobile terminal 110 and the difference vector V _CA (world coordinate system). Coordinates (world coordinate system) C are calculated.

  In step S1109, the AR content paste unit 805 uses the position coordinates (world coordinate system) C of the paste position calculated in step S1108 to store the position stored in “AR content position information” of the AR content management information 600. Change information. The AR content paste unit 805 displays the AR content 230 to be edited at the paste position on the display screen 210.

  In step S1110, the edit target receiving unit 801 determines whether or not to end editing. If it is determined that the editing is not to be ended, the process returns to step S1101 to edit other AR content. On the other hand, when it is determined that the editing is to be ended, the editing process is ended.

  Next, an example of editing processing of the AR content editing unit 506 (display screen transition example) will be described. For explaining the transition example of the display screen, first, for comparison purposes, FIG. 12 to FIG. 14 are used to show the display when the location information associated with the AR content is changed by the conventional portable terminal. Indicates screen transition. Then, the transition of the display screen in the case where the position information associated with the AR content is changed by the mobile terminal 110 in the present embodiment will be described with reference to FIGS. 15 and 16.

  12 to 14 are diagrams showing transition of the display screen of a conventional portable terminal when performing an editing process for associating AR content with appropriate position information. FIG. 12A shows a state in which the real-world image 1220 is displayed on the display screen 1211 of the conventional portable terminal 1210 and the AR content 1230 is displayed. Note that the shaded area of the map 720 indicates the imaging range of the conventional mobile terminal 1210.

  In changing the display position of the AR content 1230, the conventional mobile terminal 1210 changes the display position by moving the AR content 1230 while the user touches (holds) the AR content 1230 on the display screen 1211, for example. . For this reason, the maximum length that can be moved by one movement operation is the length between the left end and the right end of the display screen 1211. Therefore, when the AR content 1230 is moved in the left direction, the user rotates the imaging range of the mobile terminal 1210 in the left direction so that the AR content 1230 is displayed at the right end.

  FIG. 12B shows a state where the AR content 1230 is displayed at the right end of the display screen 1211 by rotating the imaging range of the mobile terminal 1210 to the left. In this state, the user moves the AR content 1230 toward the left end of the display screen 1211 while touching (holding) the AR content 1230.

  FIG. 12C shows a state where the AR content 1230 is moved to the left end of the display screen 1211 (see arrow 1240).

  Here, when the AR content 1230 is further moved leftward, the user again rotates the imaging range of the mobile terminal 1210 leftward so that the AR content 1230 is displayed at the right end of the display screen 1211.

  FIG. 13A shows a state in which the AR content 1230 is displayed at the right end of the display screen 1211 by rotating the imaging range of the mobile terminal 1210 in the left direction. In this state, the user moves the AR content 1230 toward the left end of the display screen 1211 while touching (holding) the AR content 1230 again.

  FIG. 13B shows a state where the AR content 1230 is moved to the left end of the display screen 1211.

  When the AR content 1230 is moved further leftward, the user again rotates the imaging range of the mobile terminal 1210 leftward so that the AR content 1230 is displayed at the right end of the display screen 1211.

  FIG. 13C shows a state where the AR content 1230 is displayed at the right end of the display screen 1211 by rotating the imaging range of the mobile terminal 1210 to the left. In this state, it is assumed that the image 1220 displayed on the display screen 1211 includes an appropriate position where the AR content 1230 is to be displayed.

  In this case, the user moves the AR content 1230 to a position to be displayed while touching (holding) the AR content 1230. FIG. 14A shows a state where the AR content 1230 has been moved to an appropriate position to be displayed (see arrow 1410).

  When the movement of the AR content 1230 is completed, the user instructs to change the position information associated with the AR content 1230 in the position information (world coordinate system) corresponding to the current display position of the AR content 1230.

  FIG. 14B shows a state where the edit menu 1420 is displayed on the display screen 1211. When the user selects a save process in the displayed edit menu 1420, the conventional portable terminal 1210 is associated with the AR content 1230 based on position information (world coordinate system) corresponding to the current display position of the AR content 1230. Change the location information. FIG. 14C shows a state after the position information associated with the AR content 1230 has been changed.

  Thus, in the case of the conventional portable terminal 1210, the maximum movable length of the AR content 1230 is limited to the length from the right end to the left end of the display screen 1211 (or vice versa). For this reason, when the shift of the display position of the AR content exceeds the imaging range, it is necessary to perform an operation of moving the AR content on the image displayed in each imaging range while changing the imaging range little by little. was there. On the other hand, according to the mobile terminal 110 according to the present embodiment, the AR content is moved by the cut-and-paste process, and therefore there is no restriction on the maximum length that can be moved, thereby reducing the load on the user who performs the moving operation. It becomes possible.

  15 and 16 are diagrams showing transition of the display screen during the editing process by the AR content editing unit.

  FIG. 15A shows a state in which the real-world image 220 is displayed and the AR content 230 is displayed on the display screen 210 of the mobile terminal 110 in the present embodiment. Note that the shaded area of the map 720 indicates the imaging range of the mobile terminal 110 in the present embodiment.

  FIG. 15B shows a state in which the editing menu 1510 is displayed on the image 220 displayed on the display screen 210 because the AR content 230 is selected as an editing target. As shown in FIG. 15B, the edit menu 1510 includes copy processing, cut processing, and paste processing, and the example of FIG. 15B indicates that the user has selected cut processing.

  When the cutting process is selected by the user, the AR content 230 displayed on the display screen 210 is deleted as shown in FIG. Thereafter, the user changes the position and orientation of the mobile terminal 110 so that the position where the AR content 230 is to be displayed is included in the imaging range.

  FIG. 16A shows a state in which the position and orientation of the mobile terminal 110 are changed so that an appropriate position where the AR content 230 should be displayed is included in the imaging range. As shown in FIG. 16A, an image 1620 including an appropriate position where the AR content 230 is to be displayed is displayed on the display screen 210 of the mobile terminal 110.

  In a state where the image 1620 is displayed (second state), the user designates the paste position 1630 of the AR content 230. Specifically, the user taps paste position 1630 on display screen 210.

  FIG. 16B shows a state where the user taps the paste position 1630 on the display screen 210. In FIG. 16B, a circle indicates a paste position 1630 where the tap operation is performed by the user. As shown in FIG. 16B, an edit menu 1610 is displayed near the position where the tap operation has been performed.

  In the example of FIG. 16B, copy processing, cut processing, and paste processing are displayed as the edit menu 1610, and it is shown that the paste processing can be selected. In this state, when the user selects the paste process from the edit menu 1610, the AR content 230 is displayed superimposed on the image 1620 on the display screen 210.

  As described above, according to the mobile terminal 110, in order to change the position information associated with the AR content, the AR content is moved to a predetermined position in comparison with the conventional mobile terminal 1210. The operation load at the time of moving can be reduced.

  As is clear from the above description, the mobile terminal 110 according to the present embodiment has the positional information (world coordinate system) associated with the AR content when the user designates the first state (cut operation). ). In addition, when the user designates the second state (paste operation) after changing the position and orientation of the mobile terminal 110, the mobile terminal 110 displays on the mobile terminal 110 whose position and orientation have changed. The AR content is displayed at the paste position on the displayed image. Furthermore, the mobile terminal 110 calculates position information (world coordinate system) based on the display position of the AR content on the image whose position and orientation have changed, and is associated with the AR content using the calculated position information. Change location information.

  As a result, the operation of associating the AR content (object data) with the position can be easily performed.

[Second Embodiment]
In the first embodiment, the position information of the AR content is changed by moving the AR content on the real-world image displayed on the display screen of the mobile terminal. In contrast, in the second embodiment, the map is displayed on the display screen of the mobile terminal, and the position information associated with the AR content is changed by moving the symbol indicating the AR content in the map. To do. Hereinafter, the second embodiment will be described focusing on differences from the first embodiment.

  First, the functional configuration of the AR content editing unit in this embodiment will be described. FIG. 17 is a diagram illustrating a functional configuration of the AR content editing unit according to the second embodiment. As illustrated in FIG. 17, the AR content editing unit 1700 includes an editing target receiving unit 801, a map moving operation receiving unit 1701, a symbol moving unit 1702, a position information updating unit 1703, and a position adjusting unit 806.

  Since the edit target receiving unit 801 has been described with reference to FIG. 8 in the first embodiment, description thereof is omitted here.

  The map movement operation reception unit 1701 receives a map movement process when the user selects a map movement process from the editing contents included in the editing menu displayed by the editing target reception unit 801. When the map movement operation accepting unit 1701 accepts the selection of the map movement process by the user, the map movement operation accepting unit 1701 generates a map 710 in the world coordinate system based on the current position information (world coordinate system) and current direction information of the mobile terminal 110. When generating the map 710 of the world coordinate system, the map movement operation accepting unit 1701 creates the edit target at a position in the map 710 specified by the position information (world coordinate system) associated with the AR content to be edited. A symbol indicating the AR content is arranged.

  Further, the map moving operation reception unit 1701 displays a map 710 on which a symbol indicating the AR content to be edited is arranged on the display screen 210.

  The symbol moving unit 1702 accepts a symbol moving operation by the user on the map 710 displayed on the display screen 210. As a result, the position of the symbol on the map 710 changes.

  When the symbol moving operation by the symbol moving unit 1702 is completed, the position information update unit 1703 determines whether or not the user has given an instruction to change the position information associated with the AR content to be edited. . When there is an instruction to change the position information associated with the AR content to be edited, the position information update unit 1703 uses the position information (world coordinate system) of the moved symbol to change the AR content to be edited. Change the associated position information. Note that the position information update unit 1703 instructs the imaging information display unit 501 to restore the display on the display screen 210 when the position information associated with the AR content is changed. As a result, the real-world image 220 is displayed on the display screen 210. If the changed position information is included in the imaging range at this time, the AR content in which the position information is changed is displayed superimposed on the image 220.

  Since the position adjustment unit 806 has been described with reference to FIG. 8 in the first embodiment, description thereof is omitted here.

  Next, an example of editing processing of the AR content editing unit 1700 of the mobile terminal 110 in the second embodiment (display screen transition example) will be described. 18 and 19 are diagrams showing transitions of display screens during editing processing by the AR content editing unit.

  FIG. 18A shows a state where the real-world image 220 is displayed and the AR content 230 is displayed on the display screen 210 of the mobile terminal 110 according to the present embodiment. FIG. 18B shows a state in which the edit menu 1510 is displayed on the image 220 displayed on the display screen 210 when the AR content 230 is selected as an editing target. As shown in FIG. 18B, the edit menu 1510 includes a map movement process in addition to a copy process, a cut process, and a paste process. In the example of FIG. 18B, the user selects the map movement process. To do.

  When the map movement process is selected by the user, the map movement operation reception unit 1701 generates a map 710 in the world coordinate system based on the current position information (world coordinate system) and current direction information of the mobile terminal 110. In addition, when generating the map 710 of the world coordinate system, the map movement operation reception unit 1701 edits the AR content to be edited at a position specified by position information (world coordinate system) associated with the AR content to be edited. The symbol indicating is placed.

  FIG. 18C shows a state where the map 710 generated by the map movement operation receiving unit 1701 is displayed on the display screen 210. As shown in FIG. 18C, the map 710 has a circular shape centered on the current position information (world coordinate system) of the mobile terminal 110, and a symbol 1800 indicating the AR content to be edited is displayed on the map 710. Is displayed. The imaging range calculated based on the current position information (world coordinate system) of the mobile terminal 110 and the current orientation information is also displayed by shading.

  While the symbol 1800 is displayed on the map 710, the user moves the symbol 1800 to a position to be changed while touching (long pressing) the symbol 1800.

  FIG. 19A shows a state in which the user touches (long presses) the symbol 1800 and moves it to a position to be changed. When the user moves the symbol 1800, position information in the map 710 of the symbol 1800 (that is, position information in the world coordinate system) is calculated. The example of FIG. 19A shows that the symbol 1800 has moved to a position specified by position information (world coordinate system) C = (La3, Lo3, Al3).

  When the movement of the symbol 1800 is completed by the user, the position information update unit 1703 displays an edit menu on the display screen 210. FIG. 19B shows a state where the edit menu 1910 is displayed on the display screen 210. When the user selects save processing in the displayed edit menu 1910, the position information update unit 1703 changes the position information stored in “AR content position information” of the AR content management information 600. Specifically, the position information update unit 1703 uses the position information (world coordinate system) C = (La3, Lo3, Al3) of the position after the movement of the symbol 1800 to “AR content management information 600”. The position information stored in “position information” is changed.

  When the change of the position information stored in “AR content position information” is completed, a real-world image is displayed on the display screen 210 of the mobile terminal 110. Note that at this time, the user changes the position and orientation of the mobile terminal so that the position of the moved symbol 1800 is included in the imaging range. FIG. 19C shows that the image 1620 is displayed on the display screen 210 of the mobile terminal 110 by completing the change of the position information associated with the AR content.

  In the example of FIG. 19C, the AR content 230 whose position information has been changed due to the user changing the position and orientation of the mobile terminal 110 and changing the imaging range is included in the imaging range. It has become.

  Next, the flow of editing processing by the AR content editing unit 1700 in this embodiment will be described. FIG. 20 is a flowchart of the editing process by the AR content editing unit. The flowchart illustrated in FIG. 20 is started when the image 220 acquired by the imaging information display unit 501 is displayed on the display screen 210 of the mobile terminal 110 and the AR content 230 is displayed.

  In step S2001, the edit target receiving unit 801 receives selection of an AR content to be edited, and displays an edit menu 1510 on the display screen 210.

  In step S2002, the map movement operation receiving unit 1701 determines whether or not map movement processing is selected in the edit menu. If it is determined in step S2002 that the map moving process has not been selected, the process returns to step S2001.

  On the other hand, if it is determined in step S2002 that the map movement process has been selected, the process proceeds to step S2003. In step S2003, the map movement operation receiving unit 1701 generates a map 710 in the world coordinate system based on the current position information (world coordinate system) and current direction information of the mobile terminal 110. Further, the map moving operation reception unit 1701 has a symbol 1800 indicating the AR content 230 to be edited at a position specified by position information (world coordinate system) associated with the AR content 230 to be edited in the map 710. Place. Further, the map movement operation reception unit 1701 displays the generated map 710 on the display screen 210.

  In step S2004, the symbol moving unit 1702 determines whether or not there has been an instruction to move the symbol 1800 by the user. If it is determined that the user has not given an instruction to move the symbol 1800, the process proceeds to step S2008.

  On the other hand, if it is determined in step S2004 that the user has given an instruction to move the symbol 1800, the process proceeds to step S2005. In step S2005, the symbol moving unit 1702 moves the symbol 1800 in accordance with a moving instruction from the user. When the movement is completed, the position information update unit 1703 determines whether or not there is an instruction from the user to change the position information associated with the AR content to be edited, and there is an instruction to change the position information. Then, the position information (world coordinate system) of the symbol 1800 after movement is calculated.

  In step S2006, the position information update unit 1703 uses the calculated position information (world coordinate system) of the symbol 1800 to change the position information associated with the AR content to be edited.

  In step S2007, the position information update unit 1703 instructs the imaging information display unit 501 to restore the display on the display screen 210. As a result, the real-world image 1620 is displayed on the display screen 210.

  In step S2008, the editing target reception unit 801 determines whether or not to end editing. If it is determined that the editing is not to be ended, the process returns to step S2001 to edit other AR content. On the other hand, when it is determined that the editing is to be ended, the editing process is ended.

  As is clear from the above description, in the mobile terminal 110 according to the present embodiment, the map movement operation reception unit 1701 is identified by the imaging range (first image) specified according to the current position information and current direction information of the mobile terminal 110. Area) and a second area outside the imaging range, a map 710 is generated. Also, the map movement operation receiving unit 1701 displays the generated map 710 by distinguishing between the imaging range and the outside of the imaging range. Further, the map moving operation reception unit 1701 arranges and displays a symbol 1800 indicating the AR content in the map 710 based on the position information associated with the AR content to be edited.

  In addition, the symbol moving unit 1702 receives a moving operation of the symbol 1800 in the map 710, and the position information updating unit 1703 changes the position information associated with the AR content based on the position information of the moved symbol 1800. To do.

  Thereby, the user can change the position information associated with the AR content only by moving the symbol in the map. As a result, the operation of associating the AR content (object data) with the position can be easily performed.

[Other Embodiments]
In the first and second embodiments, the case has been described in which the position information associated with the AR content is changed one by one. However, when a plurality of AR contents are displayed on the image 220, a plurality of AR contents may be selected and the position information may be changed collectively.

  In the first and second embodiments, the AR content and the position information included in the AR content information provided from the server device 120 are stored in the mobile terminal 110, and the position information associated with the stored AR content. Explained the case of changing. However, the AR content whose position information is to be changed is not limited to the AR content stored in the mobile terminal 110. For example, the location information associated with the AR content provided from the server device 120 may be changed, and the AR content information having the changed location information may be transmitted to the server device 120. Thereby, the position information registered in association with the AR content in the AR content information DB 122 can be changed.

  In addition, the timing which transmits AR content information which has the changed positional information to the server apparatus 120 can be arbitrary timings. For example, the mobile terminal 110 may store the AR content information having the changed position information in the AR content management DB 511 and transmit the AR content information to the server device 120 at a predetermined timing. Thereby, the location information registered in association with the AR content in the AR content information DB 122 of the server device 120 can be changed collectively.

  In the first and second embodiments described above, the AR content provided from the server device 120 is stored in the mobile terminal 110 and the process of changing the position information associated with the stored AR content has been described. . However, the mobile terminal 110 may not only change the position information associated with the stored AR content, but may display the AR content stored in the AR content management DB 511 on the display screen thereafter.

  That is, the AR content display unit 505 of the mobile terminal 110 may search the AR content management DB 511 based on the information regarding the imaging range notified from the imaging range calculation unit 504. Thereby, among the AR content information stored in the AR content management DB 511, AR content information (AR content information including the AR content registered in association with the position in the area) having the position information included in the imaging range is obtained. To detect. As a result, the AR content display unit 505 can display the AR content stored in the AR content management DB 511 on the display screen. In this case, the AR content stored in the AR content management DB 511 of the mobile terminal 110 is “registered AR content”.

  In the first and second embodiments, the case where the mobile terminal is used in the AR content display system has been described. However, the AR content is displayed using a wearable terminal such as a head-mounted display, for example. May be. In a wearable terminal such as a head mounted display, the display unit may be, for example, a transmissive type. In the case of a transmissive display unit, the AR content is not superimposed on a captured image, and the predetermined content of the display unit (for example, in the case of a glasses-type head-mounted display, a portion corresponding to the glasses of glasses). It will be displayed directly at the position.

In addition, in the disclosed technology, forms such as the following supplementary notes are conceivable.
(Appendix 1)
In the display control method for displaying the object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected,
Accepting designation of the first state of the terminal used to change the position registered in association with the object data displayed on the display;
Accepting designation of the second state of the terminal used to change the position registered in association with the object data displayed on the display;
Changing the position registered in association with the object data based on the difference in position and orientation of the terminal in the first state and the second state;
A display control method, wherein a computer executes processing.
(Appendix 2)
A relative coordinate relationship between the position indicated on the display in the second state and the position of the terminal in the second state is a first coordinate system which is a coordinate system on the display. To generate a first vector by calculating based on
Generating the second vector by converting the generated first vector into a second coordinate system indicating a position registered in association with the object data;
Instructed on the display in the second state by adding the second vector to the position and orientation of the information processing apparatus in the second state indicated by the second coordinate system The display control method according to appendix 1, wherein a position is calculated by the second coordinate system, and a position registered in association with the object data is changed.
(Appendix 3)
By accepting the designation of the first state, the display of the object data on the display is erased,
The display control method according to appendix 2, wherein the object data whose display has been deleted is displayed at a position indicated on the display in the second state.
(Appendix 4)
In the display control method for displaying the object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected,
A map including a first range indicating a first area specified according to the position and orientation of the terminal and a second range indicating a second area outside the first area; And the display of the second range and the second range,
A symbol indicating the position of the object data registered in association with the position in the first area or the second area is set to a position corresponding to the position of the object data in the map. Display
Accept an operation to change the position of the displayed symbol,
Based on a change in the position of the symbol that has received the operation, the position registered in association with the object data corresponding to the symbol is changed.
A display control method, wherein a computer executes processing.
(Appendix 5)
An information processing device that displays object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the device is detected,
First receiving means for receiving designation of a first state of the information processing apparatus used for changing the position registered in association with the object data displayed on the display;
Second accepting means for accepting designation of a second state of the information processing apparatus used for changing the position registered in association with the object data displayed on the display;
And changing means for changing the position registered in association with the object data based on a difference in position and orientation of the information processing apparatus in the first state and the second state. Information processing device.
(Appendix 6)
An information processing device that displays object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the device is detected,
A map including a first range indicating a first area specified according to a position and orientation of the information processing apparatus, and a second range indicating a second area outside the first area, First display means for distinguishing between the first range and the second range and displaying on the display;
A symbol indicating the position of the object data registered in association with the position in the first area or the second area is set to a position corresponding to the position of the object data in the map. Second display means for displaying;
Accepting means for accepting an operation for changing the position of the displayed symbol;
An information processing apparatus comprising: a changing unit configured to change the position registered in association with object data corresponding to the symbol based on a change in the position of the symbol that has received the operation.
(Appendix 7)
When object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected, the computer displays the object data on a display.
Accepting designation of the first state of the terminal used to change the position registered in association with the object data displayed on the display;
Accepting designation of the second state of the terminal used to change the position registered in association with the object data displayed on the display;
Changing the position registered in association with the object data based on the difference in position and orientation of the terminal in the first state and the second state;
Display control program that executes processing.
(Appendix 8)
When object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected, a computer that displays the object data on a display,
A map including a first range indicating a first area specified according to the position and orientation of the terminal and a second range indicating a second area outside the first area; And the display of the second range and the second range,
A symbol indicating the position of the object data registered in association with the position in the first area or the second area is set to a position corresponding to the position of the object data in the map. Display
Accept an operation to change the position of the displayed symbol,
Based on a change in the position of the symbol that has received the operation, the position registered in association with the object data corresponding to the symbol is changed.
Display control program that executes processing.

  Note that the present invention is not limited to the configurations shown here, such as combinations with other elements, etc., in the configurations described in the above embodiments. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form.

100: AR content display system 110: mobile terminal 120: server device 121: content providing unit 122: AR content information DB
210: Display screen 220: Image 230: AR content 300: Map 501: Imaging information display unit 502: Current position information acquisition unit 503: Current direction information acquisition unit 504: Imaging range calculation unit 505: AR content display unit 506: AR content Editing unit 511: AR content management DB
600: AR content management information 801: Editing object reception unit 802: Cut operation reception unit 803: Paste position reception unit 804: Vector calculation unit 805: AR content paste unit 806: Position adjustment unit 1510: Edit menu 1610: Edit menu 1620: Image 1630: Paste position 1700: AR content editing unit 1701: Map moving operation receiving unit 1702: Symbol moving unit 1703: Position information updating unit

Claims (6)

In the display control method for displaying the object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected,
In Rukoto receives designation of a first state of the terminal to be used for changing the position registered in association with the object data displayed on the display, to erase the display of the object data on the display,
In the second state of the terminal used for changing the position registered in association with the object data displayed on the display, the object data whose display has been deleted is displayed at the position indicated on the display. ,
The area corresponding to the position indicated on the display, the position registered in association with the object data based on the difference in position and orientation of the terminal in the first state and the second state Change to a position in
A display control method, wherein a computer executes processing. In the display control method for displaying the object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected,
A map including a first range indicating a first area specified according to the position and orientation of the terminal and a second range indicating a second area outside the first area; And the display of the second range and the second range,
A symbol indicating the position of the object data registered in association with the position in the first area or the second area is set to a position corresponding to the position of the object data in the map. Display
Accept an operation to change the position of the displayed symbol,
Based on a change in the position of the symbol that has received the operation, the position registered in association with the object data corresponding to the symbol is changed.
A display control method, wherein a computer executes processing. An information processing device that displays object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the device is detected,
A first state of deleting the display of the object data on the display by receiving the designation of the first state of the information processing apparatus used for changing the position registered in association with the object data displayed on the display And accepting means,
In the second state of the information processing apparatus used for changing the position registered in association with the object data displayed on the display, the object data whose display has been deleted is displayed at the position indicated on the display. A second receiving means for displaying ;
Based on the difference in position and orientation of the information processing apparatus in the first state and the second state, the position registered in association with the object data corresponds to the position indicated on the display. An information processing apparatus comprising: changing means for changing to a position in the area . An information processing device that displays object data on a display when object data registered in association with a position in an area specified according to the position and orientation of the device is detected,
A map including a first range indicating a first area specified according to a position and orientation of the information processing apparatus, and a second range indicating a second area outside the first area, First display means for distinguishing between the first range and the second range and displaying on the display;
A symbol indicating the position of the object data registered in association with the position in the first area or the second area is set to a position corresponding to the position of the object data in the map. Second display means for displaying;
Accepting means for accepting an operation for changing the position of the displayed symbol;
An information processing apparatus comprising: a changing unit configured to change the position registered in association with object data corresponding to the symbol based on a change in the position of the symbol that has received the operation. When object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected, the computer displays the object data on a display.
In Rukoto receives designation of a first state of the terminal to be used for changing the position registered in association with the object data displayed on the display, to erase the display of the object data on the display,
In the second state of the terminal used for changing the position registered in association with the object data displayed on the display, the object data whose display has been deleted is displayed at the position indicated on the display. ,
The area corresponding to the position indicated on the display, the position registered in association with the object data based on the difference in position and orientation of the terminal in the first state and the second state Change to a position in
Display control program that executes processing. When object data registered in association with a position in an area specified according to the position and orientation of the terminal is detected, a computer that displays the object data on a display,
A map including a first range indicating a first area specified according to the position and orientation of the terminal and a second range indicating a second area outside the first area; And the display of the second range and the second range,
A symbol indicating the position of the object data registered in association with the position in the first area or the second area is set to a position corresponding to the position of the object data in the map. Display
Accept an operation to change the position of the displayed symbol,
Based on a change in the position of the symbol that has received the operation, the position registered in association with the object data corresponding to the symbol is changed.
Display control program that executes processing.

Images