JP7096295B2 - Display control system, program, and display control method - Google Patents

Description

The present invention relates to a display control system, a program, and a display control method.

Patent Document 1 includes an AR (Augmented) having a display unit capable of superimposing and displaying an AR virtual object on a landscape in a real space by displaying an image such as a text or a figure in a transparent or semi-transparent state. Reality) Glass is described.
[Prior Art Document]
[Patent Document]
[Patent Document 1] Japanese Unexamined Patent Publication No. 2019-114078

According to the first aspect of the present invention, a display control system is provided. The display control system may include an area attribute setting unit for setting an attribute indicating what kind of place the area is in each of a plurality of areas included in the spatial information in which the shape of the real space is registered. The display control system may include a registration propriety determination unit that determines whether or not AR content can be registered in the area based on the attributes set for the area. The display control system may include a content registration unit that registers AR content for the area when it is determined by the registration availability determination unit that registration is possible. The display control system may include a display control unit that controls the AR content registered by the content registration unit to be displayed on the spectacle-type device for an area included in the field of view of the spectacle-type device.

The above attributes may include at least one of public, private, commercial, and infrastructure. The registration possibility determination unit may determine whether or not the AR content can be registered in the area based on the attributes set for the area and the subject identification information that identifies the subject of registration. The registration possibility determination unit may determine whether or not the AR content can be registered in the area by referring to the authority information associated with the entity that permits the registration of the AR content for each of the plurality of attributes. The display control system may include an area type setting unit for setting a type for identifying a space in which the AR content is arranged in each of the plurality of areas, and the registration possibility determination unit may be set for the area. It may be determined whether or not the AR content can be registered in the area based on the attribute and the type. The content registration unit may register a content type indicating what the AR content is in association with the AR content, and the display control unit may register the AR content based on the content type of the AR content. The content may be controlled to be displayed on the glasses-type device. The content registration unit may register a display authority indicating a condition of a user who can display the AR content in association with the AR content, and the display control unit may register the display authority based on the display authority of the AR content. The display of the AR content by the eyeglass-type device may be controlled.

The display control system includes a moving body attribute setting unit that sets a moving body attribute indicating what kind of moving body the moving body is in the moving body information in which the shape of the moving body is registered, and the moving body information. For each of the plurality of parts of the moving body included in the above, a part attribute setting unit for setting a part attribute indicating whether or not to allow superimposed display of AR contents may be provided, and the display control unit may include the glasses. The display of the AR content for the plurality of parts by the eyeglass type device may be controlled based on the part attributes set for the plurality of parts of the moving body included in the field of view of the type device. The site attribute setting unit may set the site attribute indicating a user who permits the superimposed display of the AR content and a user who does not permit the superimposed display of the AR content for each of the plurality of sites.

According to the second aspect of the present invention, a display control system is provided. The display control system may include a moving body attribute setting unit that sets a moving body attribute indicating what kind of moving body the moving body is in the moving body information in which the shape of the moving body is registered. The display control system may include a part attribute setting unit for setting a part attribute indicating whether or not to allow superimposed display of AR content for each of a plurality of parts of the moving body included in the moving body information. The display control system is a display control unit that controls the display of AR content to a plurality of parts by the spectacle-type device based on the part attributes set for the plurality of parts of the moving body included in the field of view of the spectacle-type device. May be equipped. The site attribute setting unit may set the site attribute indicating a user who permits the superimposed display of the AR content and a user who does not permit the superimposed display of the AR content for each of the plurality of sites. A content registration unit for registering AR content related to the moving object, a display position of the AR content, and a user who can display the AR content is provided based on an instruction by a registrant related to the moving object. Often, when the moving object is included in the field of view of the user's eyeglass-type device capable of displaying the AR content, the display control unit displays the AR content related to the moving object in the eyeglass-type device. It may be controlled to be displayed at the display position of the AR content. The display control system may further include the spectacle-type device.

According to the third aspect of the present invention, a program for making a computer function as the display control system is provided.

According to a fourth aspect of the present invention, a display control method executed by a computer is provided. The display control method may include an area attribute setting stage for setting an attribute indicating what kind of place the area is in each of a plurality of areas included in the spatial information in which the shape of the real space is registered. The display control method may include a registration possibility determination stage for determining whether or not AR content can be registered for the area based on the attributes set for the area. The display control method may include a content registration stage in which AR content is registered in the area when it is determined in the registration possibility determination stage that registration is possible. The display control method may include a display control stage for controlling the AR content registered in the content registration stage for the area included in the field of view of the spectacle-type device to be displayed on the spectacle-type device.

According to a fifth aspect of the present invention, a display control method executed by a computer is provided. The display control method may include a moving body attribute setting stage for setting a moving body attribute indicating what kind of moving body the moving body is in the moving body information in which the shape of the moving body is registered. The display control method may include a part attribute setting stage for setting a part attribute indicating whether or not to allow superimposed display of AR content for each of a plurality of parts of the moving body included in the moving body information. The display control method may include a display control step for controlling the display of AR content to a plurality of parts based on the part attributes set for the plurality of parts of the moving body included in the field of view of the spectacle-type device. ..

The outline of the above invention does not list all the necessary features of the present invention. A subcombination of these feature groups can also be an invention.

An example of the system 10 is shown schematically. An example of the functional configuration of the display control system 100 is schematically shown. The flow of processing in the system 10 is shown schematically. An example of the attribute set by the area attribute setting unit 106 is shown schematically. A display example controlled by the display control unit 120 is schematically shown. The flow of processing in the system 10 is shown schematically. The flow of processing in the system 10 is shown schematically. An example of the hardware configuration of the computer 1200 that functions as an information processing apparatus is schematically shown.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention to which the claims are made. Also, not all combinations of features described in the embodiments are essential to the means of solving the invention.

FIG. 1 schematically shows an example of the system 10. The system 10 includes a display control system 100. The display control system 100 may be realized on the cloud. The display control system 100 may be realized by one device. The display control system 100 may be realized by a plurality of devices.

The network 20 includes a cloud. The network 20 may include a mobile communication network. The mobile communication network may comply with any of the LTE (Long Term Evolution) communication method, the 3G (3rd Generation) communication method, the 5G (5th Generation) communication method, and the 6G (6th Generation) communication method or later. good. The network 20 may be compatible with the Wi-Fi (registered trademark) communication method. The network 20 may be accessible via a Wi-Fi access point. The network 20 may be accessible by using other wireless communication in general.

The system 10 may include a spectacle-type device 200. The system 10 may include a communication terminal 300. The system 10 may include a measuring device 400. The system 10 may include a communication terminal 500.

The spectacle-type device 200 may be a so-called AR glass. The spectacle-type device 200 is a device capable of giving the user 202 the feeling that the AR content is arranged in the real space by displaying the AR content according to the field of view on the transparent or translucent glass. You can do it. That is, the spectacle-type device 200 may be a so-called transmissive type (see-through type) device. The AR content may be CG (Computer Graphics) content for AR.

The display control system 100 controls the display of AR contents by the spectacle-type device 200. The display control system 100 communicates with the spectacle-type device 200 via the network 20. The display control system 100 may be connected to the network 20 by wire or wirelessly. The spectacle-type device 200 may be connected to the network 20 by mobile communication, Wi-Fi communication, and other wireless communication in general. The display control system 100 receives, for example, the field of view information of the spectacle-type device 200 from the spectacle-type device 200 via the network 20, and causes the spectacle-type device 200 to display AR content according to the field of view. The user 202 wearing the spectacle-type device 200 can experience as if the AR content is arranged in the real space. The spectacle-type device 200 generates visibility information based on, for example, the position, orientation, and posture of the spectacle-type device 200. The spectacle-type device 200 can specify the position, orientation, and posture of the spectacle-type device 200 by using various sensors such as a positioning sensor, an acceleration sensor, and a gyro sensor. The spectacle-type device 200 may generate visibility information based on an image captured by an imaging unit included in the spectacle-type device 200. The spectacle-type device 200 may generate visual field information by using a sensor or the like other than these, for example, LiDAR (Light Detection and Ringing). The spectacle-type device 200 may generate visual field information by using these in combination.

The display control system 100 may receive and store spatial information in which the shape of the real space is registered from the measuring device 400 via the network 20. The measuring device 400 may generate spatial information using various sensors. The spatial information may be, for example, point cloud data representing an object in space. Examples of the sensor include, but are not limited to, a ranging sensor, LiDAR, and the like, and the measuring device 400 may use any known sensor. The display control system 100 may receive and store spatial information from the spectacle-type device 200. Similar to the measuring device 400, the spectacle-type device 200 may also generate spatial information using various sensors.

The display control system 100 may accept registration of AR content for each of a plurality of areas included in the spatial information. The plurality of areas may be those according to divisions such as parks and roads, and may be arbitrarily divided.

The display control system 100 accepts, for example, registration of AR content by the user 202. The display control system 100 receives, for example, a request for registering AR content for an area from the communication terminal 300 of the user 202, and registers the AR content in the area. The communication terminal 300 may be a smartphone, a tablet terminal, a PC (Personal Computer), or the like. The display control system 100 may receive an AR content registration request for the area from the eyeglass-type device 200 of the user 202 and register the AR content in the area.

Further, the display control system 100 accepts registration of AR content by a registration worker or the like who performs AR content registration work. The display control system 100 receives, for example, a registration request for AR content for the area from the communication terminal 500 of the registration worker, and registers the AR content in the area. The communication terminal 500 may be a smartphone, a tablet terminal, a PC (Personal Computer), or the like. The communication terminal 500 may be AR glass.

The display control system 100 may accept registration of AR content for a moving object. Examples of moving objects include, but are not limited to, people, animals, vehicles, and the like. The display control system 100 is, for example, an AR regarding the first user 202 displayed by the spectacle-type device 200 when the first user 202 enters the field of view of the spectacle-type device 200 of the second user 202. The registration of the content is accepted from the first user 202. The first user 202 registers, for example, AR content indicating a link destination to his / her SNS around him / her. As a result, when the first user 202 enters the field of view of the eyeglass-type device 200 of the second user 202, the AR content indicating the link destination to the SNS of the first user 202 is provided to the second user 202. It can be displayed on the spectacle-type device 200.

Further, the display control system 100 registers, for example, the AR content displayed by the spectacle-type device 200 when the first user 202 enters the field of view of the spectacle-type device 200 of the second user 202. , Accepted from the second user 202. When the second user 202 enters the field of view of the spectacle-type device 200 of the second user 202 by registering AR contents such as clothes and a hat, the first user 202 is the first user 202. It is possible to view the state in which clothes, a hat, etc. are superimposed on the user 202.

Further, the display control system 100 registers, for example, AR content related to the vehicle displayed by the spectacle-type device 200 when the vehicle enters the field of view of the spectacle-type device 200 of the user 202. Accept from etc. The owner of the vehicle registers, for example, AR content indicating the performance of the vehicle. As a result, when the vehicle enters the field of view of the spectacle-type device 200, the user 202 can be made aware of the performance of the vehicle and the like.

By accepting the registration of a plurality of AR contents, the display control system 100 can superimpose and display the AR contents on each area or moving body in the real space, and the user 202 can enjoy the AR contents. , Can be used. However, if such AR content becomes widespread, AR content may be scattered in the space, causing inconvenience to the user 202 in daily life.

For example, overlapping AR content on traffic lights, road signs, stairs, emergency exits, etc. can increase the risk to the user. In addition, when AR content is overlapped on a building, a signboard, or the like, advertisements in the real world are hidden by the AR content, which may cause a problem of ownership. In addition, for example, if personal information is disclosed indefinitely, privacy problems may occur. Further, if the AR content of another person's face or body is superimposed on the face or body of the person in such a way that the person feels uncomfortable, the problem of defamation may occur. As described above, as the spread of AR content progresses, the risk that the AR content is displayed in an inappropriate place, the risk that the inappropriate content is displayed, or both of them increases.

The display control system 100 according to the present embodiment solves the above-mentioned problems for each of a static object such as a plurality of areas included in spatial information and a dynamic object such as a moving body. Providing technology that contributes. For example, the display control system 100 controls the display of AR contents by setting attributes and privileges for each of the plurality of areas. Further, for example, the display control system 100 controls the display of AR contents by setting display authority for each part of the moving body.

FIG. 2 schematically shows an example of the functional configuration of the display control system 100. The display control system 100 includes a storage unit 102, a spatial information acquisition unit 104, an area attribute setting unit 106, an area type setting unit 108, an authority setting unit 110, a registration possibility determination unit 112, a content registration unit 114, and a moving body information acquisition unit 116. , A site attribute setting unit 118, and a display control unit 120. It is not always essential that the display control system 100 includes all of these.

The spatial information acquisition unit 104 acquires spatial information in which the shape of the real world is registered. The spatial information acquisition unit 104 may receive spatial information generated by the measuring device 400 from the measuring device 400 via the network 20. The spatial information acquisition unit 104 may receive the spatial information generated by the spectacle-type device 200 from the spectacle-type device 200 via the network 20. The spatial information acquisition unit 104 may store the acquired spatial information in the storage unit 102.

The area attribute setting unit 106 sets an attribute indicating what kind of place the area is in each of the plurality of areas included in the spatial information stored in the storage unit 102. The area attribute setting unit 106 may divide the shape of the real world registered in the spatial information into a plurality of areas. Each of the plurality of areas may be defined by a range of three-dimensional coordinates.

The area attribute setting unit 106 divides the area and sets the attributes according to the instructions of the operator, the administrator, and the like of the display control system 100, for example. Further, for example, the area attribute setting unit 106 divides the area and sets the attributes according to the instructions of the administrator of each space. Further, the area attribute setting unit 106 divides the area and sets the attributes according to the instruction of the person who executed the measurement using, for example, the measuring device 400.

Area attributes may include public. Area attributes may include private ownership. Area attributes may include commerce. Area attributes may include infrastructure. Area attributes may include free. These are examples, and the attributes of the area may include other than these.

The area type setting unit 108 sets a type for identifying the space in which the AR content is arranged in each of the plurality of areas. The type of area may include the appearance of the building. The area type may include the inside of the building. Area types may include stairs. The area type may include a traffic light. Area types may include parks. Area types may include roads. Area types may include sidewalks. These are examples, and the type of area may include other than these.

The authority setting unit 110 sets the authority for arranging the AR content in the area for the attribute of the area. The authority setting unit 110 sets, for example, an entity on which AR content can be arranged for each area attribute. The authority setting unit 110 may generate authority information associated with an entity that permits registration of AR content for each of the plurality of attributes. As a specific example, the authority setting unit 110 sets the national government and the local government as persons who can arrange AR contents in the area of the infrastructure. As a result, it is possible to prevent the user's risk from increasing due to the free placement of AR content on infrastructure such as roads. The authority setting unit 110 may be set so as not to limit the subject to which the AR content can be arranged, for example, in a free area or the like.

The authority setting unit 110 may set the authority for arranging the AR content in the area for the attribute and the type of the area. The authority setting unit 110 sets, for example, an entity capable of arranging AR contents in a combination of area attributes and types. The authority setting unit 110 may generate authority information in which an entity that permits registration of AR content is associated with a combination of area attributes and types. As a specific example, the authority setting unit 110 sets only a specific administrator as a subject capable of arranging AR content in an area where the attribute is public and the type is road. This makes it possible to realize more detailed authority settings.

The authority setting unit 110 sets the authority according to the instructions of the operator, the administrator, and the like of the display control system 100, for example. Further, for example, the authority setting unit 110 sets the authority according to the instruction of the administrator of each space or the like. Further, for example, the authority setting unit 110 sets the authority according to the instruction of the person who executed the measurement using the measuring device 400.

The registration possibility determination unit 112 receives a registration request for AR content for the area. The registration request may include a target area, AR content to be registered, and subject identification information that identifies the subject of registration. The registration possibility determination unit 112 receives, for example, a registration request from the communication terminal 300. Further, the registration possibility determination unit 112 receives, for example, a registration request from the communication terminal 500. Further, the registration possibility determination unit 112 receives, for example, a registration request from the spectacle-type device 200.

The registration possibility determination unit 112 determines whether or not the AR content can be registered based on the attributes set for the target area. The registration possibility determination unit 112 determines, for example, that registration is possible when the attribute of the target area is set so as not to limit the subject to which the AR content can be arranged.

The registration possibility determination unit 112 may determine whether or not the AR content can be registered in the area based on the attributes set for the target area and the subject identification information. The registration possibility determination unit 112 may determine whether registration is possible by referring to the authority information generated by the authority setting unit 110. For example, if the subject identified by the subject identification information has the authority to arrange the AR content for the attribute of the target area, the registration possibility determination unit 112 determines that the registration is possible and assigns the authority. If it does not have it, it is judged as registration failure.

The registration possibility determination unit 112 may determine whether or not AR content can be registered in the area based on the attributes and types set for the target area and the subject identification information. The registration possibility determination unit 112 may determine whether registration is possible by referring to the authority information generated by the authority setting unit 110. For example, the registration possibility determination unit 112 determines that registration is possible when the subject identified by the subject identification information has the authority to arrange AR content for the combination of the attributes and types of the target area. However, if you do not have the authority, it is judged that the registration is not possible.

The content registration unit 114 registers AR content in the area when it is determined by the registration possibility determination unit 112 that registration is possible. The content registration unit 114 may register a content type indicating what the AR content is in association with the AR content. The content type may be included in the registration request. The content registration unit 114 registers, for example, the content type included in the registration request.

The content type may include advertisements. The content type may include guidance. The content type may include a guide. The content type may include a profile. These are examples, and the content type may include other than these.

The content registration unit 114 may register the display position of the AR content in association with the AR content. The display position may be defined by a range of three-dimensional coordinates. The display position may be included in the registration request. The content registration unit 114 may register the display position included in the registration request.

The content registration unit 114 may register the display setting of the AR content in association with the AR content. The display settings may be included in the registration request. The content registration unit 114 may register the display settings included in the registration request. The display setting may include whether to arrange in a plane or in three dimensions. The display settings may include the angle of the AR content. The display setting may include a display condition such that the AR content is displayed on the eyeglass-type device 200 of the user 202 located within a predetermined angle.

The content registration unit 114 may register the expiration date in association with the AR content. The expiration date may be included in the registration request. The content registration unit 114 may register the expiration date included in the registration request.

The content registration unit 114 may register the language setting of the AR content in association with the AR content. The language setting may be included in the registration request. The content registration unit 114 may register the language setting included in the registration request.

The content registration unit 114 may register the display authority indicating the condition of the user who can display the AR content in association with the AR content. Display authority may be included in the registration request. The content registration unit 114 may register the display authority included in the registration request. The display authority may specify an age limit such that display is possible for a set age or older. Further, the display authority may specify the authority for the user's attribute, such as allowing the user who has the public attribute setting turned on to display.

The moving body information acquisition unit 116 acquires moving body information in which the shape of the moving body is registered. The mobile information acquisition unit 116 receives, for example, mobile information in which the shape of the user 202 is registered from the communication terminal 300 via the network 20. Further, the moving body information acquisition unit 116 receives, for example, moving body information in which the shape of the user 202 is registered from the eyeglass-type device 200 via the network 20. Further, the mobile body information acquisition unit 116 receives, for example, mobile body information in which the shape of an arbitrary mobile body is registered from the communication terminal 500 via the network 20.

The part attribute setting unit 118 sets a part attribute indicating whether or not to allow superimposed display of AR content for each of a plurality of parts of the moving body included in the moving body information. For example, when the moving body is a person, the plurality of parts include the face, body, arms, legs, surroundings, and the like. As a specific example, the site attribute setting unit 118 makes settings such as prohibiting superimposed display of AR content on the entire body and permitting superimposed display of AR content on the surroundings of the body.

The site attribute setting unit 118 sets, for example, a site attribute indicating a user who permits superimposed display of AR content and a user who does not permit superimposed display of AR content for each of the plurality of sites. For example, the part attribute setting unit 118 allows the acquaintance of the target person to superimpose and display the AR content, and prohibits the superimposing display of the AR content to other than the acquaintance, for example, according to the instruction of the target person. conduct.

The content registration unit 114 may register the AR content related to the moving body, the display position of the AR content, and the user who can display the AR content, based on the instruction by the registrant related to the moving body. When the moving body is a person, the registrant associated with the moving body may be the person. When the moving body is a vehicle, the registrant related to the moving body may be the owner of the vehicle or the like.

The display control unit 120 controls the display of AR content by the eyeglass-type device 200. The display control unit 120 continuously receives, for example, the field of view information of the spectacle-type device 200 from the spectacle-type device 200 via the network 20. The display control unit 120 determines whether or not the area in which the AR content is registered is included in the field of view of the spectacle-type device 200 based on the field of view information.

The display control unit 120 controls the spectacle-type device 200 to display the AR content registered by the content registration unit 114 for the area included in the field of view of the spectacle-type device 200. The display control unit 120 may control the AR content to be displayed on the eyeglass-type device 200 based on the content type of the AR content. The display control unit 120 displays, for example, so that the AR content displayed on the eyeglass-type device 200 includes information on the content type of the AR content.

The display control unit 120 may transmit the AR content and the display instruction to the spectacle-type device 200 so that the AR content is displayed at the display position registered for the AR content. The display control unit 120 may transmit the AR content and the display instruction to the spectacle-type device 200 so that the AR content is displayed according to the display setting registered for the AR content. The display control unit 120 refers to the expiration date registered for the AR content, displays it when the expiration date has not passed, and does not display it when the expiration date has passed. You may control the display of AR content by the spectacle-type device 200.

The display control unit 120 may control the display of the AR content by the spectacle-type device 200 based on the display authority registered for the AR content and the attributes of the user 202 of the spectacle-type device 200. The display control unit 120 displays the AR content on the spectacle-type device 200 when the attribute of the user 202 satisfies the condition of the user who can display the AR content indicated by the display authority, and displays the AR content in the spectacles when the condition is not satisfied. It is controlled so that it is not displayed on the type device 200.

For example, if the registrant who registers the AR content thinks that the AR content is not preferable for those under the age of 18, the registrant makes it impossible to display the AR content to the user under the age of 18 in association with the AR content. Set display authority. As a result, it is possible to prevent the user from being presented with AR content that is inappropriate for the user.

The registration of the display authority for the AR content may be performed by a person other than the registrant of the AR content. For example, when the user 202 who browses the AR content by the spectacle-type device 200 determines that the AR content is not preferable for some users, the user 202 uses the spectacle-type device 200 or the communication terminal 300 to use the spectacle-type device 200 or the communication terminal 300. This is transmitted to the display control system 100. When the content registration unit 114 satisfies a predetermined condition such as receiving such an indication for the AR content more than a predetermined number of times, the content registration unit 114 may contact the AR content with respect to the part of the user. Register the display authority that restricts the display.

The display control unit 120 may determine whether or not a moving object in which AR content is registered is included in the field of view of the spectacle-type device 200 based on the field of view information. The display control unit 120 controls the display of the AR content on the plurality of parts by the spectacle-type device 200 based on the part attributes set for the plurality of parts of the moving body included in the field of view of the spectacle-type device 200. You can do it.

For example, when the moving object is included in the field of view of the spectacle-type device 200 of the user 202 capable of displaying the AR content, the display control unit 120 causes the spectacle-type device 200 to display the AR content related to the moving object. When the user 202 of the spectacle-type device 200 matches the user who can display the AR content registered for the part of the moving body included in the field of view of the spectacle-type device 200, the display control unit 120 determines the spectacles. The type device 200 is controlled to display the AR content at the display position registered for the AR content.

FIG. 3 schematically shows the flow of processing in the system 10. Here, the flow from the acquisition of spatial information to the display of AR content by the spectacle-type device 200 is schematically shown.

In the step (the step may be abbreviated as S) 102, the measuring device 400 transmits the spatial information to the display control system 100. The spatial information acquisition unit 104 may receive spatial information from a plurality of measuring devices 400. The spectacle-type device 200 may transmit the spatial information to the display control system 100. The spatial information acquisition unit 104 may receive spatial information from a plurality of eyeglass-type devices 200. The spatial information acquisition unit 104 may receive spatial information from both the measuring device 400 and the spectacle-type device 200. The spatial information acquisition unit 104 may receive a plurality of spatial information from one measuring device 400.

In S104, the area attribute setting unit 106 divides the shape of the real world registered in the spatial information into a plurality of areas. In S106, the area attribute setting unit 106 sets the attributes of each of the plurality of areas. In S108, the area type setting unit 108 sets each type of the plurality of areas.

In S110, the authority setting unit 110 sets an entity on which AR contents can be arranged for each attribute of a plurality of areas. The authority setting unit 110 may generate authority information associated with an entity that permits registration of AR content for each of the plurality of attributes.

In S112 and S114, the communication terminal 300 and the communication terminal 500 transmit an AR content registration request to the area according to the authority set by the display control system 100. In S116, the registration possibility determination unit 112 determines whether or not the AR content can be registered. In S118, the content registration unit 114 registers the AR content determined to be registerable by the registration possibility determination unit 112. The display control system 100 may accept registration of AR contents by a large number of communication terminals 300 and communication terminals 500. The display control system 100 may accept registration of AR content by the spectacle-type device 200. In this case, the spectacle-type device 200 transmits a registration request for AR content to the area according to the authority set by the display control system 100.

In S120, the spectacle-type device 200 transmits the visual field information to the display control system 100. The display control unit 120 determines whether or not the area in which the AR content is registered is included in the field of view indicated by the field of view information, and if it is included, the AR content for the user 202 of the spectacle-type device 200. Is determined whether or not can be displayed.

In S122, the display control unit 120 transmits the AR content determined to be displayable and the display instruction to the spectacle-type device 200. In S124, the spectacle-type device 200 displays AR content according to the display instruction received in S122.

In S116, it may be further determined whether or not the AR content to be registered violates public order and morals. The determination may be made, for example, by a dedicated person. When the person in charge determines that the AR content is offensive to public order and morals, the registration availability determination unit 112 may determine registration rejection.

Machine learning may be used to determine whether or not the AR content to be registered is offensive to public order and morals. For example, the registration availability determination unit 112 accumulates determination results determined by a dedicated person in charge. Then, the registration possibility determination unit 112 learns, for example, a model capable of identifying AR content determined to be offensive to public order and morals. When a new registration request is received, the registration possibility determination unit 112 determines whether or not the target AR content violates public order and morals by using the model.

FIG. 4 schematically shows an example of the attribute set by the area attribute setting unit 106. In the example shown in FIG. 4, the area attribute setting unit 106 may set a public attribute for the area 602. Further, the area type setting unit 108 can set the type of the park for the area 602. Further, the authority setting unit 110 may set a general for the area 602, which indicates that a general user can also arrange AR content.

Further, the area attribute setting unit 106 may set the infrastructure attribute for the area 604. Further, the area type setting unit 108 can set the road type for the area 604. Further, the authority setting unit 110 may set an authority for the area 604 to indicate that only the owner (country, etc.) of the road can arrange the AR content.

FIG. 5 schematically shows a display example controlled by the display control unit 120. According to the settings exemplified in FIG. 4, the user 202 can freely arrange the AR content in the area 602. FIG. 5 illustrates a case where AR content 612 is registered for the area 602.

Unless the display authority of the AR content 612 is particularly limited, the AR content 612 can be displayed in the area 602 regardless of the user 202's eyeglass-type device 200. Is displayed. For example, when an age limit is specified as the display authority of the AR content 612, the AR content 612 is displayed on the eyeglass-type device 200 of the user 202 over the set age, and the user 202 under the set age is displayed. The AR content 612 will not be displayed on the spectacle-type device 200.

According to the setting illustrated in FIG. 4, only the owner of the road can arrange the AR content in the area 604. FIG. 5 illustrates a case where AR content 614 is registered for the area 604.

A plurality of languages may be set for the AR content 614. For example, when English and Korean are set for the AR content 614, the eyeglass-type device 200 of the Korean user 202 may be replaced with "STOP" or in addition to "STOP". AR content 614 including Korean corresponding to "STOP" may be displayed.

FIG. 6 schematically shows the flow of processing in the system 10. Here, the flow of processing when displaying the AR content related to the first user 202 when the first user 202 enters the field of view of the eyeglass-type device 200 of the second user 202 is schematically described. show.

In S202, the first user 202 displays the features such as the face and body of the first user 202 and the surroundings of the first user 202 by using the glasses-type device 200 or the communication terminal 300. A registration request for registering the AR content related to the profile of 202 is transmitted to the display control system 100. The content registration unit 114 registers the features of the first user 202. Further, the content registration unit 114 registers the AR content received for the portion around the first user 202 in association with the first user 202.

In S204, the first user 202 enters the field of view of the eyeglass-type device 200 of the second user 202. In S206, the eyeglass-type device 200 of the second user 202 detects the feature of the first user 202. In S208, the spectacle-type device 200 of the second user 202 transmits the feature data indicating the feature detected in S206 to the display control system 100.

The display control unit 120 identifies the first user 202 based on the feature data received in S208, and reads out the AR content registered in association with the first user 202. In S210, the display control unit 120 transmits the display instruction and the AR content to the eyeglass-type device 200 of the second user 202 so that the read AR content is displayed around the first user 202.

In S212, the eyeglass-type device 200 of the second user 202 displays the AR content received in S210 around the first user 202.

FIG. 7 schematically shows the flow of processing in the system 10. Here, the flow of processing when the AR content registered by the second user 202 is displayed when the first user 202 enters the field of view of the eyeglass-type device 200 of the second user 202 is schematically described. show. Here, it is assumed that the second user 202 is set to arrange the AR content of the hat on the head of the person in the field of view of the eyeglass-type device 200 and the AR content of the clothes on the body.

In S302, the first user 202 uses the glasses-type device 200 or the communication terminal 300 to transmit the features such as the face and body of the first user 202 and the setting of the site attribute to the display control system 100. Here, the description will be continued assuming that the setting is set to allow the arrangement of the AR content with respect to the head of the first user 202.

In S304, the first user 202 enters the field of view of the eyeglass-type device 200 of the second user 202. In S306, the eyeglass-type device 200 of the second user 202 detects the feature of the first user 202. In S308, the spectacle-type device 200 of the second user 202 transmits the feature data indicating the feature detected in S206 to the display control system 100.

The display control unit 120 identifies the first user 202 based on the feature data received in S308, and confirms the setting of the part attribute for the first user 202. The display control unit 120 indicates that the placement of AR content is permitted for the head of the first user 202, and the placement of AR content is prohibited for the body of the first user 202. Confirm. The display control unit 120 transmits the display instruction for arranging and displaying the AR content of the hat on the head of the first user 202 and the AR content of the hat to the glasses-type device 200 of the second user 202.

In S312, the eyeglass-type device 200 of the second user 202 arranges and displays the AR content received in S210 on the head of the first user 202.

In the above embodiment, the case where the spectacle-type device 200 is a transmissive type (see-through type) device has been mainly described, but the present invention is not limited to this. The spectacle-type device 200 may be a non-transmissive device. In this case, the spectacle-type device 200 always displays the captured image capturing the same range as the field of view of the user 202 on the non-transmissive display. The glasses-type device 200 continuously transmits the visibility information to the display control system 100, and under the control of the display control system 100, includes the AR content in the captured image that captures the same range as the view of the user 202. , Display on a non-transparent display.

FIG. 8 schematically shows an example of a hardware configuration of a computer 1200 that functions as a display control system 100. A program installed on the computer 1200 causes the computer 1200 to function as one or more "parts" of the apparatus according to the present embodiment, or causes the computer 1200 to perform an operation associated with the apparatus according to the present embodiment or the one or the like. A plurality of "parts" can be executed and / or a computer 1200 can be made to execute a process according to the present embodiment or a stage of the process. Such a program may be run by the CPU 1212 to cause the computer 1200 to perform certain operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphic controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes an input / output unit such as a communication interface 1222, a storage device 1224, and an IC card drive, which are connected to the host controller 1210 via the input / output controller 1220. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes an input / output unit such as a ROM 1230 and a keyboard or touch panel, which are connected to the input / output controller 1220 via an input / output chip 1240.

The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires the image data generated by the CPU 1212 in a frame buffer or the like provided in the RAM 1214 or itself so that the image data is displayed on the display device 1218.

The communication interface 1222 communicates with other electronic devices via the network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The IC card drive reads the program and data from the IC card and / or writes the program and data to the IC card.

The ROM 1230 stores in it a boot program or the like executed by the computer 1200 at the time of activation, and / or a program depending on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

The program may be provided by a computer-readable storage medium such as an IC card. The program is read from a computer-readable storage medium, installed in a storage device 1224, RAM 1214, or ROM 1230, which is also an example of a computer-readable storage medium, and executed by the CPU 1212. The information processing described in these programs is read by the computer 1200 and provides a link between the program and the various types of hardware resources described above. The device or method may be configured to implement the operation or processing of information in accordance with the use of the computer 1200.

For example, when communication is executed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded in the RAM 1214, and performs communication processing with respect to the communication interface 1222 based on the processing described in the communication program. You may order. Under the control of the CPU 1212, the communication interface 1222 reads the transmission data stored in the transmission buffer area provided in the recording medium such as the RAM 1214, the storage device 1224, or the IC card, and transfers the read transmission data to the network. The received data transmitted or received from the network is written in the reception buffer area or the like provided on the recording medium.

Further, the CPU 1212 makes the RAM 1214 read all or necessary parts of the file or the database stored in the external recording medium such as the storage device 1224 and the IC card, and various types of processing for the data on the RAM 1214. May be executed. The CPU 1212 may then write back the processed data to an external recording medium.

Various types of information such as various types of programs, data, tables, and databases may be stored in recording media and processed. The CPU 1212 describes various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, and information retrieval described in various parts of the present disclosure with respect to the data read from the RAM 1214. Various types of processing may be performed, including / replacement, etc., and the results are written back to the RAM 1214. Further, the CPU 1212 may search for information in a file, a database, or the like in the recording medium. For example, when a plurality of entries each having an attribute value of the first attribute associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 is the first of the plurality of entries. The attribute value of the attribute of is searched for the entry that matches the specified condition, the attribute value of the second attribute stored in the entry is read, and the attribute value of the second attribute is changed to the first attribute that satisfies the predetermined condition. You may get the attribute value of the associated second attribute.

The program or software module described above may be stored on a computer 1200 or in a computer readable storage medium near the computer 1200. Also, a recording medium such as a hard disk or RAM provided in a dedicated communication network or a server system connected to the Internet can be used as a computer readable storage medium, thereby allowing the program to be transferred to the computer 1200 via the network. offer.

The blocks in the flowcharts and block diagrams of this embodiment may represent the stage of the process in which the operation is performed or the "part" of the device responsible for performing the operation. Specific steps and "parts" are supplied with a dedicated circuit, a programmable circuit supplied with computer-readable instructions stored on a computer-readable storage medium, and / or with computer-readable instructions stored on a computer-readable storage medium. It may be implemented by the processor. Dedicated circuits may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuits include logical products, logical sums, exclusive logical sums, negative logical products, negative logical sums, and other logical operations, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like. , Flip-flops, registers, and reconfigurable hardware circuits, including memory elements.

The computer readable storage medium may include any tangible device capable of storing instructions executed by the appropriate device, so that the computer readable storage medium having the instructions stored therein may be in a flow chart or block diagram. It will be equipped with a product that contains instructions that can be executed to create means for performing the specified operation. Examples of the computer-readable storage medium may include an electronic storage medium, a magnetic storage medium, an optical storage medium, an electromagnetic storage medium, a semiconductor storage medium, and the like. More specific examples of computer-readable storage media include floppy (registered trademark) disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), and erasable programmable read-only memory (EPROM or flash memory). , Electrically Erasable Programmable Read Only Memory (EEPROM), Static Random Access Memory (SRAM), Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD), Blu-ray® Disc, Memory Stick , Integrated circuit cards and the like may be included.

Computer-readable instructions are assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or object-oriented programming such as Smalltalk, JAVA®, C ++, etc. Includes either source code or object code written in any combination of one or more programming languages, including languages and traditional procedural programming languages such as the "C" programming language or similar programming languages. good.

Computer-readable instructions are used to generate means for a general-purpose computer, a special-purpose computer, or the processor of another programmable data processing device, or a programmable circuit, to perform an operation specified in a flowchart or block diagram. General purpose computers, special purpose computers, or other programmable data processing locally or via a local area network (LAN), a wide area network (WAN) such as the Internet, etc., to execute such computer-readable instructions. It may be provided to the processor of the device or a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the above embodiments. It is clear from the description of the claims that the form with such changes or improvements may be included in the technical scope of the present invention.

The order of execution of each process such as operation, procedure, step, and step in the apparatus, system, program, and method shown in the claims, specification, and drawings is particularly "before" and "prior to". It should be noted that it can be realized in any order unless the output of the previous process is used in the subsequent process. Even if the scope of claims, the specification, and the operation flow in the drawings are explained using "first", "next", etc. for convenience, it means that it is essential to carry out in this order. It's not a thing.

10 system, 20 network, 100 display control system, 102 storage unit, 104 spatial information acquisition unit, 106 area attribute setting unit, 108 area type setting unit, 110 authority setting unit, 112 registration availability determination unit, 114 content registration unit, 116 Mobile information acquisition unit, 118 part attribute setting unit, 120 display control unit, 200 glasses-type device, 202 users, 300 communication terminals, 400 measuring devices, 500 communication terminals, 602 areas, 604 areas, 612 AR contents, 614 AR contents 1200 Computer, 1210 Host Controller, 1212 CPU, 1214 RAM, 1216 Graphic Controller, 1218 Display Device, 1220 I / O Controller, 1222 Communication Interface, 1224 Storage Device, 1230 ROM, 1240 I / O Chip

Claims (8)

An area attribute setting unit that sets attributes indicating what kind of place the area is for each of the multiple areas included in the spatial information in which the shape of the real space is registered.
An area type setting unit that sets the type for each of the plurality of areas,
An authority setting unit that generates authority information associated with an entity that permits registration of AR content for each combination of the area attribute and the area type.
It is a registration possibility determination unit that determines whether or not the AR content can be registered in the area based on the attributes and types set for the area, and the subject of registration is the target with reference to the authority information. When it is determined that the AR content has the authority to be arranged for the combination of the attribute and the type of the area, the registration possibility determination unit for determining whether the AR content can be registered in the area, and the registration possibility determination unit.
When the registration possibility determination unit determines that registration is possible, the content registration unit that registers the AR content in the area and the content registration unit.
The AR content and the display instruction are transmitted to the spectacle-type device so that the AR content registered by the content registration unit is displayed on the spectacle-type device for an area included in the field of view of the spectacle-type device. Equipped with a display control unit
The attributes include at least one of public, private, commercial, and infrastructure.
The type is a display control system including at least one of building exterior, building interior, stairs, traffic lights, parks, roads, and sidewalks . The content registration unit registers the display authority indicating the condition of the user who can display the AR content in association with the AR content.
The display control system according to claim 1 , wherein the display control unit controls the display of the AR content by the eyeglass-type device based on the display authority of the AR content. The content registration unit according to claim 1 or 2 , wherein when the registration possibility determination unit determines that registration is possible, the content registration unit registers the AR content and display settings related to the display of the AR content in the area. Display control system. The display control system according to claim 3 , wherein the display setting includes whether the display of the AR content to be registered is arranged in a plane or three-dimensionally. The display control system according to claim 3 or 4 , wherein the display setting includes a display angle of the AR content to be registered. The display control system according to any one of claims 1 to 5 , further comprising the spectacle-type device. A program for operating a computer as the display control system according to any one of claims 1 to 5 . A display control method performed by a computer.
An area attribute setting stage that sets an attribute indicating what kind of place the area is for each of the multiple areas included in the spatial information in which the shape of the real space is registered.
The area type setting stage where the type is set for each of the plurality of areas, and
For each combination of the attribute of the area and the type of the area, the authority setting stage for generating the authority information associated with the subject who permits the registration of the AR content, and the authority setting stage.
At the registration availability determination stage for determining whether or not the AR content can be registered for the area based on the attributes and types set for the area, the subject of registration is the target with reference to the authority information. When it is determined that the AR content has the authority to be arranged for the combination of the attribute and the type of the area, the registration possibility determination stage for determining whether the AR content can be registered in the area and the registration possibility determination stage.
When it is determined that registration is possible in the registration possibility determination stage, the content registration stage in which the AR content is registered in the area and the content registration stage.
The AR content and the display instruction are transmitted to the spectacle-type device so that the AR content registered in the content registration stage is displayed on the spectacle-type device for an area included in the field of view of the spectacle-type device. It has a display control stage and
The attributes include at least one of public, private, commercial, and infrastructure.
The type is a display control method including at least one of a building exterior, a building interior, stairs, a traffic light, a park, a road, and a sidewalk .

Images