JP7274451B2 - System, management device, program, and management method - Google Patents

Description

The present invention relates to a system, management device, program, and management method.

In Patent Document 1, a plurality of objects are grouped, and distribution display is performed to display an area in which the grouped objects are distributed. It is described that a drawing process is executed for each of the . Japanese Patent Laid-Open No. 2002-200000 describes that when virtual objects such as speech balloons overlap each other, the virtual objects can be drawn closer to each other so that the virtual objects can be easily seen by the user.
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP 2016-218981 [Patent Document 2] JP 2017-027206

According to one embodiment of the invention, a system is provided. The system may comprise an eyeglass device. The system may comprise a management device. The management device may have a content storage unit that stores content associated with real-world areas. For each of a plurality of contents corresponding to an area included within an imaging range of the spectacle-type device, the management apparatus provides content-related information related to the content, surrounding conditions of the spectacle-type device, and user wearing the spectacle-type device. It may have a priority determining unit that determines priority based on user-related information regarding. The management device may have a content transmission unit that transmits a plurality of contents and respective priorities of the plurality of contents to the glasses-type device. The glasses-type device may have a display control section that controls display of a plurality of contents on the display section according to the priority of each of the plurality of contents.

The priority determination unit may calculate a score of the content based on the content-related information, the surrounding situation, and the user-related information, and determine a higher priority as the score is higher. The priority determination unit includes a type score related to the content type of the content, a time score related to time information related to the content, a peripheral situation score related to the peripheral situation, a hobby and taste score related to the user's taste and preference, and the above A score for the content may be calculated by summing a recency score for the recency of the content and a rating score for the rating of the content and the rating of the distributor of the content. The priority determination unit may calculate, as the type score, a score reflecting weighting on a score corresponding to the content type of the content. When the content type of the content is an advertisement, the priority determining unit assigns a score corresponding to the content type of the content with a higher weighting as the advertising fee of the advertisement increases as the type score. can be calculated. When the content type of the content is an advertisement for a store, the priority determination unit calculates the time score that is higher as the degree of matching between the opening time of the store and the current time indicated by the surrounding situation is higher. good. The priority determination unit may calculate the surrounding situation score that increases as the degree of matching between the age targeted by the content and the age of the person around the glasses-type device indicated by the surrounding situation increases. When the content type of the content matches the taste and preference of the user included in the user-related information, the priority determining unit may calculate a higher taste and preference score than when the content type does not match.

The display control unit may perform control to arrange and display the content with the lower priority at a position corresponding to the farther side of the space in the real world. The display control unit may perform control to display only a predetermined number of contents in descending order of priority among the plurality of contents. The display control unit may perform control to display only content having a priority value higher than a predetermined value among the plurality of contents. The glasses-type device may have a plurality of applications for displaying the content, and the display control unit displays only the content corresponding to the application selected from the plurality of applications from among the plurality of contents. You may control to display. The display control unit may perform control to display only content corresponding to a layer selected from a plurality of layers among the plurality of contents. The display control unit may control to arrange and display a plurality of contents having the same priority so that the farther the corresponding area is from the glasses-type device, the less conspicuous the contents are. When the plurality of contents are arranged according to the priority, the display control unit shifts the positions of the plurality of contents and displays them when an overlapping rate of the plurality of contents is higher than a predetermined threshold. may be controlled to The display control unit may perform control so that the positions of the plurality of contents are shifted and displayed according to the density and area of the space in the real world within the imaging range of the glasses-type device. When the overlap rate of the plurality of contents is lower than the predetermined threshold value, the display control unit adjusts the transmittance of the content, among the plurality of contents, to which the user's line of sight is not directed. It may be controlled to be higher than the transmittance of the content to which the line of sight is directed. When the plurality of contents are arranged according to the priority, the display control unit may perform control so that the plurality of contents that overlap each other are displayed in an alternate manner at predetermined time intervals. When the plurality of contents are arranged according to the priority, the display control unit detects that the line of sight of the user has been directed to the plurality of contents that overlap each other continuously for a predetermined time or longer. Accordingly, the plurality of contents may be displayed so as not to overlap each other, and the display may be controlled to return to the overlapping state when the user's line of sight moves away from the plurality of contents. After displaying the plurality of contents in accordance with the priority, the display control unit causes the content designated by the user among the plurality of contents to be displayed at hand of the user, and selected by the user. You may control to hide the content that is displayed.

According to one embodiment of the invention, a management device is provided. The management device may include a content storage unit that stores content associated with real-world areas. For each of a plurality of contents corresponding to an area included within an imaging range of the spectacle-type device, the management apparatus provides content-related information related to the content, surrounding conditions of the spectacle-type device, and user wearing the spectacle-type device. A priority determination unit may be provided for determining priority based on user-related information relating to. The management device may include a content transmission unit that transmits a plurality of contents and respective priorities of the plurality of contents to the glasses-type device.

According to one embodiment of the present invention, there is provided a program for causing a computer to function as the management device.

According to one embodiment of the present invention, a computer-implemented management method is provided. The management method may comprise a content storage step of storing content associated with real-world areas. The management method includes, for each of a plurality of contents corresponding to an area included within an imaging range of the spectacle-type device, content-related information related to the content, the surrounding situation of the spectacle-type device, and the user wearing the spectacle-type device. may comprise a prioritization stage of determining a priority based on user-related information about the. The management method may comprise a content transmission stage of transmitting the plurality of contents and respective priorities of the plurality of contents to the glasses-type device.

According to a third aspect of the present invention, there is provided a program for causing a computer to function as the display control system.

It should be noted that the above summary of the invention does not list all the necessary features of the invention. Subcombinations of these feature groups can also be inventions.

An example system 10 is shown schematically. An example of the configuration of the spectacles-type device 100 is shown schematically. 4 schematically shows an example of display by the spectacles-type device 100. FIG. An example of the priority determination table 502 is shown schematically. An example of an application table 504 showing correspondence between applications and contents is shown schematically. An example of the positional relationship between the spectacles-type device 100 and a store 510, which is an example of an area corresponding to the content 400, is schematically shown. FIG. 10 is an explanatory diagram for explaining adjustment according to overlapping of contents by the glasses-type device 100; FIG. 10 is an explanatory diagram for explaining adjustment according to overlapping of contents by the glasses-type device 100; FIG. 10 is an explanatory diagram for explaining control when content 422, content 424, and content 426 overlap; FIG. 10 is an explanatory diagram for explaining how to shift and display a plurality of overlapping contents. FIG. 11 is an explanatory diagram for explaining adjustment of display positions of content 422, content 424, and content 426 by the glasses-type device 100; FIG. 11 is an explanatory diagram for explaining adjustment of display of content 400 by the glasses-type device 100; An example of a process flow in system 10 is shown schematically. An example of the functional configuration of the management server 300 is shown schematically. An example of the functional configuration of the control device 200 is shown schematically. An example of a hardware configuration of a computer 1200 functioning as a control device 200 or a management server 300 is shown schematically.

As glasses-type devices such as AR (Augmented Reality) glasses become more popular in the future, content will overflow the space of the real world and will be displayed overlapping. There is a concern that the content in the foreground may become an obstacle, making it difficult to operate. The system 10 according to the present embodiment can, for example, change the display order of overlapping content, reduce overlap by reducing displayed content, change the size of content to reduce overlap, and display overlapping content. Provide the ability to adjust content for easier viewing and operation.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution of the invention.

FIG. 1 schematically illustrates an example system 10 . The system 10 includes a plurality of eyeglass-type devices 100 and a management server 300. FIG.

The spectacles-type device 100 may be any type of spectacles-type device that has a wireless communication function and a display function of displaying content on a display unit. The glasses-type device 100 may be AR glasses, for example.

Content may be in any data format. For example, the content is 3D CG (Computer Graphics) data. For example, the content is a still image. Also, for example, the content is a moving image. For example, the content is text. Content may include these in a composite manner.

The glasses-type device 100 may be a device capable of giving the user 102 the feeling that the content is arranged in real space by displaying the content on transparent or translucent glasses. That is, the spectacles-type device 100 may be a so-called transmissive (see-through) device. Note that the glasses-type device 100 may be a video pass-through type device. In this case, the spectacles-type device 100 may display a captured image of a range corresponding to the field of view of the user 102 on a non-transmissive display and superimpose the content.

The management server 300 manages content to be distributed to the glasses-type device 100 . The management server 300 may be an example of a management device. The management server 300, for example, registers contents in association with areas in the real world. Content registration may be performed by any person authorized by the administrator of the management server 300 or the like. The management server 300 may accept registration of content by smartphones, tablet terminals, PCs (Personal Computers), AR glasses, and the like.

For example, the management server 300 may receive imaging range information indicating the imaging range of the spectacles-type device 100 from the spectacles-type device 100, and transmit content corresponding to the area included in the imaging range to the spectacles-type device 100. . The imaging range of the spectacles-type device 100 may be the imaging range of the camera of the spectacles-type device 100 . The imaging range of the camera of the glasses-type device 100 may be a range corresponding to the field of view of the user 102 . The imaging range of the camera of the glasses-type device 100 may be a range wider than the field of view of the user 102 or substantially the same as the field of view of the user 102 .

The glasses-type device 100 and the management server 300 may communicate via the network 20 . Network 20 includes a cloud. Network 20 may include a mobile communication network. The mobile communication network conforms to any of the LTE (Long Term Evolution) communication method, 3G (3rd Generation) communication method, 5G (5th Generation) communication method, 6G (6th Generation) communication method and later communication methods. good. The network 20 may support the Wi-Fi (registered trademark) communication system. Network 20 may be accessible via a Wi-Fi access point. The network 20 may be accessible using other wireless communications in general. The management server 300 may be wired or wirelessly connected to the network 20 . The glasses-type device 100 may be connected to the network 20 by mobile communication, Wi-Fi communication, or other general wireless communication.

FIG. 2 schematically shows an example of the configuration of the spectacles-type device 100. As shown in FIG. The eyewear device 100 comprises a frame 110 having rims 112 and temples 118 . The spectacles-type device 100 includes a control device 200 that executes various controls in the spectacles-type device 100 .

The arrangement of the control device 200 in FIG. 2 is an example, and the control device 200 may be arranged at other positions on the frame 110 . For example, controller 200 may be located outside frame 110 . Also, for example, the controller 200 may be located within the temple 118 . As a specific example, the controller 200 may be located at the tip of the temple 118, ie, at the modulus. Control device 200 may include a battery. The control device 200 and the battery may be arranged at different positions on the frame 110 as separate bodies.

The glasses-type device 100 may have a camera 120 . The imaging range of the camera 120 may be a range corresponding to the field of view of the user 102 wearing the glasses-type device 100 . The arrangement of the cameras 120 in FIG. 2 is an example, and the cameras 120 may be arranged at other positions.

The eyewear device 100 may include sensors 122 . The sensor 122 may be a sensor for identifying the environment around the eyewear-type device 100 . Sensor 122 may include LiDAR (Light Detection and Ranging). Sensor 122 may include a ranging sensor. Although FIG. 2 illustrates the case where the sensor 122 is arranged on the bridge 114, the arrangement of the sensor 122 in FIG. 2 is an example, and the sensor 122 may be arranged at other positions.

The eyewear device 100 may include sensors 124 . The sensor 124 detects, for example, the line of sight of the user 102 who wears the spectacles-type device 100 . Sensor 124 detects the gaze of user 102 by, for example, imaging and monitoring the eyes of user 102 . The placement of the sensors 124 in FIG. 2 is an example, and the sensors 124 may be placed at other positions.

Glasses-type device 100 may include microphone 126 . The microphone 126 is placed at a position where it can pick up the speech of the user 102 who wears the spectacles-type device 100 . The placement of the microphone 126 in FIG. 2 is an example, and the microphone 126 may be placed at other positions.

The control device 200 may receive various inputs. The control device 200 may receive various inputs from the user 102 via an operation unit arranged at an arbitrary position on the spectacles-type device 100 . The control device 200 receives various inputs from the user 102 via an input unit such as a button arranged at an arbitrary position on the frame 110, for example. The control device 200 may receive various inputs from the user 102 via, for example, a mobile terminal such as a smart phone and a wearable terminal, a tablet terminal, a PC, or the like. The glasses-type device 100 may establish a wireless connection with them, for example, using short-range wireless communication schemes such as Wi-Fi, Bluetooth®, and Zigbee®.

Controller 200 may accept voice input by user 102 . The control device 200 may accept voice input by the user 102 by voice recognition of the user's 102 speech captured by the microphone 126 .

The control device 200 may accept input by hand movements of the user 102 . The control device 200 may accept input from the user 102 such as selection of content by recognizing the movement of the hand of the user 102 captured by the camera 120 . The control device 200 may accept gesture input by the user 102 .

The control device 200 may include various sensors. The control device 200 includes, for example, a positioning sensor. For example, the control device 200 includes a GNSS (Global Navigation Satellite System) sensor such as a GPS (Global Positioning System) sensor. Control device 200 may include an acceleration sensor. The control device 200 may include a gyro sensor. Controller 200 may include other sensors.

The control device 200 may generate imaging range information indicating the imaging range of the camera 120 . The control device 200 may generate imaging range information based on the position, orientation, and orientation of the glasses-type device 100 . The control device 200 may identify the position, orientation, and orientation of the spectacles-type device 100 based on the outputs of various sensors.

The control device 200 may have a display function on the lens 116 . The lenses 116 may be an example of the display section of the spectacles-type device 100 . Lens 116 may be a transparent or translucent display, and controller 200 may cause lens 116 to perform various displays. That is, the glasses-type device 100 may be a transparent or translucent display-type device. Also, the control device 200 may have a function of projecting a display onto the lens 116 . That is, the glasses-type device 100 may be a projection-type device.

The control device 200 may have the function of performing communication via the network 20 . Controller 200 may access network 20 via mobile communications, Wi-Fi communications, and/or other wireless communications in general. The control device 200 may communicate with the management server 300 via the network 20 .

FIG. 3 schematically shows a display example by the spectacles-type device 100. As shown in FIG. FIG. 3 shows a display example when the glasses-type device 100 displays a plurality of contents 400 received from the management server 300 without any care. As shown in FIG. 3, when a large number of contents 400 are received, if all of them are simply displayed, the contents 400 overlap each other and the visibility and operability of the contents 400 deteriorate.

The system 10 according to this embodiment provides a solution method for solving such problems. For example, the management server 300 provides a solution. Also, for example, the glasses-type device 100 provides a solution. Also, for example, the management server 300 and the spectacles-type device 100 cooperate to provide a solution method.

The management server 300, for example, sets a score for the content and changes the display order of the content according to the score. When there are a plurality of contents corresponding to an area included in the imaging range indicated by the imaging range information received from the glasses-type device 100, the management server 300 determines the plurality of priority elements for each of the plurality of contents. A score may be calculated. The management server 300 then determines the display order of the plurality of contents based on the scores. The management server 300 calculates the score of the content, for example, by Equation 1 below.

aw is the weighting of priority element a, bw is the weighting of priority element b, and xw is the weighting of priority element x.

The management server 300 may also calculate the score in consideration of user settings. The management server 300 calculates the score of the content, for example, by Equation 2 below.

where au is the user setting for priority element a, bu is the user setting for priority element b, and xu is the user setting for priority element x.

FIG. 4 schematically shows an example of the priority determination table 502. As shown in FIG. The priority determination table 502 shows an example of score calculation for one content. Based on the content-related information that is information related to the content, the surrounding situation of the glasses-type device 100 to which the content is distributed, and the user-related information related to the user 102 of the glasses-type device 100, the glasses-type device 100 A score for the content may be calculated.

FIG. 4 exemplifies content type, open time/usage rate, passers-by/surrounding situation, user tastes and preferences, new arrival/latest order, and content/distributor evaluation as priority elements. A priority element may contain none of these or others.

Here, an example will be described in which the content for which the score is to be calculated is content related to an advertisement for a coffee shop. The content-related information of content may be set by the content distributor. In this example, the content type is "Advertisement/Coffee", the opening time is "9:00 to 18:00", the usage rate peak is "15:00", the delivery date is "August (latest)", and the target is "20s to 30s". A case where is set will be described as an example.

In addition, the situation around the spectacles-type device 100 to which the content is to be distributed is the current time "11:00", passers-by around the area "many in their 40s and 50s", the distributor evaluation "◯", and the content evaluation "◯". ". Also, it is assumed that the user-related information is age "40's", hobbies and tastes "coffee lover", and plan "advertisement non-display plan".

The points for content types may differ for each type. For example, public information: 40pt, guide: 30pt, advertisement: 20pt, review: 10pt, entertainment: 5pt, general layout: 1pt, and the like. Note that the points for each type may be arbitrarily set or changed by the administrator of the management server 300 or the like.

The weighting of content types may be set for each type. For example, if the content type is advertising, different weightings may be set according to advertising rates. Specifically, the higher the advertising fee, the higher the weighting.

An open time/utilization rate point may be arbitrarily set as a reference point. In the example shown in FIG. 4, 10 points are set. For the open time/utilization rate weighting, for example, a higher value is set as the degree of matching between the open time and the current time is higher. As for the open time/utilization rate weighting, the highest weighting may be set when the current time coincides with the utilization peak.

A passerby/circumstance point may be arbitrarily set as a reference point. In the example shown in FIG. 4, 10 points are set. For the weighting of the passerby/peripheral situation, for example, a higher value is set as the degree of matching between the target of the content information and the age of the passerby in the surrounding situation is higher.

The points of the user's hobbies and tastes may be arbitrarily set as reference points. In the example shown in FIG. 4, 10 points are set. For the weighting of the user's tastes and preferences, for example, a higher value is set as the degree of association between the content type and the tastes and preferences of the user-related information is higher. Further, for example, the weighting of the user's hobbies and preferences is set to a higher value as the degree of matching between the content type and the search history of the user 102, the viewing history of the content of the user 102, etc. is higher. The user's preference weighting may be a value manually set in advance by the user 102 .

The new/latest order points may be arbitrarily set as reference points. In the example shown in FIG. 4, 10 points are set. For the new arrival/newest order weighting, for example, the newer the distribution date of the content, the higher the value is set.

Content/distributor evaluation points may be arbitrarily set as reference points. In the example shown in FIG. 4, 10 points are set. For the weighting of the content/distributor evaluation, for example, the higher the evaluation of the content, the higher the value is set. For the weighting of the content/distributor evaluation, for example, a higher value is set as the evaluation of the distributor is higher.

User settings may be set by a user or based on user-related information. The example shown in FIG. 4 illustrates a case where the user setting is set based on the plan of the user-related information. In this example, the user 102 has subscribed to a no-ads plan. In this case, if the content type is advertisement, 0 is set as the user setting except for the user's hobbies and preferences. If the user's tastes and preferences do not match the content type, 0 is similarly set as the user setting, and if they match the content type, a value other than 0 is set as the user setting. . In the example shown in FIG. 4, 10 is set. As a result, even in the case of the advertisement non-display plan, it is possible to display advertisement contents that match the user's tastes and preferences.

The management server 300 may determine the display order of the plurality of contents based on the scores, and notify the glasses-type device 100 of the display order. The glasses-type device 100 may display a plurality of contents in the display order notified from the management server 300 . The glasses-type device 100 may arrange and display the contents in order from the near side to the far side according to the display order notified from the management server 300 .

The glasses-type device 100 may hide some of the multiple contents received from the management server 300 according to the score. For example, the glasses-type device 100 displays only a predetermined number of contents with high scores. As a specific example, the glasses-type device 100 displays only the content with the first and second scores. It may be possible for the user 102 to set up how many higher ranks are displayed. Also, for example, the glasses-type device 100 displays only content whose score is higher than a predetermined threshold. As a specific example, the glasses-type device 100 displays only content with a score of 100pt or higher. The score threshold may be configurable by the user 102 .

The glasses-type device 100 has a function of reducing the number of contents to be displayed among the plurality of contents received from the management server 300, changing the display size of the contents, and improving the visibility and operability of the contents. may be provided. The glasses-type device 100 has, for example, multiple applications for displaying content. Then, the glasses-type device 100 may display only the content corresponding to the application among the multiple pieces of content received from the management server 300 .

FIG. 5 schematically shows an example of an application table 504 indicating the correspondence between applications and content. In the example shown in FIG. 5, public information, guidance, and advertisements are associated with application A whose type is "life", and entertainment and advertisements are associated with application B whose type is "game." are mapped.

For example, the user 102 executes the application A when he/she wants to display public information, guidance, and advertisement contents, and executes the application B when he/she wants to display entertainment and advertisement contents. The glasses-type device 100 may execute multiple applications in accordance with instructions from the user 102 .

In addition, although the example which changed the content displayed for every application was mentioned and demonstrated here, it does not restrict to this. The glasses-type device 100 may change the content to be displayed for each layer. Examples of layers include an advertisement layer, a review layer, an entertainment layer, and the like. The glasses-type device 100 may display only the content corresponding to the layer selected by the user 102 from among the multiple pieces of content received from the management server 300 . By switching layers or selecting a plurality of layers, the user 102 can change the content to be displayed and prevent overlapping of the content.

Also, the displayed content may change for each platform used by the user 102 . For example, if a platform specializing in daily life is selected, only public information, guides, and advertisements related to daily life will be displayed, and if a platform specializing in entertainment is selected, entertainment-related entertainment will be displayed. And it may be configured so that only the content of the advertisement is displayed.

It should be noted that urgent information about suspicious persons in the vicinity and contents for notifying disasters such as earthquakes may be controlled so as to be preferentially displayed regardless of the application, layer, and platform. Likewise, content such as general-purpose clocks and email notifications may be controlled to be displayed regardless of the application, layer, and platform.

FIG. 6 schematically shows an example of the positional relationship between the glasses-type device 100 and a store 510, which is an example of an area to which the content 400 corresponds. The spectacles-type device 100 arranges and displays a plurality of contents having the same priority among the plurality of contents received from the management server 300 so that the farther the corresponding area is from the spectacles-type device 100, the more inconspicuous it is. You can control it.

The spectacles-type device 100 may reduce the size of the content 400 that is farther from the spectacles-type device 100, for example. Also, the spectacles-type device 100 may, for example, display content 400 farther from the spectacles-type device 100 as a simple display.

In the example shown in FIG. 6, the spectacles-type device 100 displays the content 400 whose corresponding area is located within a range of several meters from the spectacles-type device 100 in a smaller size according to the distance. The content 400 in which the corresponding area is located within the range is iconized. As a result, by reducing the display size of the other content 400 without changing the display of the content 400 that should be presented to the user 102 with higher priority, it is possible to appropriately reduce overlap between the content 400. .

The glasses-type device 100 may adjust the display position, transmittance, and the like of a plurality of pieces of content received from the management server 300, thereby improving the visibility and operability of the content.

FIGS. 7 and 8 are explanatory diagrams for explaining adjustment according to content overlap by the glasses-type device 100. FIG. When a plurality of contents are arranged according to priority, the glasses-type device 100 shifts the position of the plurality of contents and displays them when the overlap rate of the plurality of contents is higher than a predetermined threshold. If low, the transmittance of the content that the user's 102 gaze is directed at may be higher than the content that the user's gaze is not directed toward.

FIG. 7 exemplifies a case where the overlapping rate of content 412 and content 414 is higher than a predetermined threshold. The glasses-type device 100 may change the position of at least one of the content 412 and the content 414 so that the content 412 and the content 414 do not overlap. The glasses-type device 100 may further iconify at least one of the content 412 and the content 414 . Moreover, the glasses-type device 100 may further change the transmittance of at least one of the content 412 and the content 414 .

FIG. 8 exemplifies a case where the overlapping rate of content 412 and content 414 is lower than a predetermined threshold. As shown in FIG. 7, it is difficult to determine whether the user 102 is viewing the content 412 or the content 414 when the overlap rate is high. On the other hand, as shown in FIG. 7, when the overlap rate is low, the target to which the user 102 is directing his or her line of sight can be identified to some extent.

Therefore, the glasses-type device 100 may control the transmittance of content to which the user's 102 line of sight is not directed to be higher than the transmittance of content to which the user's 102 line of sight is directed. FIG. 8 illustrates a case where the user 102 is directed to the content 414 and the glasses-type device 100 makes the content 412 higher in transmittance than the content 414 . When the line of sight of the user 102 is directed toward the content 412 , the glasses-type device 100 may make the transmittance of the content 414 higher than the transmittance of the content 412 . Thereby, the visibility of the content to which the user's 102 line of sight is directed can be improved.

FIG. 9 is an explanatory diagram for explaining control when content 422, content 424, and content 426 overlap. When the glasses-type device 100 arranges a plurality of contents according to the priority and determines that there is overlapping content, the glasses-type device 100 switches and displays the overlapping contents at predetermined time intervals. may be controlled.

As shown in FIG. 9, the glasses-type device 100 may display content 422, content 424, and content 426 by rotating them at regular intervals. Thereby, each of the content 422, the content 424, and the content 426 can be alternately placed in the foreground, and the user 102 can check the content 422, the content 424, and the content 426 in order.

FIG. 10 is an explanatory diagram for explaining how to shift and display a plurality of overlapping contents. The spectacles-type device 100 may be controlled to shift and display a plurality of pieces of content according to the density and area of the space in the real world within the imaging range of the spectacles-type device 100 .

The density of the real-world space may be, for example, the density of people in the real-world space. Also, the density of the space in the real world may be, for example, the density of moving objects in the space in the real world.

The area of the space in the real world may be the size of the area that is not covered by the shield. For example, places such as parks where there are few obstructions such as buildings have a large area in the real world, is narrow.

As shown in FIG. 10 , the spectacles-type device 100 has a low density of space in which the spectacles-type device 100 is located, and when the area is large, the overlapped content is displayed in the field of view of the user 102 (image of the spectacles-type device 100). range) can be moved to an open area. In addition, when the density of the space where the spectacles-type device 100 is located is low and the area is small, the spectacles-type device 100 does not block the view of the user 102 (imaging range of the spectacles-type device 100) with the overlapping contents. You can move to a position.

Further, when the space in which the spectacles-type device 100 is located has a high density and a large area, the spectacles-type device 100 may move the overlapping contents to an empty space. The glasses-type device 100 may further display content as icons. Further, when the space in which the spectacle-type device 100 is located has a high density and a small area, the spectacle-type device 100 may move to a position that does not block the field of view of the user 102 (imaging range of the spectacle-type device 100). The glasses-type device 100 may further display content as icons.

FIG. 11 is an explanatory diagram for explaining adjustment of display positions of the content 422, the content 424, and the content 426 by the glasses-type device 100. FIG. When a plurality of pieces of content are arranged according to priority, the glasses-type device 100 continues to allow the user 102 to access the plurality of pieces of content for a predetermined time or more. When the line of sight of the user 102 is directed, the plurality of contents are displayed so as not to overlap each other, and when the line of sight of the user 102 deviates from the plurality of contents, the display is returned to the overlapping state. You can control it.

As illustrated in FIG. 11 , the spectacles-type device 100 displays the content 422, content 424, and content 426 overlapping each other in response to the user 102's line of sight continuing for a predetermined time or longer. The content 424 and content 426 may be displayed so as not to overlap. Further, the glasses-type device 100 may control the display to return to the original overlapping state in response to the user 102's line of sight moving away from the content 422 , the content 424 , and the content 426 .

FIG. 12 is an explanatory diagram for explaining display adjustment of the content 400 by the glasses-type device 100. As shown in FIG. The spectacles-type device 100 may display the content 400 within the specified range at hand of the user 102 when the specification of the content 400 being displayed is received by the user 102 's gesture or the like. Then, the glasses-type device 100 may control to hide the content 400 selected by the user 102 from among the content 400 displayed at hand.

For example, as shown in FIG. 12, the spectacles-type device 100 displays the content 400 within the specified range and a trash can icon 430 at the user's hand, and the user 102 moves the content 400 to the trash can icon 430. In this case, the content 400 is set to non-display. When the user 102 changes the line of sight from the hand to the front, the content 400 set to be hidden is not displayed, and only the other content 400 is displayed. By adopting the configuration as described above, the user 102 can easily specify the content 400 to be hidden.

FIG. 13 schematically shows an example of a process flow in system 10. As shown in FIG. Here, a flow of processing in which one glasses-type device 100 receives a plurality of contents from the management server 300 and adjusts display will be described. Steps (steps may be abbreviated as S) 102, S112, S114, S120, and S122 relate to a method for preventing content overlap, and S124 and S128 are processing/operations for making content easier to see. related to the method.

In S<b>102 , the control device 200 makes settings related to content display according to an instruction from the user 102 . The user 102, for example, makes settings related to the priority element. For example, user 102 sets user preferences for each priority element. Also, for example, the user 102 sets weighting for each priority element. The user 102 may set a desired layer when a configuration is adopted in which the content displayed for each layer is changed. The user 102 may set a desired platform, for example, when a configuration is adopted in which displayed content is changed for each platform.

In S<b>104 , the control device 200 detects the space around the glasses-type device 100 . The control device 200 may detect the space from the outputs of various sensors and generate imaging range information. The control device 200 transmits the generated imaging range information to the management server 300 .

In S<b>106 , the management server 300 collates the features of the space based on the imaging range information received from the control device 200 . The management server 300 may identify an area included in the imaging range of the spectacles-type device 100 .

In S108, the management server 300 refers to the content registered in the space. The management server 300 may refer to content registered in association with an area included in the imaging range of the spectacles-type device 100 .

In S110, the management server 300 detects overlapping of the multiple contents referred to in S108. In S112, the management server 300 performs score calculation by priority determination for a plurality of contents. The management server 300 rearranges the display order of the plurality of contents according to the calculated score. The management server 300 transmits the multiple contents, the display order, and the score of each of the multiple contents to the glasses-type device 100 .

In S114, the control device 200 receives the plurality of contents, the display order, and the score of each of the plurality of contents. In S116, the control device 200 executes processing based on the setting in S102. When a layer is selected in S102, the control device 200 identifies the content corresponding to the selected layer among the plurality of contents. When a platform is selected in S102, the control device 200 identifies content corresponding to the selected platform among the plurality of contents.

In S118, the control device 200 detects overlapping of the contents identified in S116. At this stage, if the control device 200 determines that there is no content overlap, the content may be displayed on the lens 116 without proceeding to S120 and beyond. Here, the explanation is continued assuming that there is an overlap.

At S120, the control device 200 extracts the content with the highest priority among the contents identified at S116. The control device 200 refers to the score of the content specified in S116, and extracts some content based on the score. The control device 200, for example, extracts content with a high score or content with a score higher than a predetermined threshold. If the control device 200 detects overlapping of the extracted contents and determines that there is no overlapping of the contents, the contents may be displayed on the lens 116 without proceeding to S122 and subsequent steps. Here, the explanation is continued assuming that there is an overlap.

At S122, the control device 200 executes a process according to the distance as described with reference to FIG. This causes some content to be reduced in size or iconified. After performing processing according to the distance, the control device 200 detects overlapping of the contents, and if it determines that there is no overlap of the contents, displays the contents on the lens 116 without proceeding to S124 and thereafter. good. Here, the explanation is continued assuming that there is an overlap.

In S124, the control device 200 performs adjustment based on the overlapping ratio of the content as described in FIGS. 7 and 8, rotation display as described in FIG. Make at least one of the adjustments. In S126, the control device 200 causes the lens 116 to display the content.

At S<b>128 , the control device 200 adjusts the content display according to the instruction of the user 102 . The control device 200 executes, for example, the gaze operation as described with reference to FIG. 11, the hand operation as described with reference to FIG. 12, layer and platform switching, application switching, and the like.

In this manner, the glasses-type device 100 and the management server 300 appropriately execute processing according to the overlapping state of the content, thereby making it possible to provide the user 102 with a plurality of content in an easy-to-see and easy-to-operate manner. can do.

FIG. 14 schematically shows an example of the functional configuration of the management server 300. As shown in FIG. The management server 300 includes a storage section 302 , a content registration section 304 , an information reception section 306 , a priority determination section 308 and a content transmission section 310 .

The content registration unit 304 receives and registers content registered by a content distributor for an area in the real world. The content registration unit 304 may store the content and the area to which the content corresponds in the storage unit 302 in association with the distributor ID of the content distributor. The storage unit 302 may be an example of a content storage unit.

The content registration unit 304 may register an evaluation for each of a plurality of contents. The content registration unit 304 acquires and registers, for example, the evaluation of the content by the user 102 who viewed the content. The content registration unit 304 may receive registration of evaluation of content by an administrator of the management server 300 or the like.

The content registration unit 304 may register evaluations for each of a plurality of content distributors. The content registration unit 304 registers, for example, the evaluation of the content distributor based on the evaluation of the content distributed by the content distributor. The content registration unit 304 may accept registration of evaluation of a content distributor by an administrator of the management server 300 or the like.

The information receiving unit 306 receives various types of information from the outside. The information receiving section 306 may store the received information in the storage section 302 .

The information receiving section 306 may receive various types of information from the glasses-type device 100 . For example, the information receiving unit 306 receives imaging range information from the glasses-type device 100 . Also, for example, the information receiving unit 306 receives information input by the user 102 from the glasses-type device 100 . The information receiving unit 306 receives, for example, the contents of gesture input, line-of-sight input, and voice input by the user 102 . Also, for example, the information receiving unit 306 receives information such as the position, orientation, and posture of the spectacle-type device 100 , the line of sight of the user 102 , and changes in these from the spectacle-type device 100 .

The priority determination unit 308 determines the priority of multiple contents to be distributed to the glasses-type device 100 . For each of a plurality of contents corresponding to areas included in the imaging range of the spectacles-type device 100, the priority determining unit 308 determines content-related information related to the content, the surrounding situation of the spectacles-type device 100 to be distributed, and the distribution target. The priority may be determined based on user-related information about the user 102 of the target eyeglass-type device 100 . The priority determining unit 308 calculates the score of the content based on, for example, the content-related information, the surrounding situation, and the user-related information, and determines a higher priority as the score is higher.

Content-related information may include a content type. Content related information may include time information related to the content. Time information may be any information that indicates the time associated with the content. For example, if the content type of the content is an advertisement for a store, the time information may indicate the opening time of the store or the peak hours of usage of the store. Content-related information may include information about the recency of the content. The information on recency indicates, for example, the delivery date of the content. Content-related information may include information indicating the target of the content. The information indicating the target may indicate the age of the person targeted by the content.

The surrounding conditions may include current time information. The surrounding situation may include information about people around the glasses-type device 100 . For example, the surrounding situation indicates the ages of people around the glasses-type device 100 . Surroundings may include content ratings. Surroundings may include the rating of the distributor who distributed the content.

User-related information may include the age of user 102 . The age of the user 102 may be a chronological age or a specific age. User-related information may include user's 102 hobbies and preferences. The user-related information may include information on plans that the user 102 has registered for services by the management server 300 .

For example, the priority determining unit 308 determines a type score related to the content type of the content, a time score related to time information related to the content, a peripheral situation score related to the surrounding situation, a hobby preference score related to the user's tastes and preferences, and a content newness score. A score for the content may be calculated by summing the recency score for the newness and the rating score for the content's rating and the content's distributor's rating.

The priority determination unit 308 may calculate, as the type score, a score reflecting weighting on the score corresponding to the content type of the content. For example, when the content type of the content is an advertisement, the priority determining unit 308 calculates a score corresponding to the content type of the content and a score reflecting a higher weighting as the advertising fee of the advertisement increases as the type score. good. When the content type of the content is an advertisement for a store, the priority determining unit 308 may calculate a higher time score as the degree of matching between the opening time of the store and the current time indicated by the surrounding situation is higher.

The priority determination unit 308 may calculate a surrounding situation score that is higher as the degree of matching between the age targeted by the content and the age of the person around the glasses-type device 100 indicated by the surrounding situation is higher. The priority determining unit 308 may calculate a higher interest/preference score when the content type of the content matches the user's preference included in the user-related information than when the content type does not match. For example, when the content type of the content matches the user's tastes and preferences included in the user-related information, the priority determination unit 308 sets the score reflecting the weighting manually set in advance by the user 102 to the taste. It may be calculated as a preference score.

The priority determining unit 308 may calculate a higher newness score for newer content. The priority determination unit 308 may calculate a higher evaluation score as the evaluation of the content is higher. The priority determining unit 308 may calculate a higher evaluation score as the evaluation of the content distributor is higher.

The content transmission unit 310 transmits to the glasses-type device 100 a plurality of contents corresponding to the area included in the imaging range of the glasses-type device 100 and the priority of the plurality of contents determined by the priority determination unit 308. do. The content transmission section 310 may determine the display order according to the priority of a plurality of contents, and transmit the display order to the glasses-type device 100 together. The content transmission section 310 may combine scores of a plurality of contents and transmit them to the glasses-type device 100 .

FIG. 15 schematically shows an example of the functional configuration of the control device 200. As shown in FIG. The control device 200 includes a storage section 202 , an information acquisition section 204 , a communication section 206 and a display control section 208 .

The information acquisition unit 204 acquires various types of information. The information acquisition section 204 may store the acquired information in the storage section 202 .

The information acquisition unit 204 acquires, from the camera 120, an image captured by the camera 120, for example. The information acquisition unit 204 acquires information output by various sensors, for example. The information acquisition unit 204 may acquire information output by the sensor 122 . The information acquisition unit 204 may acquire information output by the sensor 124 . The information acquisition unit 204 acquires line-of-sight information of the user 102 output by the sensor 124, for example.

The information acquisition unit 204 acquires the speech of the user 102 acquired by the microphone 126, for example. The information acquisition unit 204 may acquire the content of the utterance by recognizing the utterance of the user 102 acquired by the microphone 126 .

The information acquisition unit 204 may acquire various inputs from the user 102 . The information acquisition unit 204 may acquire input information input by the user 102 via the operation unit or mobile terminal. The information acquisition unit 204 may acquire the voice input content of the user 102 . The information acquisition unit 204 may acquire input information based on hand movements of the user 102 .

The information acquisition unit 204 may acquire information output by the positioning sensor. The information acquisition unit 204 may acquire information output by the acceleration sensor. The information acquisition unit 204 may acquire information output by the gyro sensor. The information acquisition unit 204 may acquire information output by other sensors.

The information acquisition unit 204 may generate imaging range information indicating the imaging range of the camera 120 . The information acquisition unit 204 may generate imaging range information based on the position, orientation, and orientation of the glasses-type device 100 . The information acquisition unit 204 may identify the position, orientation, and orientation of the spectacles-type device 100 based on outputs from various sensors.

A communication unit 206 communicates with the management server 300 . The communication unit 206 may communicate with the management server 300 via the network 20 . The communication unit 206 transmits various information acquired by the information acquisition unit 204 to the management server 300, for example.

For example, the communication unit 206 transmits the imaging range information to the management server 300 and receives from the management server 300 the content corresponding to the area within the imaging range indicated by the imaging range information. The communication unit 206 may receive from the management server 300 a plurality of contents and the priorities of the plurality of contents. The communication unit 206 may receive the display order of multiple pieces of content from the management server 300 . The communication unit 206 may receive scores of multiple contents from the management server 300 .

The display control unit 208 controls to display various information on the lens 116 . The display control unit 208 controls so that the content received by the communication unit 206 from the management server 300 is displayed on the lens 116 .

The display control unit 208 may control the plurality of contents received by the communication unit 206 to be displayed on the lens 116 according to the priority of each of the plurality of contents. The display control unit 208 displays a plurality of contents according to the display order received from the management server 300, for example. In addition, the display control unit 208 controls, for example, the content with the lower priority to be arranged and displayed at a position corresponding to the farther side of the space in the real world.

The display control unit 208 may control to display only a predetermined number of contents in descending order of priority among the plurality of contents corresponding to the area included in the imaging range. The predetermined number may be configurable by user 102 and may be changeable.

Further, the display control unit 208 may perform control to display only content having a priority value higher than a predetermined value among the plurality of content corresponding to the area included in the imaging range. The predetermined value may be settable by the user 102 and may be changeable.

As a result, low-priority content can be hidden, visibility of high-priority content and high-relevance content to the user 102 can be enhanced, and operability of content can be enhanced.

The glasses-type device 100 may have multiple apps for displaying content. The storage unit 202 may store multiple applications. The display control unit 208 may perform control to display only the content corresponding to the application selected from the plurality of applications among the plurality of contents corresponding to the area included in the imaging range. The display control unit 208 may control to display only content corresponding to a layer selected from a plurality of layers among a plurality of contents corresponding to an area included within the imaging range. As a result, it is possible to display only the content that matches the intention of the user 102, thereby enhancing the visibility of the content and enhancing the operability of the content.

The display control unit 208 may control to arrange and display a plurality of contents having the same priority so that the farther the corresponding area is from the spectacles-type device 100, the more inconspicuous it is. For example, the display control unit 208 controls to display a plurality of contents in a smaller display size as the corresponding areas are farther from the spectacles-type device 100 . Further, the display control unit 208 controls, for example, to display a plurality of contents in a simpler manner as the corresponding areas are farther from the spectacles-type device 100 . An example of simple display is iconification.

When the plurality of contents corresponding to the area included in the imaging range are arranged according to the priority, the display control unit 208 determines whether the overlapping rate of the plurality of contents is higher or lower than a predetermined threshold. control may be exercised. The predetermined threshold may be configurable by user 102 and may be changeable.

For example, when arranging a plurality of contents corresponding to an area included in the imaging range according to the priority, the display control unit 208 determines that the overlapping rate of the plurality of contents is higher than a predetermined threshold value. You may control to shift and display the position of the some content. The display control unit 208 may perform control to shift and display the positions of a plurality of contents according to the density and area of the imaging range space of the spectacles-type device 100 .

For example, when the density of the space where the glasses-type device 100 is located is lower than a predetermined density threshold and the area is larger than a predetermined area threshold, the display control unit 208 displays the overlapping content to the user 102. Move to an open field of view. The density threshold and area threshold may be configurable by the user 102 and may be changeable. The open field of view of the user 102 may be, for example, a position where there are no people or obstructions.

In addition, for example, when the density of the space where the glasses-type device 100 is located is lower than the density threshold and the area is smaller than the area threshold, the display control unit 208 displays the overlapping content in a position that does not block the field of view of the user 102. You can move to A position that does not block the field of view of the user 102 may be, for example, a position that overlaps with an obstacle such as a building.

Further, when the density of the space where the glasses-type device 100 is located is higher than the density threshold and the area is larger than the area threshold, the display control section 208 may move the overlapping content to an empty space. The empty space may be, for example, a space with a low density of people or the like. The display control unit 208 may further display the content as an icon.

Further, when the density of the space where the spectacle-type device 100 is located is higher than the density threshold and the area is smaller than the area threshold, the display control section 208 may move the user 102 to a position where the field of vision is not obstructed. The display control unit 208 may further display the content as an icon.

When the overlap rate of the plurality of contents is lower than a predetermined threshold value, the display control unit 208 sets the transmittance of the content to which the line of sight of the user 102 is not directed among the plurality of contents. It may be controlled to be higher than the transparency of the content to which it is directed.

When the plurality of contents corresponding to the areas included in the imaging range are arranged according to the priority, the display control unit 208 switches and displays the overlapping contents every predetermined time. may be controlled.

When the plurality of contents corresponding to the areas included in the imaging range are arranged according to the priority, the display control unit 208 continuously displays the overlapping contents for the user 102 for a predetermined time or longer. When the line of sight of the user 102 is directed, the plurality of contents are displayed so as not to overlap each other, and when the line of sight of the user 102 deviates from the plurality of contents, the display is returned to the overlapping state. may be controlled.

The display control unit 208 displays the plurality of contents corresponding to the area included in the imaging range in accordance with the priority, and then displays the content specified by the user 102 among the plurality of contents to the hand of the user 102. It may be controlled to display and hide content selected by the user 102 .

FIG. 16 schematically shows an example of a hardware configuration of a computer 1200 functioning as the control device 200 or management server 300. As shown in FIG. Programs installed on the computer 1200 cause the computer 1200 to function as one or more "parts" of the apparatus of the present embodiments, or cause the computer 1200 to operate or perform operations associated with the apparatus of the present invention. Multiple "units" can be executed and/or the computer 1200 can be caused to execute the process or steps of the process according to the present invention. Such programs may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

Computer 1200 according to this embodiment includes CPU 1212 , RAM 1214 , and graphics controller 1216 , which are interconnected by host controller 1210 . Computer 1200 also includes input/output units such as communication interface 1222 , storage device 1224 , and IC card drives, which are connected to host controller 1210 via input/output controller 1220 . Storage devices 1224 may be hard disk drives, solid state drives, and the like. Computer 1200 also includes input/output units such as ROM 1230 and keyboard or touch panel, which are connected to input/output controller 1220 via input/output chip 1240 .

The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. Graphics controller 1216 retrieves image data generated by CPU 1212 into a frame buffer or the like provided in RAM 1214 or itself, and causes the image data to be displayed on display device 1218 .

Communication interface 1222 communicates with other electronic devices over a network. Storage device 1224 stores programs and data used by CPU 1212 within computer 1200 . The IC card drive reads programs and data from IC cards and/or writes programs and data to IC cards.

ROM 1230 stores therein programs that are dependent on the hardware of computer 1200, such as a boot program that is executed by computer 1200 upon activation. Input/output chip 1240 may also connect various input/output units to input/output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, and the like.

A program may be provided by a computer-readable storage medium such as an IC card. The program is read from a computer-readable storage medium, installed in storage device 1224 , RAM 1214 , or ROM 1230 , which are also examples of computer-readable storage media, and executed by CPU 1212 . The information processing described within these programs is read by computer 1200 to provide coordination between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing information operations or processing according to the use of computer 1200 .

For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded into the RAM 1214 and sends communication processing to the communication interface 1222 based on the processing described in the communication program. you can command. Under the control of the CPU 1212, the communication interface 1222 reads the transmission data stored in the transmission buffer area provided in the RAM 1214, the storage device 1224, or a recording medium such as an IC card, and transmits the read transmission data to the network. Received data transmitted or received from a network is written in a receive buffer area or the like provided on a recording medium.

The CPU 1212 also causes the RAM 1214 to read all or necessary portions of files or databases stored in an external recording medium such as a storage device 1224 or an IC card, and performs various types of processing on the data on the RAM 1214. may be executed. CPU 1212 may then write back the processed data to an external recording medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored on recording media and subjected to information processing. CPU 1212 performs various types of operations on data read from RAM 1214, information processing, conditional decisions, conditional branching, unconditional branching, and information retrieval, which are described throughout this disclosure and are specified by instruction sequences of programs. Various types of processing may be performed, including /replace, etc., and the results written back to RAM 1214 . In addition, the CPU 1212 may search for information in a file in a recording medium, a database, or the like. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 selects the first attribute from among the plurality of entries. search for an entry that matches the specified condition of the attribute value of the attribute, read the attribute value of the second attribute stored in the entry, and thereby determine the first attribute that satisfies the predetermined condition An attribute value of the associated second attribute may be obtained.

The programs or software modules described above may be stored in a computer-readable storage medium on or near computer 1200 . Also, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. offer.

The blocks in the flowcharts and block diagrams in this embodiment may represent steps in the process in which the operations are performed or "parts" of the apparatus responsible for performing the operations. Certain steps and "sections" may be provided with dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and/or computer readable instructions provided with computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor. Dedicated circuitry may include digital and/or analog hardware circuitry, and may include integrated circuits (ICs) and/or discrete circuitry. Programmable circuits, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), etc., perform AND, OR, EXCLUSIVE OR, NOT AND, NOT OR, and other logical operations. , flip-flops, registers, and memory elements.

A computer-readable storage medium may comprise any tangible device capable of storing instructions to be executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon may be illustrated in flowchart or block diagram form. It will comprise an article of manufacture containing instructions that can be executed to create means for performing specified operations. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory) , electrically erasable programmable read only memory (EEPROM), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick , integrated circuit cards, and the like.

The computer readable instructions may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state configuration data, or instructions such as Smalltalk, JAVA, C++, etc. any source or object code written in any combination of one or more programming languages, including object-oriented programming languages, and conventional procedural programming languages such as the "C" programming language or similar programming languages; may include

Computer readable instructions are used to produce means for a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuits to perform the operations specified in the flowchart or block diagrams. A general purpose computer, special purpose computer, or other programmable data processor, locally or over a wide area network (WAN) such as the Internet, etc., to execute such computer readable instructions. It may be provided in the processor of the device or in a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various modifications or improvements can be made to the above embodiments. It is clear from the description of the scope of the claims that forms with such modifications or improvements can also be included in the technical scope of the present invention.

The execution order of each process such as actions, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, the specification, and the drawings is etc., and it should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the specification, and the drawings, even if the description is made using "first," "next," etc. for convenience, it means that it is essential to carry out in this order. not a thing

10 system, 20 network, 100 glasses-type device, 102 user, 110 frame, 112 rim, 114 bridge, 116 lens, 118 temple, 120 camera, 122 sensor, 124 sensor, 126 microphone, 200 control device, 202 storage unit, 204 Information acquisition unit 206 communication unit 208 display control unit 300 management server 302 storage unit 304 content registration unit 306 information reception unit 308 priority determination unit 310 content transmission unit 400 content 412 content 414 content , 422 content, 424 content, 426 content, 430 trash can icon, 502 priority determination table, 510 store, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input/output controller, 1222 Communication interface, 1224 storage device, 1230 ROM, 1240 input/output chip

Claims (25)

an eyeglass device;
with a management device and
The management device
a content storage unit that stores content associated with real-world areas;
For each of the plurality of contents corresponding to the area included in the imaging range of the spectacles-type device, the content-related information related to the contents, the peripheral situation of the spectacles-type device, and the spectacles-type device are worn. a priority determination unit that determines priority based on user-related information about the user;
a content transmission unit configured to transmit the plurality of contents and respective priorities of the plurality of contents to the spectacles-type device;
The spectacles-type device is
a display control unit that controls to display the plurality of contents on a display unit according to the priority of each of the plurality of contents;
When the plurality of contents are arranged according to the priority, the display control unit shifts the positions of the plurality of contents and displays them when an overlapping rate of the plurality of contents is higher than a predetermined threshold value. and, when the overlapping rate of the plurality of contents is lower than the predetermined threshold, the transmittance of the content to which the user's line of sight is not directed, among the plurality of contents, is adjusted to the line of sight of the user. A system that controls the transparency of the content to which it is directed . 2. The priority determining unit according to claim 1, wherein the priority determination unit calculates a score of the content based on the content-related information, the surrounding situation, and the user-related information, and determines a higher priority as the score is higher. system. The priority determination unit includes a type score related to the content type of the content, a time score related to time information related to the content, a peripheral situation score related to the peripheral situation, a hobby preference score related to the user's hobby preference, and the 3. The system of claim 2 , wherein the score for the content is calculated by summing a recency score for the recency of the content and a rating score for the rating of the content and the rating of the distributor of the content. 4. The system according to claim 3 , wherein said priority determination unit calculates, as said type score, a score reflecting weighting on a score corresponding to a content type of said content. When the content type of the content is an advertisement, the priority determination unit assigns a score corresponding to the content type of the content with a higher weighting as the advertising fee of the advertisement increases as the type score. 5. The system of claim 4 , calculating. When the content type of the content is an advertisement for a store, the priority determination unit calculates the time score that is higher as the degree of matching between the opening time of the store and the current time indicated by the surrounding situation is higher. 6. The system of claim 5 . 3. The priority determining unit calculates the peripheral situation score, which increases as the degree of matching between the age targeted by the content and the age of the person in the vicinity of the glasses-type device indicated by the peripheral situation increases. 7. The system of any one of 3-6 . 3. The priority determination unit, when the content type of the content matches the taste and preference of the user included in the user-related information, calculates the hobby and preference score higher than when the content type does not match. 8. The system according to any one of 3 to 7 . 9. The system according to any one of claims 3 to 8 , wherein said priority determination unit calculates said evaluation score higher as the evaluation of said content distributor is higher. an eyeglass device;
management device and
with
The management device
a content storage unit that stores content associated with real-world areas;
For each of the plurality of contents corresponding to the area included in the imaging range of the spectacles-type device, the content-related information related to the contents, the peripheral situation of the spectacles-type device, and the spectacles-type device are worn. a priority determination unit that determines priority based on user-related information about the user;
a content transmission unit configured to transmit the plurality of contents and respective priorities of the plurality of contents to the glasses-type device;
has
The spectacles-type device is
A display control unit that controls to display the plurality of contents on a display unit according to the priority of each of the plurality of contents.
has
When the plurality of contents are arranged according to the priority, the display control unit shifts the positions of the plurality of contents if an overlapping rate of the plurality of contents is higher than a predetermined threshold value, and A system for controlling display of a plurality of contents so as not to overlap each other by changing the position of at least one of the contents. an eyeglass device;
management device and
with
The management device
a content storage unit that stores content associated with real-world areas;
For each of the plurality of contents corresponding to the area included in the imaging range of the spectacles-type device, the content-related information related to the contents, the peripheral situation of the spectacles-type device, and the spectacles-type device are worn. a priority determination unit that determines priority based on user-related information about the user;
a content transmission unit configured to transmit the plurality of contents and respective priorities of the plurality of contents to the glasses-type device;
has
The spectacles-type device is
A display control unit that controls to display the plurality of contents on a display unit according to the priority of each of the plurality of contents.
has
When the plurality of contents are arranged according to the priority, the display control unit controls the density of the space where the glasses-type device is located when the overlapping rate of the plurality of contents is higher than a predetermined threshold value. is low and the area of the space is large, the overlapping content is moved to a wider area of the imaging range of the glasses-type device; is a system that shifts and displays the plurality of contents by moving the overlapping contents to a position that does not block the imaging range of the spectacles-type device. an eyeglass device;
with a management device and
The management device
a content storage unit that stores content associated with real-world areas;
For each of the plurality of contents corresponding to the area included in the imaging range of the spectacles-type device, the content-related information related to the contents, the peripheral situation of the spectacles-type device, and the spectacles-type device are worn. a priority determining unit that calculates a score of the content based on user-related information about the user, and determines a higher priority as the score is higher;
a content transmission unit configured to transmit the plurality of contents and respective priorities of the plurality of contents to the spectacles-type device;
The priority determination unit calculates the score of the content that is higher as the evaluation of the distributor of the content is higher,
The spectacles-type device is
A system, comprising: a display control section that controls to display the plurality of contents on a display section according to respective priorities of the plurality of contents. The priority determination unit includes a type score related to the content type of the content, a time score related to time information related to the content, a peripheral situation score related to the peripheral situation, a hobby preference score related to the user's hobby preference, and the 13. The system of claim 12, wherein the score for the content is calculated by summing a recency score for the recency of the content and a rating score for the rating of the content and the rating of the distributor of the content. 14. The display control unit according to any one of claims 1 to 13, wherein the display control unit performs control such that the content with the lower priority is arranged and displayed at a position corresponding to a deeper side of a space in the real world. system. 15. The system according to any one of claims 1 to 14, wherein said display control unit controls to display only a predetermined number of contents in descending order of said priority among said plurality of contents. 15. The system according to any one of claims 1 to 14, wherein said display control unit controls to display only content with said priority value higher than a predetermined value among said plurality of contents. . The spectacles-type device is
having a plurality of apps for displaying said content;
17. The system according to any one of claims 1 to 16, wherein said display control unit controls to display only content corresponding to an application selected from said plurality of applications among said plurality of contents. 17. The system according to any one of claims 1 to 16, wherein said display control unit controls to display only content corresponding to a layer selected from a plurality of layers among said plurality of contents. 19. The display control unit controls to arrange and display a plurality of contents having the same priority so that the farther the corresponding area is from the glasses-type device, the more inconspicuous it is. The system described in paragraph. 20. When the plurality of contents are arranged according to the priority, the display control unit performs control such that the plurality of contents that overlap each other are displayed in a switched manner at predetermined time intervals. A system according to any one of Claims 1 to 3. The display control unit detects that, when the plurality of contents are arranged according to the priority, the user's line of sight is continuously directed to the plurality of overlapping contents for a predetermined time or longer. according to claim 1 to 20, the plurality of contents are displayed so as not to overlap each other, and the display is controlled so as to return to the overlapping state in response to the line of sight of the user deviating from the plurality of contents. A system according to any one of Claims 1 to 3. After displaying the plurality of contents in accordance with the priority, the display control unit causes the content specified by the user among the plurality of contents to be displayed at hand of the user, and selected by the user. 22. The system according to any one of claims 1 to 21, wherein the system controls to hide the displayed content. a content storage unit that stores content associated with real-world areas;
For each of the plurality of contents corresponding to the areas included in the imaging range of the spectacle-type device, content-related information related to the content, the surrounding situation of the spectacle-type device, and the user wearing the spectacle-type device a priority determination unit that calculates the score of the content based on the user-related information related to and determines a higher priority as the score is higher;
a content transmission unit that transmits the plurality of contents and the priority of each of the plurality of contents to the glasses-type device,
The management device, wherein the priority determining unit calculates the score of the content that is higher as the evaluation of the distributor of the content is higher. A program for causing a computer to function as the management device according to claim 23. A computer-implemented management method comprising:
a content storage stage for storing content associated with real-world areas;
For each of the plurality of contents corresponding to the areas included in the imaging range of the spectacle-type device, content-related information related to the content, the surrounding situation of the spectacle-type device, and the user wearing the spectacle-type device a priority determination step of calculating the score of the content based on the user-related information related to and determining a higher priority as the score is higher;
a content transmission step of transmitting the plurality of contents and respective priorities of the plurality of contents to the glasses-type device;
The management method, wherein the priority determination step calculates the score of the content that is higher as the evaluation of the distributor of the content is higher.

Images