JP7133005B2 - Glasses-type device, program, and control method - Google Patents

Description

The present invention relates to an eyeglass-type device, program, and control method.

In Patent Document 1, an AR (Augmented Reality) device having a display unit capable of superimposing and displaying an AR virtual object on a landscape in a real space by displaying an image such as text or a diagram in a transparent or translucent state is disclosed. Reality) glasses are described.
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP-A-2019-114078

According to one embodiment of the invention, an eyeglass device is provided. The spectacles-type device may include a server communication unit that receives, from the content management server, content corresponding to an object that is included within an imaging range of the spectacles-type device and positioned within a predetermined distance from the spectacles-type device. The glasses-type device may comprise a storage unit for storing content received by the server communication unit. The spectacles-type device is included in the imaging range of the spectacles-type device, and a display control unit that reads content corresponding to an object positioned within a predetermined distance from the spectacles-type device and displays it on the display unit of the spectacles-type device. may be provided. When the target corresponding to the content displayed by the display control unit is out of the imaging range of the spectacles-type device, the spectacles-type device holds the content until a predetermined condition is satisfied. A deletion control unit may be provided that controls deletion of the content in response to the satisfaction of the conditions.

The server communication unit may receive, from the content management server, content corresponding to an area included within an imaging range of the spectacles-type device and located within a predetermined distance from the spectacles-type device. The unit holds the content until a predetermined condition is satisfied when the area corresponding to the content displayed by the display control unit is out of the imaging range of the spectacles-type device. is satisfied, the content may be deleted. The deletion control unit performs control to delete the content from the storage unit in response to a distance between the glasses-type device and an object corresponding to the content becoming longer than a predetermined distance threshold. good. The deletion control unit deletes the content from the storage unit in response to a distance between the glasses-type device and an object corresponding to the content becoming longer than a distance threshold corresponding to a content type of the content. may be controlled to The deletion control unit deletes the content in response to a distance between the spectacles-type device and a target corresponding to the content becoming longer than a distance threshold corresponding to a state of a user wearing the spectacles-type device. You may control to delete from the said storage part. In response to the fact that the distance between the glasses-type device and the target corresponding to the content becomes longer than a distance threshold as the moving speed of the user wearing the glasses-type device increases, Control may be performed to delete the content from the storage unit.

The deletion control unit deletes the content in response to a state in which an object corresponding to the content displayed by the display control unit has been out of an imaging range of the spectacles-type device for a predetermined time threshold. may be controlled to be deleted from the storage unit. The deletion control unit determines that a state in which an object corresponding to the content displayed by the display control unit is out of an imaging range of the glasses-type device continues for a time threshold corresponding to a content type of the content. Accordingly, the content may be controlled to be deleted from the storage unit. The deletion control unit determines that a state in which an object corresponding to the content displayed by the display control unit is out of an imaging range of the spectacles-type device is a time threshold value corresponding to a state of the user wearing the spectacles-type device. The content may be deleted from the storage unit according to the fact that the content has continued for a period of time. The deletion control unit determines that a state in which an object corresponding to the content displayed by the display control unit is out of an imaging range of the spectacles-type device becomes longer as a user wearing the spectacles-type device moves faster. The content may be controlled to be deleted in response to continuing for a time threshold. When the frequency of visits of the user of the glasses-type device to the target corresponding to the content displayed by the display control unit is higher than a predetermined visit threshold, the deletion control unit determines whether the predetermined condition is satisfied. You do not have to delete the above content even if it is deleted. When an object with a higher visit frequency than the visit threshold by the user is located in the imaging direction of the spectacles-type device, and content corresponding to the object is stored in the storage unit, The content may be displayed on the display unit. The server communication unit, when the content corresponding to the target visited by the user higher than the visit threshold stored in the storage unit is updated in the content management server, from the content management server: The updated content may be received and stored in the storage unit.

According to one embodiment of the present invention, there is provided a program for causing a computer to function as the control device.

According to one embodiment of the present invention, there is provided a control method performed by a computer onboard an eyeglass-type device. The control method may comprise receiving from a content management server content contained within an imaging range of the glasses-type device. The control method may comprise a storing step of storing the content received in the receiving step in storage of the computer. The control method may comprise a display control step of reading content included within an imaging range of the spectacles-type device from the storage unit and displaying it on the display unit of the spectacles-type device. In the control method, when the target corresponding to the content displayed in the display control stage is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. A deletion control stage may be provided to control the deletion of the content from the storage upon the satisfaction of the.

It should be noted that the above summary of the invention does not list all the necessary features of the invention. Subcombinations of these feature groups can also be inventions.

An example system 10 is shown schematically. An example of the configuration of the spectacles-type device 100 is shown schematically. 4 schematically shows an example of content display by the spectacles-type device 100. FIG. FIG. 10 is an explanatory diagram for explaining a holding distance of content by the glasses-type device 100; FIG. 10 is an explanatory diagram for explaining a holding distance of content by the glasses-type device 100; An example of a distance threshold table 500 is shown schematically. An example of a time threshold table 510 is shown schematically. An example of a time threshold table 520 is shown schematically. An example of a frequent location table 530 is shown schematically. An example of the functional configuration of the control device 200 is shown schematically. 1 schematically shows an example of a hardware configuration of a computer 1200 functioning as a control device 200. FIG.

A glasses-type device such as AR (Augmented Reality) glasses can receive and display content corresponding to an object within the field of view of a user who is the wearer, from a content management server. However, no method has been established for determining how long the content should be retained when the target is out of the user's field of vision. Repeatedly downloading content that matches your line of sight and deleting it when it's out of line of sight can strain your network and devices. The spectacles-type device 100 according to this embodiment provides a method of caching and holding distant content once out of sight.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution of the invention.

FIG. 1 schematically illustrates an example system 10 . The system 10 includes a plurality of glasses-type devices 100 and a content management server 300. FIG.

The spectacles-type device 100 may be any type of spectacles-type device that has a wireless communication function and a display function of displaying content on a display unit. The glasses-type device 100 may be AR glasses, for example.

Content may be in any data format. For example, the content is 3D CG (Computer Graphics) data. For example, the content is a still image. Also, for example, the content is a moving image. For example, the content is text. Content may include these in a composite manner.

The glasses-type device 100 may be a device capable of giving the user 102 the feeling that the content is arranged in real space by displaying the content on transparent or translucent glasses. That is, the spectacles-type device 100 may be a so-called transmissive (see-through) device. Note that the glasses-type device 100 may be a video pass-through type device. In this case, the spectacles-type device 100 may display a captured image of a range corresponding to the field of view of the user 102 on a non-transmissive display and superimpose the content.

The content management server 300 manages content to be distributed to the glasses-type device 100 . The content management server 300 registers content in association with real-world objects, for example. As a specific example, the content management server 300 registers content in association with each position in the real world. Also, for example, the content management server 300 registers content in association with an area in the real world. Content registration may be performed by any person authorized by the administrator of the content management server 300 or the like. The content management server 300 may accept registration of content by smartphones, tablet terminals, PCs (Personal Computers), AR glasses, and the like.

For example, the content management server 300 receives, from the spectacles-type device 100, imaging range information indicating the imaging range of the spectacles-type device 100, and transmits content corresponding to an object included in the imaging range to the spectacles-type device 100. good. The imaging range of the spectacles-type device 100 may be the imaging range of the camera of the spectacles-type device 100 . The imaging range of the camera of the glasses-type device 100 may be a range corresponding to the field of view of the user 102 . The imaging range of the camera of the glasses-type device 100 may be a range wider than the field of view of the user 102 or substantially the same as the field of view of the user 102 .

The glasses-type device 100 and the content management server 300 may communicate via the network 20 . Network 20 includes a cloud. Network 20 may include a mobile communication network. The mobile communication network conforms to any of the LTE (Long Term Evolution) communication method, 3G (3rd Generation) communication method, 5G (5th Generation) communication method, 6G (6th Generation) communication method and later communication methods. good. The network 20 may support the Wi-Fi (registered trademark) communication system. Network 20 may be accessible via a Wi-Fi access point. The network 20 may be accessible using other wireless communications in general. The content management server 300 may be wired or wirelessly connected to the network 20 . The glasses-type device 100 may be connected to the network 20 by mobile communication, Wi-Fi communication, or other general wireless communication.

FIG. 2 schematically shows an example of the configuration of the spectacles-type device 100. As shown in FIG. The eyewear device 100 comprises a frame 110 having rims 112 and temples 118 . The spectacles-type device 100 includes a control device 200 that executes various controls in the spectacles-type device 100 .

The arrangement of the control device 200 in FIG. 2 is an example, and the control device 200 may be arranged at other positions on the frame 110 . For example, controller 200 may be located outside frame 110 . Also, for example, the controller 200 may be located within the temple 118 . As a specific example, the controller 200 may be located at the tip of the temple 118, ie, at the modulus. Control device 200 may include a battery. The control device 200 and the battery may be arranged at different positions on the frame 110 as separate bodies.

The glasses-type device 100 may have a camera 120 . The imaging range of the camera 120 may be a range corresponding to the field of view of the user 102 wearing the glasses-type device 100 . The arrangement of the cameras 120 in FIG. 2 is an example, and the cameras 120 may be arranged at other positions.

The eyewear device 100 may include sensors 122 . The sensor 122 may be a sensor for identifying the environment around the eyewear-type device 100 . Sensor 122 may include LiDAR (Light Detection and Ranging). Sensor 122 may include a ranging sensor. Although FIG. 2 illustrates the case where the sensor 122 is arranged on the bridge 114, the arrangement of the sensor 122 in FIG. 2 is an example, and the sensor 122 may be arranged at other positions.

The eyewear device 100 may include sensors 124 . The sensor 124 detects, for example, the line of sight of the user 102 who wears the spectacles-type device 100 . Sensor 124 detects the gaze of user 102 by, for example, imaging and monitoring the eyes of user 102 . The placement of the sensors 124 in FIG. 2 is an example, and the sensors 124 may be placed at other positions.

Glasses-type device 100 may include microphone 126 . The microphone 126 is placed at a position where it can pick up the speech of the user 102 who wears the spectacles-type device 100 . The placement of the microphone 126 in FIG. 2 is an example, and the microphone 126 may be placed at other positions.

The control device 200 may receive various inputs. The control device 200 may receive various inputs from the user 102 via an operation unit arranged at an arbitrary position on the spectacles-type device 100 . The control device 200 receives various inputs from the user 102 via an input unit such as a button arranged at an arbitrary position on the frame 110, for example. The control device 200 may receive various inputs from the user 102 via, for example, a mobile terminal such as a smart phone and a wearable terminal, a tablet terminal, a PC, or the like. The glasses-type device 100 may establish a wireless connection with them, for example, using short-range wireless communication schemes such as Wi-Fi, Bluetooth®, and Zigbee®.

Controller 200 may accept voice input by user 102 . The control device 200 may accept voice input by the user 102 by voice recognition of the user's 102 speech captured by the microphone 126 .

The control device 200 may accept input by hand movements of the user 102 . The control device 200 may accept input from the user 102 such as selection of content by recognizing the movement of the hand of the user 102 captured by the camera 120 . The control device 200 may accept gesture input by the user 102 .

The control device 200 may include various sensors. The control device 200 includes, for example, a positioning sensor. For example, the control device 200 includes a GNSS (Global Navigation Satellite System) sensor such as a GPS (Global Positioning System) sensor. Control device 200 may include an acceleration sensor. The control device 200 may include a gyro sensor. Controller 200 may include other sensors.

The control device 200 may generate imaging range information indicating the imaging range of the camera 120 . The control device 200 may generate imaging range information based on the position, orientation, and orientation of the glasses-type device 100 . The control device 200 may identify the position, orientation, and orientation of the spectacles-type device 100 based on the outputs of various sensors.

The control device 200 may have a display function on the lens 116 . The lenses 116 may be an example of the display section of the spectacles-type device 100 . Lens 116 may be a transparent or translucent display, and controller 200 may cause lens 116 to perform various displays. That is, the glasses-type device 100 may be a transparent or translucent display-type device. Also, the control device 200 may have a function of projecting a display onto the lens 116 . That is, the glasses-type device 100 may be a projection-type device.

The control device 200 may have the function of performing communication via the network 20 . Controller 200 may access network 20 via mobile communications, Wi-Fi communications, and/or other wireless communications in general. The control device 200 may communicate with the content management server 300 via the network 20 .

FIG. 3 schematically shows a display example of content 400 by the glasses-type device 100. As shown in FIG. The spectacles-type device 100 receives the content 400 corresponding to the object within the imaging range from the content management server 300 , stores it, and displays it on the lens 116 .

Since the storage capacity of the glasses-type device 100 has an upper limit, it is not possible to store all the content 400 received from the content management server 300 . Therefore, implementation is conceivable in which the content 400 is deleted when the target corresponding to the content 400 is out of the imaging range of the spectacles-type device 100 . However, in this case, for example, if the user 102 once turned his back and immediately turned back to face forward, the glasses-type device 100 immediately downloads the content 400 again from the content management server 300 after deleting the content 400 . I have to.

The spectacles-type device 100 according to the present embodiment holds the content 400 until a predetermined condition is satisfied when the target corresponding to the displayed content 400 is out of the imaging range of the spectacles-type device 100. The content 400 is deleted according to the satisfaction of a predetermined condition.

For example, the glasses-type device 100 manages the content 400 according to the distance between the object corresponding to the content 400 and the glasses-type device 100 . The glasses-type device 100, for example, holds the content until it moves away from the object corresponding to the content 400 by a certain distance, and deletes the content 400 from the storage area when the object moves away from the object corresponding to the content 400 by the certain distance.

As a result, while the user 102 is positioned within a certain range from the object corresponding to the content 400, the content 400 can be displayed again when the object once leaves the imaging range of the spectacles-type device 100 and returns. The stored content 400 can be read and displayed without downloading. In addition, as a result, the content 400 can be deleted when the possibility of displaying the content 400 again after moving away from the target corresponding to the content 400 by a certain distance or more has decreased.

Also, for example, the spectacles-type device 100 manages the content 400 based on the elapsed time after the target corresponding to the content 400 has left the imaging range of the spectacles-type device 100 . For example, the spectacles-type device 100 holds the content 400 for a certain period of time even if the target corresponding to the content 400 is out of the imaging range, and the state in which the target is out of the imaging range continues for a certain period of time. Content 400 is deleted from the storage area accordingly.

As a result, the content 400 can be held as long as the time elapsed after the object corresponding to the content 400 has left the imaging range of the spectacles-type device 100 is short and the possibility of displaying it again is relatively high. In addition, the object corresponding to the content 400 remains out of the imaging range for a relatively long time, and the possibility that the content 400 will be displayed again becomes low because the user 102 has moved to another location. Content 400 can be deleted accordingly.

FIG. 4 is an explanatory diagram for explaining the content holding distance of the glasses-type device 100 . Here, the case where the content 400 is associated with the position in front of the building 33 among the buildings 31, 32, 33, 34, and 35 is illustrated.

When the imaging range of the spectacles-type device 100 includes a position in front of the building 33 associated with the content 400 , the content 400 is displayed on the spectacles-type device 100 . The user 102 can get the feeling that the content 400 is actually arranged in front of the building 33 which is real space.

The glasses-type device 100 retains the content 400 without deleting it while the glasses-type device 100 is positioned within a predetermined distance threshold 420 from the position corresponding to the content 400 . Thereby, the glasses-type device 100 displays the content 400 without re-downloading the content 400 from the content management server 300 when the user 102 turns around after passing the position corresponding to the content 400, for example. be able to.

The glasses-type device 100 deletes the content 400 in response to the glasses-type device 100 being positioned outside the predetermined distance threshold 420 from the position corresponding to the content 400 . This reduces the possibility that the user 102 will move a relatively long distance after passing in front of the building 33 and the position in front of the building 33 will be included in the imaging range of the spectacles-type device 100 again. Content 400 can be deleted.

FIG. 5 is an explanatory diagram for explaining the content holding distance of the glasses-type device 100. As shown in FIG. The spectacles-type device 100 deletes the content when the distance between the spectacles-type device 100 and the object corresponding to the content becomes longer than a predetermined distance threshold. A distance threshold may be registered. Examples of content types include public information, guides, advertisements, reviews, entertainment, and general user placement. In addition, these are examples and are not limited to these.

FIG. 5 illustrates distance threshold 422 corresponding to advertising content 402 and distance threshold 424 corresponding to review content 404 . In this example, distance threshold 422 is greater than distance threshold 424 . For example, by setting a longer distance threshold for content types of content that is more interesting to the user 102 and content that is more important to the user 102, these content can be preferentially retained.

FIG. 6 schematically shows an example of a distance threshold table 500. As shown in FIG. The glasses-type device 100 may refer to the distance threshold table 500 and use a distance threshold according to the state of the user 102 . For example, the glasses-type device 100 deletes the content from the storage unit when the distance between the glasses-type device 100 and the object corresponding to the content becomes longer than the distance threshold corresponding to the state of the user 102. Control.

The distance threshold table 500 illustrated in FIG. 6 includes four states of the user 102: "normal (walking)", "running", "riding a bicycle", and "riding a train or car". A range of distance thresholds for each of . For example, a distance threshold of several meters to several hundreds of meters can be set for "normal time (walking)". Also, for example, a distance threshold of several hundred meters to several kilometers can be set for "when running". Also, for example, a distance threshold of several hundred meters to several tens of kilometers can be set for "when riding a bicycle". Further, for example, 0 km is set for "when getting on a train or car".

For example, when the user 102 is walking, the spectacles-type device 100 holds the content 400 while the distance between the target corresponding to the content 400 and the spectacles-type device 100 is within 10 m. For example, when the user 102 is running, the spectacles-type device 100 holds the content 400 while the distance between the target corresponding to the content 400 and the spectacles-type device 100 is within 200 m. Further, for example, when the user 102 is riding a bicycle, the spectacles-type device 100 holds the content 400 while the distance between the target corresponding to the content 400 and the spectacles-type device 100 is within 3 km. Accordingly, it is possible to control the holding of the content 400 in consideration of the possibility that the content 400 is again included in the imaging range of the spectacles-type device 100 according to the movement ability of the user 102 .

Further, the spectacles-type device 100 may delete the content 400 when the target corresponding to the content 400 is out of the imaging range of the spectacles-type device 100 while the user 102 is on a train or a car. . As a result, the content 400 can be immediately deleted when the target corresponding to the content 400 is unlikely to be included in the imaging range of the spectacles-type device 100 again.

Note that the glasses-type device 100 may set a distance threshold according to the state of the user for each content type. For public information, for example, the spectacles-type device 100 is 50 m for "normal time (walking)", 500 m for "running", 5 km for "riding a bicycle", 0 km is set for "when getting in a car". In addition, for example, the spectacles-type device 100 is 10 m for "normal time (walking)", 100 m for "running", 200 m for "riding a bicycle", and 200 m for "when riding a train". 0 km is set for "when driving or getting in a car". As a result, the content whose content type is public information can be held preferentially compared to the content whose content type is review.

FIG. 7 schematically shows an example of a time threshold table 510. As shown in FIG. The glasses-type device 100 may refer to the time threshold table 510 and use a time threshold according to the content type of the content. For example, the spectacles-type device 100 stores the content in response to a state in which the target corresponding to the displayed content has been out of the imaging range of the spectacles-type device 100 for a time threshold corresponding to the content type of the content. Control to delete from department.

A time threshold table 510 illustrated in FIG. 7 shows distance thresholds for each of the four content types of "general user placement", "review", "advertisement", and "interesting content". Interesting content may be, for example, content registered as a favorite by the user 102 or content that matches the user's 102 tastes and hobbies. In the example of FIG. 7, 5 minutes are set for "general user placement", 10 minutes for "review", 30 minutes for "advertisement", and 1 hour for "interesting content". .

The spectacles-type device 100, for example, deletes the content of “general user placement” when the target corresponding to the content has been out of the imaging range of the spectacles-type device 100 for 5 minutes. Also, the spectacles-type device 100 deletes, for example, the “review” content when the target corresponding to the content has been out of the imaging range of the spectacles-type device 100 for 10 minutes. Further, the spectacles-type device 100, for example, deletes the “advertisement” content when the target corresponding to the content has been out of the imaging range of the spectacles-type device 100 for 30 minutes. Also, the spectacles-type device 100 deletes, for example, the content of “interesting content” when the target corresponding to the content has been out of the imaging range of the spectacles-type device 100 for one hour.

Contents with high urgency such as evacuation information and disaster information may be held regardless of the elapsed time. For example, when the glasses-type device 100 receives highly urgent content from the content management server 300, it may be held regardless of time and displayed preferentially. Moreover, such highly urgent content may be deleted from the glasses-type device 100 when the glasses-type device 100 receives information from the content management server 300 notifying that the urgency has decreased.

FIG. 8 schematically shows an example of the time threshold table 520. As shown in FIG. The glasses-type device 100 may refer to the time threshold table 520 and use a time threshold according to the state of the user 102 . For example, the spectacles-type device 100 stores the content in response to the fact that the target corresponding to the displayed content has been out of the imaging range of the spectacles-type device 100 for a time threshold corresponding to the state of the user 102. Control to delete from department.

The time threshold table 520 illustrated in FIG. 8 includes four states of the user 102: "normal (walking)", "running", "riding a bicycle", and "riding a train or car". are shown the range of time thresholds for each of the . For example, a time threshold of several minutes to over ten minutes can be set for "normal time (walking time)". Also, for example, a time threshold of several minutes to several tens of minutes can be set for "while running". Also, for example, a time threshold of several tens of minutes to several hours can be set for "when riding a bicycle". Further, for example, 0 minutes is set for "when getting on a train or car".

For example, when the user 102 is walking, the spectacles-type device 100 deletes the content when the target corresponding to the displayed content is out of the imaging range of the spectacles-type device 100 for 5 minutes. . Further, for example, when the user 102 is running, the spectacles-type device 100 deletes the content in response to the fact that the target corresponding to the displayed content has been out of the imaging range of the spectacles-type device 100 for 10 minutes. do. Further, for example, when the user 102 is riding a bicycle, the spectacles-type device 100 responds to a state in which the target corresponding to the displayed content is out of the imaging range of the spectacles-type device 100 for 30 minutes. Delete content. Accordingly, it is possible to control the holding of the content 400 in consideration of the possibility that the content 400 is again included in the imaging range of the spectacles-type device 100 according to the movement ability of the user 102 .

Further, the spectacles-type device 100 may delete the content 400 when the target corresponding to the content 400 is out of the imaging range of the spectacles-type device 100 while the user 102 is on a train or a car. . As a result, the content 400 can be immediately deleted when the target corresponding to the content 400 is unlikely to be included in the imaging range of the spectacles-type device 100 again.

Note that the glasses-type device 100 may set a time threshold according to the state of the user for each content type. For public information, for example, the spectacles-type device 100 takes 10 minutes for "normal time (walking)", 15 minutes for "running", 2 hours for "riding a bicycle", Set 0 minutes for "when getting on a train or car". In addition, the spectacles-type device 100, for example, takes 5 minutes for "normal time (walking)", 10 minutes for "running", and 30 minutes for "riding a bicycle" for reviews. , and set 0 minutes for "when getting on a train or car". As a result, the content whose content type is public information can be held preferentially compared to the content whose content type is review.

Up to this point, a predetermined condition (the distance between the spectacles-type device 100 and the target corresponding to the content being longer than the distance threshold, or the target corresponding to the displayed content being out of the imaging range of the spectacles-type device 100). Examples have been described of deleting content in response to satisfaction of a condition that has persisted for a time threshold. When the frequency of visits by the user 102 to the target corresponding to the displayed content is higher than a predetermined visit threshold, the glasses-type device 100 may not delete the content even if the above condition is satisfied.

FIG. 9 schematically shows an example of the frequent place table 530. As shown in FIG. The glasses-type device 100 may register high-frequency locations visited by the user 102 more frequently than a predetermined visit threshold based on the history of the location information of the glasses-type device 100 . In the high frequency location table 530 illustrated in FIG. 9, home, nearest station, getting off station, etc. are registered.

The glasses-type device 100 may register the content corresponding to the frequent place target in the frequent place table 530 . In the high-frequency place table 530 illustrated in FIG. 9, content A and content B are registered for home, content C, content D, and content E are registered for the nearest station, and content F is registered for the getting off station. and content G are registered.

When the imaging direction of the spectacles-type device 100 includes a high-frequency location, the spectacles-type device 100 may display content corresponding to the high-frequency location even if the high-frequency location is not included in the imaging range. . Thereby, for example, when the user 102 is at home, the content C, the content D, and the content E can be displayed by looking in the direction of the nearest station.

The glasses-type device 100 may register the frequent location table 530 in the content management server 300 . The content management server 300 may store the frequently visited location table 530 for each of the multiple glasses-type devices 100 .

When content registered in the frequent location table 530 is updated, the content management server 300 may transmit the updated content to the glasses-type device 100 corresponding to the frequent location table 530 . The glasses-type device 100 may update the content in the storage section with the updated content received from the content management server 300 . As a result, when the content stored in the spectacle-type device 100 is updated in the content management server 300, the content stored in the spectacle-type device 100 can be updated even if the user is far away.

FIG. 10 schematically shows an example of the functional configuration of the control device 200. As shown in FIG. The control device 200 includes a storage unit 202 , an information acquisition unit 204 , a server communication unit 206 , a display control unit 208 and a deletion control unit 210 .

The information acquisition unit 204 acquires various types of information. The information acquisition section 204 may store the acquired information in the storage section 202 .

The information acquisition unit 204 acquires, from the camera 120, an image captured by the camera 120, for example. The information acquisition unit 204 acquires information output by various sensors, for example. The information acquisition unit 204 may acquire information output by the sensor 122 . The information acquisition unit 204 may acquire information output by the sensor 124 . The information acquisition unit 204 acquires line-of-sight information of the user 102 output by the sensor 124, for example.

The information acquisition unit 204 may acquire information output by the positioning sensor. The information acquisition unit 204 may acquire information output by the acceleration sensor. The information acquisition unit 204 may acquire information output by the gyro sensor. The information acquisition unit 204 may acquire information output by other sensors.

The information acquisition unit 204 acquires the speech of the user 102 acquired by the microphone 126, for example. The information acquisition unit 204 may acquire the content of the utterance by recognizing the utterance of the user 102 acquired by the microphone 126 .

The information acquisition unit 204 may acquire various inputs from the user 102 . The information acquisition unit 204 may acquire input information input by the user 102 via the operation unit or mobile terminal. The information acquisition unit 204 may acquire the voice input content of the user 102 . The information acquisition unit 204 may acquire input information based on hand movements of the user 102 .

The information acquisition unit 204 may generate imaging range information indicating the imaging range of the camera 120 . The information acquisition unit 204 may generate imaging range information based on the position, orientation, and orientation of the glasses-type device 100 . The information acquisition unit 204 may identify the position, orientation, and orientation of the spectacles-type device 100 based on outputs from various sensors.

The information acquisition unit 204 may identify a high-frequency location where the frequency of visits by the user 102 is higher than a predetermined visit threshold. The information acquisition unit 204 may identify the high-frequency location based on the history of the location information of the glasses-type device 100 . The visit threshold may be arbitrarily set, such as once a day, twice a day, once every two days, or may be changed.

Server communication unit 206 communicates with content management server 300 . The server communication section 206 may communicate with the content management server 300 via the network 20 . The server communication unit 206 , for example, transmits various information acquired by the information acquisition unit 204 to the content management server 300 .

The server communication unit 206 , for example, transmits the imaging range information to the content management server 300 and receives from the content management server 300 the content corresponding to the object within the imaging range indicated by the imaging range information. Server communication unit 206 stores the received content in storage unit 202 . Server communication section 206 may store the received content in a cache included in storage section 202 . Server communication unit 206 may be an example of a content reception unit.

The display control unit 208 controls to display various information on the lens 116 . The display control unit 208 reads the content corresponding to the object included in the imaging range of the glasses-type device 100 from the storage unit 202 and causes the lens 116 to display the content.

When content corresponding to an object included in the imaging range of the glasses-type device 100 is stored in the storage unit 202 , the display control unit 208 causes the lens 116 to display the content.

When the content corresponding to the object included in the imaging range of the glasses-type device 100 is not stored in the storage unit 202, the server communication unit 206 receives the content from the content management server 300 and stores it in the storage unit 202. . A display control unit 208 displays the content stored in the storage unit 202 on the lens 116 .

When the object corresponding to the content displayed on the lens 116 by the display control unit 208 is out of the imaging range of the glasses-type device 100, the deletion control unit 210 retains the content until a predetermined condition is satisfied. Then, the content is deleted from the storage unit 202 when a predetermined condition is satisfied.

The deletion control unit 210 may perform control to delete the content from the storage unit 202 when the distance between the glasses-type device 100 and the object corresponding to the content becomes longer than a predetermined distance threshold.

The deletion control unit 210 performs control to delete content from the storage unit 202 when the distance between the glasses-type device 100 and the object corresponding to the content becomes longer than the distance threshold corresponding to the content type of the content. You can

The deletion control unit 210 stores the content when the distance between the spectacles-type device 100 and the object corresponding to the content becomes longer than the distance threshold corresponding to the state of the user 102 wearing the spectacles-type device 100. You may control to delete from the part 202. FIG. The deletion control unit 210 may refer to, for example, the distance threshold table 500 to obtain the distance threshold corresponding to the state of the user 102 .

When the distance between the spectacles-type device 100 and the object corresponding to the content becomes longer than the distance threshold as the moving speed of the user wearing the spectacles-type device 100 increases, the deletion control unit 210 deletes the content. may be controlled to be deleted from the storage unit 202 .

The deletion control unit 210 stores the content in response to the fact that the object corresponding to the content displayed by the display control unit 208 has been out of the imaging range of the spectacles-type device 100 for a predetermined time threshold. You may control to delete from the part 202. FIG.

The deletion control unit 210 responds to the fact that the target corresponding to the content displayed by the display control unit 208 has been out of the imaging range of the spectacles-type device 100 for a time threshold corresponding to the content type of the content. , the content may be deleted from the storage unit 202 . For example, the deletion control unit 210 may refer to the time threshold table 510 to obtain the time threshold corresponding to the content type.

The deletion control unit 210 controls the state in which the target corresponding to the content displayed by the display control unit 208 is out of the imaging range of the spectacles-type device 100 for a time threshold corresponding to the state of the user wearing the spectacles-type device 100. Depending on the continuation, the content may be controlled to be deleted from the storage unit 202 . The deletion control unit 210 may refer to, for example, the time threshold table 520 to acquire the time threshold corresponding to the state of the user 102 .

The deletion control unit 210 makes the state in which the target corresponding to the content displayed by the display control unit 208 is out of the imaging range of the spectacles-type device 100 longer as the user 102 wearing the spectacles-type device 100 moves faster. Content may be controlled to be deleted in response to continuing for a time threshold.

When the frequency of visits by the user of the glasses-type device to the target corresponding to the content displayed by the display control unit 208 is higher than a predetermined visit threshold, the deletion control unit 210 determines that the predetermined condition is satisfied. may not delete the content.

If an object with a higher visit frequency than the visit threshold of the user 102 is located in the imaging direction of the spectacles-type device 100 and content corresponding to the object is stored in the storage unit 202, the display control unit 208 displays the Content may be displayed on lens 116 .

The server communication unit 206 receives an update from the content management server 300 when the content corresponding to the target visited by the user 102 higher than the visit threshold stored in the storage unit 202 is updated in the content management server 300 . The content may be received later and stored in the storage unit 202 .

FIG. 11 schematically shows an example of the hardware configuration of a computer 1200 functioning as the control device 200. As shown in FIG. Programs installed on the computer 1200 cause the computer 1200 to function as one or more "parts" of the apparatus of the present embodiments, or cause the computer 1200 to operate or perform operations associated with the apparatus of the present invention. Multiple "units" can be executed and/or the computer 1200 can be caused to execute the process or steps of the process according to the present invention. Such programs may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

Computer 1200 according to this embodiment includes CPU 1212 , RAM 1214 , and graphics controller 1216 , which are interconnected by host controller 1210 . Computer 1200 also includes input/output units such as communication interface 1222 , storage device 1224 , and IC card drives, which are connected to host controller 1210 via input/output controller 1220 . Storage devices 1224 may be hard disk drives, solid state drives, and the like. Computer 1200 also includes input/output units such as ROM 1230 and keyboard or touch panel, which are connected to input/output controller 1220 via input/output chip 1240 .

The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. Graphics controller 1216 retrieves image data generated by CPU 1212 into a frame buffer or the like provided in RAM 1214 or itself, and causes the image data to be displayed on display device 1218 .

Communication interface 1222 communicates with other electronic devices over a network. Storage device 1224 stores programs and data used by CPU 1212 within computer 1200 . The IC card drive reads programs and data from IC cards and/or writes programs and data to IC cards.

ROM 1230 stores therein programs that are dependent on the hardware of computer 1200, such as a boot program that is executed by computer 1200 upon activation. Input/output chip 1240 may also connect various input/output units to input/output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, and the like.

A program may be provided by a computer-readable storage medium such as an IC card. The program is read from a computer-readable storage medium, installed in storage device 1224 , RAM 1214 , or ROM 1230 , which are also examples of computer-readable storage media, and executed by CPU 1212 . The information processing described within these programs is read by computer 1200 to provide coordination between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing information operations or processing according to the use of computer 1200 .

For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded into the RAM 1214 and sends communication processing to the communication interface 1222 based on the processing described in the communication program. you can command. Under the control of the CPU 1212, the communication interface 1222 reads the transmission data stored in the transmission buffer area provided in the RAM 1214, the storage device 1224, or a recording medium such as an IC card, and transmits the read transmission data to the network. Received data transmitted or received from a network is written in a receive buffer area or the like provided on a recording medium.

The CPU 1212 also causes the RAM 1214 to read all or necessary portions of files or databases stored in an external recording medium such as a storage device 1224 or an IC card, and performs various types of processing on the data on the RAM 1214. may be executed. CPU 1212 may then write back the processed data to an external recording medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored on recording media and subjected to information processing. CPU 1212 performs various types of operations on data read from RAM 1214, information processing, conditional decisions, conditional branching, unconditional branching, and information retrieval, which are described throughout this disclosure and are specified by instruction sequences of programs. Various types of processing may be performed, including /replace, etc., and the results written back to RAM 1214 . In addition, the CPU 1212 may search for information in a file in a recording medium, a database, or the like. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 selects the first attribute from among the plurality of entries. search for an entry that matches the specified condition of the attribute value of the attribute, read the attribute value of the second attribute stored in the entry, and thereby determine the first attribute that satisfies the predetermined condition An attribute value of the associated second attribute may be obtained.

The programs or software modules described above may be stored in a computer-readable storage medium on or near computer 1200 . Also, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. offer.

The blocks in the flowcharts and block diagrams in this embodiment may represent steps in the process in which the operations are performed or "parts" of the apparatus responsible for performing the operations. Certain steps and "sections" may be provided with dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and/or computer readable instructions provided with computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor. Dedicated circuitry may include digital and/or analog hardware circuitry, and may include integrated circuits (ICs) and/or discrete circuitry. Programmable circuits, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), etc., perform AND, OR, EXCLUSIVE OR, NOT AND, NOT OR, and other logical operations. , flip-flops, registers, and memory elements.

A computer-readable storage medium may comprise any tangible device capable of storing instructions to be executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon may be illustrated in flowchart or block diagram form. It will comprise an article of manufacture containing instructions that can be executed to create means for performing specified operations. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory) , electrically erasable programmable read only memory (EEPROM), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick , integrated circuit cards, and the like.

The computer readable instructions may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state configuration data, or instructions such as Smalltalk, JAVA, C++, etc. any source or object code written in any combination of one or more programming languages, including object-oriented programming languages, and conventional procedural programming languages such as the "C" programming language or similar programming languages; may include

Computer readable instructions are used to produce means for a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuits to perform the operations specified in the flowchart or block diagrams. A general purpose computer, special purpose computer, or other programmable data processor, locally or over a wide area network (WAN) such as the Internet, etc., to execute such computer readable instructions. It may be provided in the processor of the device or in a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various modifications or improvements can be made to the above embodiments. It is clear from the description of the scope of the claims that forms with such modifications or improvements can also be included in the technical scope of the present invention.

The execution order of each process such as actions, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, the specification, and the drawings is etc., and it should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the specification, and the drawings, even if the description is made using "first," "next," etc. for convenience, it means that it is essential to carry out in this order. not a thing

10 system, 20 network, 31, 32, 33, 34, 35 building, 100 spectacle device, 102 user, 110 frame, 112 rim, 114 bridge, 116 lens, 118 temple, 120 camera, 122 sensor, 124 sensor, 126 microphone, 200 control device, 202 storage unit, 204 information acquisition unit, 206 server communication unit, 208 display control unit, 210 deletion control unit, 300 content management server, 400 content, 402 advertisement content, 404 review content, 420 distance threshold, 422 distance threshold, 424 distance threshold, 500 distance threshold table, 510 time threshold table, 520 time threshold table, 530 frequent place table, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input/output controller, 1222 communication interface, 1224 storage device, 1230 ROM, 1240 input/output chip

Claims (16)

A glasses-type device,
a server communication unit that receives, from a content management server, content corresponding to an object that is included within an imaging range of the spectacles-type device and positioned within a predetermined distance from the spectacles-type device;
a storage unit that stores the content received by the server communication unit;
a display control unit that reads content corresponding to an object included in an imaging range of the spectacles-type device from the storage unit and displays the content on a display unit of the spectacles-type device;
When the target corresponding to the content displayed by the display control unit is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. a deletion control unit that controls deletion of the content from the storage unit in response to satisfaction of a condition ;
The deletion control unit deletes the content from the storage unit in response to a distance between the glasses-type device and an object corresponding to the content becoming longer than a distance threshold corresponding to a content type of the content. A glasses-type device that controls A glasses-type device,
a server communication unit that receives, from a content management server, content corresponding to an object that is included within an imaging range of the spectacles-type device and positioned within a predetermined distance from the spectacles-type device;
a storage unit that stores the content received by the server communication unit;
a display control unit that reads content corresponding to an object included in an imaging range of the spectacles-type device from the storage unit and displays the content on a display unit of the spectacles-type device;
When the target corresponding to the content displayed by the display control unit is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. a deletion control unit that controls deletion of the content from the storage unit in response to satisfaction of a condition;
with
The deletion control unit deletes the content in response to a distance between the spectacles-type device and a target corresponding to the content becoming longer than a distance threshold corresponding to a state of a user wearing the spectacles-type device. A glasses-type device that is controlled to be removed from the storage unit. When the distance between the spectacles-type device and the object corresponding to the content becomes longer than the distance threshold as the moving speed of the user wearing the spectacles-type device increases, 3. The spectacles-type device according to claim 2, which controls deletion of the content from the storage unit. The server communication unit receives, from a content management server, content corresponding to an area included within an imaging range of the spectacles-type device and located within a predetermined distance from the spectacles-type device,
The deletion control unit retains the content until a predetermined condition is satisfied when the area corresponding to the content displayed by the display control unit is out of the imaging range of the glasses-type device. 4. The spectacles-type device according to any one of claims 1 to 3 , controlling to delete the content depending on the condition being satisfied. The deletion control unit deletes the content in response to a state in which an object corresponding to the content displayed by the display control unit has been out of an imaging range of the spectacles-type device for a predetermined time threshold. 5. The spectacles-type device according to any one of claims 1 to 4 , wherein the device controls to delete from the storage unit. A glasses-type device,
a server communication unit that receives, from a content management server, content corresponding to an object that is included within an imaging range of the spectacles-type device and positioned within a predetermined distance from the spectacles-type device;
a storage unit that stores the content received by the server communication unit;
a display control unit that reads content corresponding to an object included in an imaging range of the spectacles-type device from the storage unit and displays the content on a display unit of the spectacles-type device;
When the target corresponding to the content displayed by the display control unit is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. a deletion control unit that controls deletion of the content from the storage unit in response to satisfaction of a condition;
with
The deletion control unit detects that the target corresponding to the content displayed by the display control unit has been out of the imaging range of the glasses-type device for a time threshold corresponding to the content type of the content. and, in response, a glasses-type device that controls deletion of the content from the storage. A glasses-type device,
a server communication unit that receives, from a content management server, content corresponding to an object that is included within an imaging range of the spectacles-type device and positioned within a predetermined distance from the spectacles-type device;
a storage unit that stores the content received by the server communication unit;
a display control unit that reads content corresponding to an object included in an imaging range of the spectacles-type device from the storage unit and displays the content on a display unit of the spectacles-type device;
When the target corresponding to the content displayed by the display control unit is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. a deletion control unit that controls deletion of the content from the storage unit in response to satisfaction of a condition;
with
The deletion control unit determines that a state in which an object corresponding to the content displayed by the display control unit is out of an imaging range of the eyeglasses-type device is a time threshold value corresponding to a state of the user wearing the eyeglasses-type device. a spectacles-type device that controls deletion of the content from the storage unit in accordance with the fact that the content has been continued for a period of time. The deletion control unit determines that a state in which an object corresponding to the content displayed by the display control unit is out of the imaging range of the spectacles-type device becomes longer as the moving speed of the user wearing the spectacles-type device is faster. 8. The glasses-type device according to claim 7 , controlling deletion of the content according to continuing for a time threshold. When the frequency of visits of the user of the glasses-type device to the target corresponding to the content displayed by the display control unit is higher than a predetermined visit threshold, the deletion control unit determines whether the predetermined condition is satisfied. 9. The spectacles-type device according to any one of claims 1 to 8 , wherein the device does not delete the content even if it is deleted. When an object with a frequency of visits by the user higher than the visit threshold is located in the imaging direction of the spectacles-type device, and content corresponding to the object is stored in the storage unit, 10. The spectacles-type device according to claim 9 , wherein the content is displayed on the display unit. The server communication unit, when the content corresponding to the target visited by the user higher than the visit threshold stored in the storage unit is updated in the content management server, from the content management server: 11. The spectacles - type device according to claim 9 , wherein the updated content is received and stored in the storage unit. A program for causing a spectacles-type device to function as the spectacles-type device according to any one of claims 1 to 11 . A control method executed by a computer mounted on an eyeglass-type device, comprising:
a receiving step of receiving content included within an imaging range of the glasses-type device from a content management server;
a storing step of storing the content received in the receiving step in a storage unit of the computer;
a display control step of reading out content included in an imaging range of the spectacles-type device from the storage unit and displaying the contents on a display unit of the spectacles-type device;
When the target corresponding to the content displayed in the display control step is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. a deletion control stage for controlling deletion of said content from said storage unit in response to a condition being met ;
The deletion control step deletes the content from the storage unit in response to a distance between the glasses-type device and a target corresponding to the content becoming longer than a distance threshold corresponding to a content type of the content. control method A control method executed by a computer mounted on an eyeglass-type device, comprising:
a receiving step of receiving content included within an imaging range of the glasses-type device from a content management server;
a storing step of storing the content received in the receiving step in a storage unit of the computer;
a display control step of reading out content included in an imaging range of the spectacles-type device from the storage unit and displaying the contents on a display unit of the spectacles-type device;
When the target corresponding to the content displayed in the display control step is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. a deletion control stage for controlling deletion of the content from the storage unit in response to a condition being satisfied;
with
The deletion control step deletes the content in response to a distance between the spectacles-type device and an object corresponding to the content becoming longer than a distance threshold corresponding to a state of a user wearing the spectacles-type device. A control method for controlling deletion from the storage unit. A control method executed by a computer mounted on an eyeglass-type device, comprising:
a receiving step of receiving content included within an imaging range of the glasses-type device from a content management server;
a storing step of storing the content received in the receiving step in a storage unit of the computer;
a display control step of reading out content included in an imaging range of the spectacles-type device from the storage unit and displaying the contents on a display unit of the spectacles-type device;
When the target corresponding to the content displayed in the display control step is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. a deletion control stage for controlling deletion of the content from the storage unit when a condition is satisfied;
with
In the deletion control step, a state in which an object corresponding to the content displayed in the display control step is out of the imaging range of the glasses-type device continues for a time threshold corresponding to the content type of the content. responsively controlling deletion of said content from said storage unit. A control method executed by a computer mounted on an eyeglass-type device, comprising:
a receiving step of receiving content included within an imaging range of the glasses-type device from a content management server;
a storing step of storing the content received in the receiving step in a storage unit of the computer;
a display control step of reading out content included in an imaging range of the spectacles-type device from the storage unit and displaying the contents on a display unit of the spectacles-type device;
When the target corresponding to the content displayed in the display control step is out of the imaging range of the spectacles-type device, the content is held until a predetermined condition is satisfied, and the predetermined condition is satisfied. a deletion control stage for controlling deletion of the content from the storage unit when a condition is satisfied;
with
In the deletion control step, the state in which the object corresponding to the content displayed in the display control step is out of the imaging range of the spectacles-type device is a time threshold corresponding to the state of the user wearing the spectacles-type device. a control method for controlling deletion of the content from the storage unit in accordance with the fact that the content has been continued for a period of time.

Images