WO2018216221A1 - Wearable terminal display system, wearable terminal display method and program - Google Patents

Wearable terminal display system, wearable terminal display method and program Download PDF

Info

Publication number
WO2018216221A1
WO2018216221A1 PCT/JP2017/019809 JP2017019809W WO2018216221A1 WO 2018216221 A1 WO2018216221 A1 WO 2018216221A1 JP 2017019809 W JP2017019809 W JP 2017019809W WO 2018216221 A1 WO2018216221 A1 WO 2018216221A1
Authority
WO
WIPO (PCT)
Prior art keywords
support
wearable terminal
display
telephone number
target
Prior art date
Application number
PCT/JP2017/019809
Other languages
French (fr)
Japanese (ja)
Inventor
俊二 菅谷
Original Assignee
株式会社オプティム
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社オプティム filed Critical 株式会社オプティム
Priority to PCT/JP2017/019809 priority Critical patent/WO2018216221A1/en
Publication of WO2018216221A1 publication Critical patent/WO2018216221A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to a wearable terminal display system and a wearable terminal display method for displaying a collected support center telephone number as an augmented reality for a support object that can be seen through the display board on the display board of the wearable terminal. And program.
  • Patent Document 1 An information display system that allows a user to quickly cope with a trouble in an electronic device.
  • Patent Document 1 has a problem that a support center can be called only when an electronic device trouble occurs.
  • the present invention identifies a support target from an image of a wearable terminal field of view, and displays the support center telephone number collected according to the support target as an augmented reality display on the display panel of the wearable terminal. It is an object to provide a system, a wearable terminal display method, and a program.
  • the present invention provides the following solutions.
  • the invention according to the first aspect is a wearable terminal display system for displaying a phone number of a support center to be supported on a display board of the wearable terminal, and an image for acquiring an image of a support target that has entered the field of view of the wearable terminal
  • An acquisition unit an image analysis unit that analyzes the image to identify the support target; a collection unit that collects a telephone number of the support center to be supported; and a display plate on the display plate of the wearable terminal.
  • a wearable terminal display system comprising: a telephone number display unit that displays the support center telephone number as an augmented reality for the support object that is transparent.
  • the invention according to the first aspect is a wearable terminal display method for displaying a phone number of a support center to be supported on a display board of the wearable terminal, and an image for acquiring a support target image entering the field of view of the wearable terminal An acquisition step; an image analysis of the image to identify the support target; a collection step of collecting telephone numbers of the support center to be supported; and a display board on the display board of the wearable terminal.
  • a wearable terminal display method comprising: a telephone number display step of displaying the support center telephone number as an augmented reality for the support object that appears transparent.
  • the invention according to the first aspect includes an image acquisition step of acquiring, in a computer, an image of a support target that has entered the field of view of the wearable terminal, a specific step of analyzing the image and specifying the support target, A collecting step of collecting a phone number of a support center to be supported, and displaying the phone number of the support center as an augmented reality on the display board of the wearable terminal with respect to the support object that is seen through the display board A telephone number display step is provided.
  • the phone number of the support center to be supported can be displayed on the wearable terminal display board.
  • FIG. 1 is a schematic diagram of a wearable terminal display system.
  • FIG. 2 is an example in which the telephone numbers of the support centers to be supported are collected and displayed on the display board of the wearable terminal.
  • the wearable terminal display system of the present invention is a system that displays the collected support center telephone numbers as augmented reality on the display board of the wearable terminal for a support object that can be seen through the display board.
  • a wearable terminal is a terminal with a field of view, such as a smart glass or a head-mounted display.
  • FIG. 1 is a schematic diagram of a wearable terminal display system which is a preferred embodiment of the present invention.
  • the wearable terminal display system includes image acquisition means, identification means, collection means, and telephone number display means that are realized by a control unit reading a predetermined program.
  • determination means, change means, detection means, action result display means, position / direction acquisition means, estimation means, guideline display means, and selection reception means may be provided. These may be application type, cloud type or others.
  • Each means described above may be realized by a single computer or may be realized by two or more computers (for example, a server and a terminal).
  • the image acquisition means acquires a supported image that has entered the field of view of the wearable terminal. You may acquire the image imaged with the camera of the wearable terminal. Or even if it is other than a wearable terminal, as long as such an image can be acquired, it does not matter.
  • the image may be a moving image or a still image. In order to display the telephone number of the support center in real time, a real-time image is preferable.
  • the identification means identifies the support target by analyzing the image. For example, it is specified whether the support target is a JCB credit card, iPhone, or Weekly Shonen Jump. Support target can be specified from appearance, color, shape, size, mark, etc. The support target is not limited to these. Further, if it takes time to specify all the supported support targets, only the support target at the center of the field of view of the wearable terminal may be specified. By identifying only the support target in the center of the field of view, the time required for identification can be greatly reduced. The accuracy of image analysis may be improved by machine learning. For example, machine learning is performed using a past image to be supported as teacher data.
  • Collecting means collects the telephone number of the support center according to the support target.
  • the support center telephone numbers corresponding to the support target may be collected with reference to a database in which the support center telephone numbers are registered in advance. Further, the telephone number of the support center may be collected by accessing Web contents linked in advance to the support target.
  • the URL can be collected from the Web content by assigning a URL that links the support target and the telephone number of the support center.
  • the telephone number of the support center may be collected from the Web content searched by searching the support target on the Internet. For example, there are cases where the telephone number of the support center is posted on the homepage to be supported, and it can be collected from the Internet search.
  • the support center telephone number may be collected from an SNS (social networking service) or a word-of-mouth site.
  • the telephone number display means displays the telephone number of the support center as augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board.
  • the phone number of the support center drawn with a broken line is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target drawn with a solid line that can be seen through the display board.
  • the solid line is the real thing
  • the broken line is the augmented reality.
  • the judging means judges whether or not the displayed telephone number of the support center has been browsed. It may be determined whether the telephone number of the support center has been browsed by acquiring the image being browsed and analyzing the image. Further, it may be determined whether or not the telephone number of the support center has been browsed from the sensor information of the wearable terminal or the sensor information attached to the viewer. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
  • the change means changes the attention level so that the phone number of the support center is changed to browsed when it is determined that it has been browsed, and the phone number of the support center is browsed when it is determined that it has not been browsed. .
  • the attention level may be changed by changing the color / size of the telephone number of the support center or pressing a stamp so that the telephone number of the support center is conspicuous.
  • Detecting means detects an action for the phone number of the displayed support center.
  • the action is, for example, a gesture, a hand movement, a line-of-sight movement, or the like.
  • the action for the telephone number of the support center can be detected by acquiring the image being browsed and analyzing the image.
  • the action result display means displays the result corresponding to the action as an augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board. For example, when an action for deleting the telephone number of the support center is detected, the display of the telephone number of the support center may be deleted. For example, when an action to make a call to a support center telephone number is detected, a result of making a call (during outgoing call etc.) may be displayed. Of course, other actions are possible.
  • the position direction means acquires the terminal position and the imaging direction of the wearable terminal.
  • the terminal position can be acquired from the GPS (Global Positioning System) of the wearable terminal.
  • the imaging direction can be acquired from a geomagnetic sensor or an acceleration sensor of the wearable terminal when imaging is performed with the wearable terminal. You may acquire from other than these.
  • the estimation means estimates the support target position to be supported based on the terminal position and the imaging direction. If the terminal position and the imaging direction are known, the support target position of the captured support target can be estimated.
  • the specifying means may specify the support target from the support target position and the image analysis. For example, even if the support target is the same chain store, there are cases where the phone number of the support center differs depending on the store. For example, if it can be specified that the store is Minato-ku, Tokyo, the phone number of the support center of the Minato-ku, Tokyo can be displayed.
  • the guideline display means displays the guideline for imaging the support target as augmented reality on the display board of the wearable terminal.
  • guidelines such as a frame or a cross may be displayed. Image analysis is facilitated by having images taken along the guidelines.
  • the acquisition unit may acquire an image taken along the guideline.
  • the selection accepting unit accepts selection of a selection target for a support target that is seen through the display board of the wearable terminal.
  • the selection of the selection target may be accepted by looking at the support target that is seen through the display board of the wearable terminal for a certain period of time.
  • the selection of the selection target may be received by touching the support target that is seen through the display board of the wearable terminal.
  • the selection of the selection target may be received by placing the cursor on the support target that can be seen through the display board of the wearable terminal.
  • a sensor that detects a line of sight a motion sensor, an acceleration sensor, and the like.
  • the telephone number display means may display the telephone number of the support center as augmented reality on the display board of the wearable terminal only in accordance with the selection target that can be seen through the display board. Since the telephone number of the support center is displayed as augmented reality according to the selected selection object, the telephone number of the support center can be grasped pinpointly. If the phone number of the support center is displayed on all identified support targets, the screen of the display board may become troublesome.
  • the wearable terminal display method of the present invention is a method of displaying the collected telephone numbers of the support center as augmented reality on the display board of the wearable terminal with respect to the support object that can be seen through the display board.
  • the wearable terminal display method includes an image acquisition step, a specific step, a collection step, and a telephone number display step. Although not shown, similarly, a determination step, a change step, a detection step, an action result display step, a position / direction acquisition step, an estimation step, a guideline display step, and a selection reception step may be provided.
  • the support target image that has entered the field of view of the wearable terminal is acquired. You may acquire the image imaged with the camera of the wearable terminal. Or even if it is other than a wearable terminal, as long as such an image can be acquired, it does not matter.
  • the image may be a moving image or a still image. In order to display the telephone number of the support center in real time, a real-time image is preferable.
  • the support target is specified by analyzing the image. For example, it is specified whether the support target is a JCB credit card, iPhone, or Weekly Shonen Jump.
  • Support target can be specified from appearance, color, shape, size, mark, etc. The support target is not limited to these. Further, if it takes time to specify all the supported support targets, only the support target at the center of the field of view of the wearable terminal may be specified. By identifying only the support target in the center of the field of view, the time required for identification can be greatly reduced.
  • the accuracy of image analysis may be improved by machine learning. For example, machine learning is performed using a past image to be supported as teacher data.
  • the telephone number of the support center corresponding to the support target is collected.
  • the support center telephone numbers corresponding to the support target may be collected with reference to a database in which the support center telephone numbers are registered in advance. Further, the telephone number of the support center may be collected by accessing Web contents linked in advance to the support target.
  • the URL can be collected from the Web content by assigning a URL that links the support target and the telephone number of the support center.
  • the telephone number of the support center may be collected from the Web content searched by searching the support target on the Internet. For example, there are cases where the telephone number of the support center is posted on the homepage to be supported, and it can be collected from the Internet search.
  • the support center telephone number may be collected from an SNS (social networking service) or a word-of-mouth site.
  • the phone number of the support center is displayed on the display board of the wearable terminal as an augmented reality with respect to the support object that can be seen through the display board.
  • the phone number of the support center drawn with a broken line is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target drawn with a solid line that can be seen through the display board.
  • the solid line is the real thing
  • the broken line is the augmented reality.
  • the determination step determines whether or not the displayed support center telephone number has been browsed. It may be determined whether the telephone number of the support center has been browsed by acquiring the image being browsed and analyzing the image. Further, it may be determined whether or not the telephone number of the support center has been browsed from the sensor information of the wearable terminal or the sensor information attached to the viewer. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
  • the change step changes the degree of attention so that the telephone number of the support center is changed to viewed when it is determined that the information has been viewed, and the telephone number of the support center is viewed when it is determined that the information is not viewed. .
  • it is possible to visually grasp which support center telephone number has been browsed or not browsed. For example, you can check it by checking the check box of the phone number of the support center. For example, it may be viewed by pressing a stamp on the telephone number of the support center.
  • the attention level may be changed by changing the color / size of the telephone number of the support center or pressing a stamp so that the telephone number of the support center is conspicuous.
  • Detecting step detects an action for the phone number of the displayed support center.
  • the action is, for example, a gesture, a hand movement, a line-of-sight movement, or the like.
  • the action for the telephone number of the support center can be detected by acquiring the image being browsed and analyzing the image. Moreover, you may detect the action with respect to the telephone number of a support center from the sensor information of a wearable terminal, the sensor information with which the viewer was mounted
  • the result corresponding to the action is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board.
  • the display of the telephone number of the support center may be deleted.
  • a result of making a call may be displayed.
  • other actions are possible.
  • the position / direction step acquires the terminal position and the imaging direction of the wearable terminal.
  • the terminal position can be acquired from the GPS (Global Positioning System) of the wearable terminal.
  • the imaging direction can be acquired from a geomagnetic sensor or an acceleration sensor of the wearable terminal when imaging is performed with the wearable terminal. You may acquire from other than these.
  • the estimation step estimates the support target position to be supported based on the terminal position and the imaging direction. If the terminal position and the imaging direction are known, the support target position of the captured support target can be estimated.
  • the support target may be specified from the support target position and the image analysis. For example, even if the support target is the same chain store, there are cases where the phone number of the support center differs depending on the store. For example, if it can be specified that the store is Minato-ku, Tokyo, the phone number of the support center of the Minato-ku, Tokyo can be displayed.
  • the guideline for imaging the support target is displayed as augmented reality on the display board of the wearable terminal.
  • guidelines such as a frame or a cross may be displayed. Image analysis is facilitated by having images taken along the guidelines.
  • an image captured along the guideline may be acquired.
  • the selection accepting step accepts selection of a selection target for a support target that appears through the display panel of the wearable terminal.
  • the selection of the selection target may be accepted by looking at the support target that is seen through the display board of the wearable terminal for a certain period of time.
  • the selection of the selection target may be received by touching the support target that is seen through the display board of the wearable terminal.
  • the selection of the selection target may be received by placing the cursor on the support target that can be seen through the display board of the wearable terminal.
  • a sensor that detects a line of sight a motion sensor, an acceleration sensor, and the like.
  • the telephone number of the support center may be displayed as augmented reality on the display board of the wearable terminal only in accordance with the selection target that can be seen through the display board. Since the telephone number of the support center is displayed as augmented reality according to the selected selection object, the telephone number of the support center can be grasped pinpointly. If the phone number of the support center is displayed on all identified support targets, the screen of the display board may become troublesome.
  • the means and functions described above are realized by a computer (including a CPU, an information processing apparatus, and various terminals) reading and executing a predetermined program.
  • the program may be, for example, an application installed on a computer, or may be in the form of SaaS (software as a service) provided from a computer via a network, for example, a flexible disk, a CD It may be provided in a form recorded on a computer-readable recording medium such as a CD-ROM (DVD-ROM, DVD-RAM, etc.).
  • the computer reads the program from the recording medium, transfers it to the internal storage device or the external storage device, stores it, and executes it.
  • the program may be recorded in advance in a storage device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and provided from the storage device to a computer via a communication line.
  • a nearest neighbor method a naive Bayes method, a decision tree, a support vector machine, reinforcement learning, or the like may be used.
  • deep learning may be used in which a characteristic amount for learning is generated by using a neural network.

Abstract

[Problem] To identify a support target from an image in the field of view of a wearable terminal and to display on a display plate of the wearable terminal, as augmented reality, the phone number of a support center collected corresponding to the support target. [Solution] This wearable terminal display system, for displaying the phone number of a support center of a support target on the display plate of the wearable terminal, is provided with an image acquisition means for acquiring an image of the support target which has entered into the field of view of the wearable terminal, an identifying means which performs an image analysis on the aforementioned image to identify the support target, a collecting means which collects the phone number of a support center of the support target, and a phone number display means which, on the display plate of the wearable terminal, displays the phone number of a support center as augmented reality on the support target visible through the display plate.

Description

ウェアラブル端末表示システム、ウェアラブル端末表示方法およびプログラムWearable terminal display system, wearable terminal display method and program
　本発明は、ウェアラブル端末の表示板に、表示板を透過して見えるサポート対象に対して、収集されたサポート対象のサポートセンターの電話番号を拡張現実として表示するウェアラブル端末表示システム、ウェアラブル端末表示方法およびプログラムに関する。 The present invention relates to a wearable terminal display system and a wearable terminal display method for displaying a collected support center telephone number as an augmented reality for a support object that can be seen through the display board on the display board of the wearable terminal. And program.
　近年、サポートのＩＴ化が進んでいる。例えば、電子機器のトラブル発生時に、ユーザが速やかに対処可能な情報表示システムが提供されている。（特許文献１）。 In recent years, IT support has been developed. For example, there is provided an information display system that allows a user to quickly cope with a trouble in an electronic device. (Patent Document 1).
特開２０１５－１２６２４６号公報Japanese Patent Laying-Open No. 2015-126246
　しかしながら、特許文献１のシステムは、電子機器のトラブル発生時にしかサポートセンターに電話を掛けられない問題がある。 However, the system of Patent Document 1 has a problem that a support center can be called only when an electronic device trouble occurs.
　本発明は、上記課題に鑑み、ウェアラブル端末の視界の画像からサポート対象を特定して、サポート対象に応じて収集したサポートセンターの電話番号をウェアラブル端末の表示板に拡張現実として表示するウェアラブル端末表示システム、ウェアラブル端末表示方法およびプログラムを提供することを目的とする。 In view of the above problems, the present invention identifies a support target from an image of a wearable terminal field of view, and displays the support center telephone number collected according to the support target as an augmented reality display on the display panel of the wearable terminal. It is an object to provide a system, a wearable terminal display method, and a program.
　本発明では、以下のような解決手段を提供する。 The present invention provides the following solutions.
　第１の特徴に係る発明は、ウェアラブル端末の表示板に、サポート対象のサポートセンターの電話番号を表示するウェアラブル端末表示システムであって、ウェアラブル端末の視界に入ったサポート対象の画像を取得する画像取得手段と、前記画像を画像解析して、前記サポート対象を特定する特定手段と、前記サポート対象のサポートセンターの電話番号を収集する収集手段と、前記ウェアラブル端末の表示板に、前記表示板を透過して見える前記サポート対象に対して、前記サポートセンターの電話番号を拡張現実として表示する電話番号表示手段と、を備えるウェアラブル端末表示システムを提供する。 The invention according to the first aspect is a wearable terminal display system for displaying a phone number of a support center to be supported on a display board of the wearable terminal, and an image for acquiring an image of a support target that has entered the field of view of the wearable terminal An acquisition unit; an image analysis unit that analyzes the image to identify the support target; a collection unit that collects a telephone number of the support center to be supported; and a display plate on the display plate of the wearable terminal. Provided is a wearable terminal display system comprising: a telephone number display unit that displays the support center telephone number as an augmented reality for the support object that is transparent.
　第１の特徴に係る発明は、ウェアラブル端末の表示板に、サポート対象のサポートセンターの電話番号を表示するウェアラブル端末表示方法であって、ウェアラブル端末の視界に入ったサポート対象の画像を取得する画像取得ステップと、前記画像を画像解析して、前記サポート対象を特定する特定ステップと、前記サポート対象のサポートセンターの電話番号を収集する収集ステップと、前記ウェアラブル端末の表示板に、前記表示板を透過して見える前記サポート対象に対して、前記サポートセンターの電話番号を拡張現実として表示する電話番号表示ステップと、を備えるウェアラブル端末表示方法を提供する。 The invention according to the first aspect is a wearable terminal display method for displaying a phone number of a support center to be supported on a display board of the wearable terminal, and an image for acquiring a support target image entering the field of view of the wearable terminal An acquisition step; an image analysis of the image to identify the support target; a collection step of collecting telephone numbers of the support center to be supported; and a display board on the display board of the wearable terminal. There is provided a wearable terminal display method comprising: a telephone number display step of displaying the support center telephone number as an augmented reality for the support object that appears transparent.
　第１の特徴に係る発明は、コンピュータに、ウェアラブル端末の視界に入ったサポート対象の画像を取得する画像取得ステップと、前記画像を画像解析して、前記サポート対象を特定する特定ステップと、前記サポート対象のサポートセンターの電話番号を収集する収集ステップと、前記ウェアラブル端末の表示板に、前記表示板を透過して見える前記サポート対象に対して、前記サポートセンターの電話番号を拡張現実として表示する電話番号表示ステップと、をさせるためのプログラムを提供する。 The invention according to the first aspect includes an image acquisition step of acquiring, in a computer, an image of a support target that has entered the field of view of the wearable terminal, a specific step of analyzing the image and specifying the support target, A collecting step of collecting a phone number of a support center to be supported, and displaying the phone number of the support center as an augmented reality on the display board of the wearable terminal with respect to the support object that is seen through the display board A telephone number display step is provided.
　サポート対象をウェアラブル端末の視界に入れるだけで、ウェアラブル端末の表示板にサポート対象のサポートセンターの電話番号を表示できる。 ∙ Just by putting the support target into the field of view of the wearable terminal, the phone number of the support center to be supported can be displayed on the wearable terminal display board.
図１は、ウェアラブル端末表示システムの概要図である。FIG. 1 is a schematic diagram of a wearable terminal display system. 図２は、ウェアラブル端末の表示板にサポート対象のサポートセンターの電話番号を収集して表示した一例である。FIG. 2 is an example in which the telephone numbers of the support centers to be supported are collected and displayed on the display board of the wearable terminal.
　以下、本発明を実施するための最良の形態について説明する。なお、これはあくまでも一例であって、本発明の技術的範囲はこれに限られるものではない。 Hereinafter, the best mode for carrying out the present invention will be described. This is merely an example, and the technical scope of the present invention is not limited to this.
　本発明のウェアラブル端末表示システムは、ウェアラブル端末の表示板に、表示板を透過して見えるサポート対象に対して、収集されたサポートセンターの電話番号を拡張現実として表示するシステムである。ウェアラブル端末とはスマートグラスやヘッドマウントディスプレイなどの視界がある端末のことをいう。 The wearable terminal display system of the present invention is a system that displays the collected support center telephone numbers as augmented reality on the display board of the wearable terminal for a support object that can be seen through the display board. A wearable terminal is a terminal with a field of view, such as a smart glass or a head-mounted display.
　本発明の好適な実施形態の概要について、図１に基づいて説明する。図１は、本発明の好適な実施形態であるウェアラブル端末表示システムの概要図である。 An outline of a preferred embodiment of the present invention will be described with reference to FIG. FIG. 1 is a schematic diagram of a wearable terminal display system which is a preferred embodiment of the present invention.
　図１にあるように、ウェアラブル端末表示システムは、制御部が所定のプログラムを読み込むことで実現される、画像取得手段、特定手段、収集手段、電話番号表示手段、を備える。また図示しないが、同様に、判定手段、変更手段、検出手段、アクション結果表示手段、位置方向取得手段、推測手段、ガイドライン表示手段、選択受付手段、を備えてもよい。これらは、アプリケーション型、クラウド型またはその他であってもよい。上述の各手段が、単独のコンピュータで実現されてもよいし、２台以上のコンピュータ（例えば、サーバと端末のような場合）で実現されてもよい。 As shown in FIG. 1, the wearable terminal display system includes image acquisition means, identification means, collection means, and telephone number display means that are realized by a control unit reading a predetermined program. Although not shown, similarly, determination means, change means, detection means, action result display means, position / direction acquisition means, estimation means, guideline display means, and selection reception means may be provided. These may be application type, cloud type or others. Each means described above may be realized by a single computer or may be realized by two or more computers (for example, a server and a terminal).
　画像取得手段は、ウェアラブル端末の視界に入ったサポート対象の画像を取得する。ウェアラブル端末のカメラで撮像された画像を取得してもよい。または、ウェアラブル端末以外であっても、このような画像を取得できるのであれば、それでも構わない。画像とは動画でも静止画でもよい。リアルタイムにサポートセンターの電話番号を表示するためには、リアルタイムな画像の方が好ましい。 The image acquisition means acquires a supported image that has entered the field of view of the wearable terminal. You may acquire the image imaged with the camera of the wearable terminal. Or even if it is other than a wearable terminal, as long as such an image can be acquired, it does not matter. The image may be a moving image or a still image. In order to display the telephone number of the support center in real time, a real-time image is preferable.
　特定手段は、画像を画像解析してサポート対象を特定する。例えば、サポート対象が、ＪＣＢクレジットカードであるのか、ｉＰｈｏｎｅであるのか、週刊少年ジャンプであるのか、などを特定する。外観、色、形、大きさ、マーク、などからサポート対象を特定できる。サポート対象はこれらに限らない。また、映ったサポート対象の全てを特定してしまうと時間が掛かる場合には、ウェアラブル端末の視界の中央にあるサポート対象だけを特定してもよい。視界の中央にあるサポート対象だけを特定することで、特定に要する時間を大幅に短縮できる。機械学習によって画像解析の精度を向上させてもよい。例えば、サポート対象の過去画像を教師データとして機械学習を行う。 The identification means identifies the support target by analyzing the image. For example, it is specified whether the support target is a JCB credit card, iPhone, or Weekly Shonen Jump. Support target can be specified from appearance, color, shape, size, mark, etc. The support target is not limited to these. Further, if it takes time to specify all the supported support targets, only the support target at the center of the field of view of the wearable terminal may be specified. By identifying only the support target in the center of the field of view, the time required for identification can be greatly reduced. The accuracy of image analysis may be improved by machine learning. For example, machine learning is performed using a past image to be supported as teacher data.
　収集手段は、サポート対象に応じたサポートセンターの電話番号を収集する。予めサポートセンターの電話番号が登録されたデータベースを参照してサポート対象に応じたサポートセンターの電話番号を収集してもよい。また、サポート対象に予め紐付けられたＷｅｂコンテンツにアクセスしてサポートセンターの電話番号を収集してもよい。例えば、サポート対象とサポートセンターの電話番号とを紐づけるＵＲＬなど割当てることでＷｅｂコンテンツから収取できる。また、サポート対象をインターネット検索して検索されたＷｅｂコンテンツからサポートセンターの電話番号を収集してもよい。例えば、サポート対象のホームページにサポートセンターの電話番号が掲載されているケースがあるので、インターネット検索から収集できる。または、ＳＮＳ（ｓｏｃｉａｌ　ｎｅｔｗｏｒｋｉｎｇ　ｓｅｒｖｉｃｅ）や口コミサイトなどから、サポートセンターの電話番号を収集できることもある。 Collecting means collects the telephone number of the support center according to the support target. The support center telephone numbers corresponding to the support target may be collected with reference to a database in which the support center telephone numbers are registered in advance. Further, the telephone number of the support center may be collected by accessing Web contents linked in advance to the support target. For example, the URL can be collected from the Web content by assigning a URL that links the support target and the telephone number of the support center. Further, the telephone number of the support center may be collected from the Web content searched by searching the support target on the Internet. For example, there are cases where the telephone number of the support center is posted on the homepage to be supported, and it can be collected from the Internet search. Alternatively, the support center telephone number may be collected from an SNS (social networking service) or a word-of-mouth site.
　電話番号表示手段は、ウェアラブル端末の表示板に、表示板を透過して見えるサポート対象に対してサポートセンターの電話番号を拡張現実として表示する。例えば図２にあるように、ウェアラブル端末の表示板に、表示板を透過して見える実線で描かれたサポート対象に対して、破線で描かれたサポートセンターの電話番号を拡張現実として表示している。ここでは理解のために、実線は実物、破線は拡張現実、としている。表示板を透過して見える実線で描かれたサポート対象に対してサポートセンターの電話番号を拡張現実で表示することで、サポート対象にどのようなサポートセンターの電話番号があるのかを視覚的に把握することが出来る。拡張現実として表示するサポートセンターの電話番号は、表示板を透過して見えるサポート対象に重なるように表示しても良いが、サポート対象が見づらくなるので、サポートセンターの電話番号の表示ＯＮ／ＯＦＦを切り替えられるようにしてもよい。 The telephone number display means displays the telephone number of the support center as augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board. For example, as shown in FIG. 2, the phone number of the support center drawn with a broken line is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target drawn with a solid line that can be seen through the display board. Yes. Here, for the sake of understanding, the solid line is the real thing, and the broken line is the augmented reality. By displaying the support center phone number in the augmented reality for the support target drawn with a solid line that can be seen through the display board, it is possible to visually grasp what kind of support center phone number the support target has I can do it. The phone number of the support center displayed as augmented reality may be displayed so as to overlap the support target that can be seen through the display board, but it becomes difficult to see the support target. You may make it switch.
　判定手段は、表示されたサポートセンターの電話番号が閲覧されたかどうかを判定する。閲覧中の画像を取得して画像解析をすることで、サポートセンターの電話番号が閲覧されたかどうかを判定してもよい。また、ウェアラブル端末のセンサ情報や、閲覧者に装着されたセンサ情報などから、サポートセンターの電話番号が閲覧されたかどうかを判定してもよい。例えば、視線を検知するセンサ、モーションセンサ、加速度センサなど。 The judging means judges whether or not the displayed telephone number of the support center has been browsed. It may be determined whether the telephone number of the support center has been browsed by acquiring the image being browsed and analyzing the image. Further, it may be determined whether or not the telephone number of the support center has been browsed from the sensor information of the wearable terminal or the sensor information attached to the viewer. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
　変更手段は、閲覧されたと判定された場合はサポートセンターの電話番号を閲覧済みに変更し、閲覧されていないと判定された場合はサポートセンターの電話番号が閲覧されるように注目度を変更する。このようにすることで、どのサポートセンターの電話番号が、閲覧されたのか、閲覧されていないのか、を視覚的に把握できる。例えば、サポートセンターの電話番号のチェックボックスにチェックを入れることで閲覧済とてもよい。例えば、サポートセンターの電話番号にスタンプを押すことで閲覧済としてもよい。また、注目度の変更は、サポートセンターの電話番号の色・サイズを変更したり、サポートセンターの電話番号が目立つようにスタンプを押したりしてもよい。 The change means changes the attention level so that the phone number of the support center is changed to browsed when it is determined that it has been browsed, and the phone number of the support center is browsed when it is determined that it has not been browsed. . By doing so, it is possible to visually grasp which support center telephone number has been browsed or not browsed. For example, you can check it by checking the check box of the phone number of the support center. For example, it may be viewed by pressing a stamp on the telephone number of the support center. Further, the attention level may be changed by changing the color / size of the telephone number of the support center or pressing a stamp so that the telephone number of the support center is conspicuous.
　検出手段は、表示されたサポートセンターの電話番号に対するアクションを検出する。アクションは、例えば、ジェスチャーや、手の動き、視線の動き、などである。閲覧中の画像を取得して画像解析をすることで、サポートセンターの電話番号に対するアクションを検出できる。また、ウェアラブル端末のセンサ情報や、閲覧者に装着されたセンサ情報などから、サポートセンターの電話番号に対するアクションを検出してもよい。例えば、視線を検知するセンサ、モーションセンサ、加速度センサなど。 Detecting means detects an action for the phone number of the displayed support center. The action is, for example, a gesture, a hand movement, a line-of-sight movement, or the like. The action for the telephone number of the support center can be detected by acquiring the image being browsed and analyzing the image. Moreover, you may detect the action with respect to the telephone number of a support center from the sensor information of a wearable terminal, the sensor information with which the viewer was mounted | worn. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
　アクション結果表示手段は、ウェアラブル端末の表示板に、表示板を透過して見えるサポート対象に対して、アクションに応じた結果を拡張現実として表示する。例えば、サポートセンターの電話番号を消すアクションを検出したらサポートセンターの電話番号の表示を消してよい。例えば、サポートセンターの電話番号に電話を掛けるアクションを検出したら電話を掛けた結果（発信中など）を表示してもよい。もちろん他のアクションでもよい。 The action result display means displays the result corresponding to the action as an augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board. For example, when an action for deleting the telephone number of the support center is detected, the display of the telephone number of the support center may be deleted. For example, when an action to make a call to a support center telephone number is detected, a result of making a call (during outgoing call etc.) may be displayed. Of course, other actions are possible.
　位置方向手段は、ウェアラブル端末の端末位置と撮像方向とを取得する。例えば、端末位置は、ウェアラブル端末のＧＰＳ（Ｇｌｏｂａｌ　Ｐｏｓｉｔｉｏｎｉｎｇ　Ｓｙｓｔｅｍ）から取得できる。例えば、撮像方向は、ウェアラブル端末で撮像する場合は、ウェアラブル端末の地磁気センサや加速度センサから取得できる。これら以外から取得してもよい。 The position direction means acquires the terminal position and the imaging direction of the wearable terminal. For example, the terminal position can be acquired from the GPS (Global Positioning System) of the wearable terminal. For example, the imaging direction can be acquired from a geomagnetic sensor or an acceleration sensor of the wearable terminal when imaging is performed with the wearable terminal. You may acquire from other than these.
　推測手段は、端末位置と撮像方向とに基づいて、サポート対象のサポート対象位置を推測する。端末位置と撮像方向が分かっていれば、撮像されたサポート対象のサポート対象位置を推測することができる。 The estimation means estimates the support target position to be supported based on the terminal position and the imaging direction. If the terminal position and the imaging direction are known, the support target position of the captured support target can be estimated.
　また、特定手段は、サポート対象位置と画像解析とから、サポート対象を特定してもよい。例えば、同じチェーン店のサポート対象であっても、店舗によってサポートセンターの電話番号が異なるケースもあるので、サポート対象位置を推測しないと一意的に特定できないことがある。例えば、東京都港区店であると特定できれば、東京都港区店のサポートセンターの電話番号を表示できる。 Further, the specifying means may specify the support target from the support target position and the image analysis. For example, even if the support target is the same chain store, there are cases where the phone number of the support center differs depending on the store. For example, if it can be specified that the store is Minato-ku, Tokyo, the phone number of the support center of the Minato-ku, Tokyo can be displayed.
　ガイドライン表示手段は、ウェアラブル端末の表示板に、サポート対象を撮像するためのガイドラインを拡張現実として表示する。例えば、枠や十字などのガイドラインを表示してもよい。ガイドラインに沿って撮像してもらうことで画像解析がしやすくなる。 The guideline display means displays the guideline for imaging the support target as augmented reality on the display board of the wearable terminal. For example, guidelines such as a frame or a cross may be displayed. Image analysis is facilitated by having images taken along the guidelines.
　また、取得手段は、ガイドラインに沿って撮像された画像を取得してもよい。ガイドラインに沿って撮像された画像だけを取得して画像解析することで、効率良くサポート対象を特定できる。 Further, the acquisition unit may acquire an image taken along the guideline. By acquiring only images captured along the guidelines and analyzing the images, it is possible to efficiently identify the support target.
　選択受付手段は、ウェアラブル端末の表示板を透過して見えるサポート対象に対して、選択対象の選択を受け付ける。例えば、ウェアラブル端末の表示板を透過して見えるサポート対象を一定時間見ることで選択対象の選択を受け付けてもよい。例えば、ウェアラブル端末の表示板を透過して見えるサポート対象にタッチして選択対象の選択を受け付けてもよい。例えば、ウェアラブル端末の表示板を透過して見えるサポート対象にカーソルを合わせることで選択対象の選択を受け付けてもよい。例えば、視線を検知するセンサ、モーションセンサ、加速度センサなど。 The selection accepting unit accepts selection of a selection target for a support target that is seen through the display board of the wearable terminal. For example, the selection of the selection target may be accepted by looking at the support target that is seen through the display board of the wearable terminal for a certain period of time. For example, the selection of the selection target may be received by touching the support target that is seen through the display board of the wearable terminal. For example, the selection of the selection target may be received by placing the cursor on the support target that can be seen through the display board of the wearable terminal. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
　また、電話番号表示手段は、ウェアラブル端末の表示板に、表示板を透過して見える選択対象にだけ合わせて、サポートセンターの電話番号を拡張現実として表示してもよい。選択された選択対象にだけ合わせてサポートセンターの電話番号を拡張現実として表示するので、ピンポイントにサポートセンターの電話番号を把握することができる。特定された全てのサポート対象にサポートセンターの電話番号を表示すると表示板の画面が煩わしくなることがある。 Further, the telephone number display means may display the telephone number of the support center as augmented reality on the display board of the wearable terminal only in accordance with the selection target that can be seen through the display board. Since the telephone number of the support center is displayed as augmented reality according to the selected selection object, the telephone number of the support center can be grasped pinpointly. If the phone number of the support center is displayed on all identified support targets, the screen of the display board may become troublesome.
[動作の説明]
　次に、ウェアラブル端末表示方法について説明する。本発明のウェアラブル端末表示方法は、ウェアラブル端末の表示板に、表示板を透過して見えるサポート対象に対して、収集されたサポートセンターの電話番号を拡張現実として表示する方法である。 [Description of operation]
Next, a wearable terminal display method will be described. The wearable terminal display method of the present invention is a method of displaying the collected telephone numbers of the support center as augmented reality on the display board of the wearable terminal with respect to the support object that can be seen through the display board.
　ウェアラブル端末表示方法は、画像取得ステップ、特定ステップ、収集ステップ、電話番号表示ステップ、を備える。また図示しないが、同様に、判定ステップ、変更ステップ、検出ステップ、アクション結果表示ステップ、位置方向取得ステップ、推測ステップ、ガイドライン表示ステップ、選択受付ステップ、を備えてもよい。 The wearable terminal display method includes an image acquisition step, a specific step, a collection step, and a telephone number display step. Although not shown, similarly, a determination step, a change step, a detection step, an action result display step, a position / direction acquisition step, an estimation step, a guideline display step, and a selection reception step may be provided.
　画像取得ステップは、ウェアラブル端末の視界に入ったサポート対象の画像を取得する。ウェアラブル端末のカメラで撮像された画像を取得してもよい。または、ウェアラブル端末以外であっても、このような画像を取得できるのであれば、それでも構わない。画像とは動画でも静止画でもよい。リアルタイムにサポートセンターの電話番号を表示するためには、リアルタイムな画像の方が好ましい。 In the image acquisition step, the support target image that has entered the field of view of the wearable terminal is acquired. You may acquire the image imaged with the camera of the wearable terminal. Or even if it is other than a wearable terminal, as long as such an image can be acquired, it does not matter. The image may be a moving image or a still image. In order to display the telephone number of the support center in real time, a real-time image is preferable.
　特定ステップは、画像を画像解析してサポート対象を特定する。例えば、サポート対象が、ＪＣＢクレジットカードであるのか、ｉＰｈｏｎｅであるのか、週刊少年ジャンプであるのか、などを特定する。外観、色、形、大きさ、マーク、などからサポート対象を特定できる。サポート対象はこれらに限らない。また、映ったサポート対象の全てを特定してしまうと時間が掛かる場合には、ウェアラブル端末の視界の中央にあるサポート対象だけを特定してもよい。視界の中央にあるサポート対象だけを特定することで、特定に要する時間を大幅に短縮できる。機械学習によって画像解析の精度を向上させてもよい。例えば、サポート対象の過去画像を教師データとして機械学習を行う。 In the specifying step, the support target is specified by analyzing the image. For example, it is specified whether the support target is a JCB credit card, iPhone, or Weekly Shonen Jump. Support target can be specified from appearance, color, shape, size, mark, etc. The support target is not limited to these. Further, if it takes time to specify all the supported support targets, only the support target at the center of the field of view of the wearable terminal may be specified. By identifying only the support target in the center of the field of view, the time required for identification can be greatly reduced. The accuracy of image analysis may be improved by machine learning. For example, machine learning is performed using a past image to be supported as teacher data.
　収集ステップは、サポート対象に応じたサポートセンターの電話番号を収集する。予めサポートセンターの電話番号が登録されたデータベースを参照してサポート対象に応じたサポートセンターの電話番号を収集してもよい。また、サポート対象に予め紐付けられたＷｅｂコンテンツにアクセスしてサポートセンターの電話番号を収集してもよい。例えば、サポート対象とサポートセンターの電話番号とを紐づけるＵＲＬなど割当てることでＷｅｂコンテンツから収取できる。また、サポート対象をインターネット検索して検索されたＷｅｂコンテンツからサポートセンターの電話番号を収集してもよい。例えば、サポート対象のホームページにサポートセンターの電話番号が掲載されているケースがあるので、インターネット検索から収集できる。または、ＳＮＳ（ｓｏｃｉａｌ　ｎｅｔｗｏｒｋｉｎｇ　ｓｅｒｖｉｃｅ）や口コミサイトなどから、サポートセンターの電話番号を収集できることもある。 In the collecting step, the telephone number of the support center corresponding to the support target is collected. The support center telephone numbers corresponding to the support target may be collected with reference to a database in which the support center telephone numbers are registered in advance. Further, the telephone number of the support center may be collected by accessing Web contents linked in advance to the support target. For example, the URL can be collected from the Web content by assigning a URL that links the support target and the telephone number of the support center. Further, the telephone number of the support center may be collected from the Web content searched by searching the support target on the Internet. For example, there are cases where the telephone number of the support center is posted on the homepage to be supported, and it can be collected from the Internet search. Alternatively, the support center telephone number may be collected from an SNS (social networking service) or a word-of-mouth site.
　電話番号表示ステップは、ウェアラブル端末の表示板に、表示板を透過して見えるサポート対象に対してサポートセンターの電話番号を拡張現実として表示する。例えば図２にあるように、ウェアラブル端末の表示板に、表示板を透過して見える実線で描かれたサポート対象に対して、破線で描かれたサポートセンターの電話番号を拡張現実として表示している。ここでは理解のために、実線は実物、破線は拡張現実、としている。表示板を透過して見える実線で描かれたサポート対象に対してサポートセンターの電話番号を拡張現実で表示することで、サポート対象にどのようなサポートセンターの電話番号があるのかを視覚的に把握することが出来る。拡張現実として表示するサポートセンターの電話番号は、表示板を透過して見えるサポート対象に重なるように表示しても良いが、サポート対象が見づらくなるので、サポートセンターの電話番号の表示ＯＮ／ＯＦＦを切り替えられるようにしてもよい。 In the phone number display step, the phone number of the support center is displayed on the display board of the wearable terminal as an augmented reality with respect to the support object that can be seen through the display board. For example, as shown in FIG. 2, the phone number of the support center drawn with a broken line is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target drawn with a solid line that can be seen through the display board. Yes. Here, for the sake of understanding, the solid line is the real thing, and the broken line is the augmented reality. By displaying the support center phone number in the augmented reality for the support target drawn with a solid line that can be seen through the display board, it is possible to visually grasp what kind of support center phone number the support target has I can do it. The phone number of the support center displayed as augmented reality may be displayed so as to overlap the support target that can be seen through the display board, but it becomes difficult to see the support target. You may make it switch.
　判定ステップは、表示されたサポートセンターの電話番号が閲覧されたかどうかを判定する。閲覧中の画像を取得して画像解析をすることで、サポートセンターの電話番号が閲覧されたかどうかを判定してもよい。また、ウェアラブル端末のセンサ情報や、閲覧者に装着されたセンサ情報などから、サポートセンターの電話番号が閲覧されたかどうかを判定してもよい。例えば、視線を検知するセンサ、モーションセンサ、加速度センサなど。 The determination step determines whether or not the displayed support center telephone number has been browsed. It may be determined whether the telephone number of the support center has been browsed by acquiring the image being browsed and analyzing the image. Further, it may be determined whether or not the telephone number of the support center has been browsed from the sensor information of the wearable terminal or the sensor information attached to the viewer. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
　変更ステップは、閲覧されたと判定された場合はサポートセンターの電話番号を閲覧済みに変更し、閲覧されていないと判定された場合はサポートセンターの電話番号が閲覧されるように注目度を変更する。このようにすることで、どのサポートセンターの電話番号が、閲覧されたのか、閲覧されていないのか、を視覚的に把握できる。例えば、サポートセンターの電話番号のチェックボックスにチェックを入れることで閲覧済とてもよい。例えば、サポートセンターの電話番号にスタンプを押すことで閲覧済としてもよい。また、注目度の変更は、サポートセンターの電話番号の色・サイズを変更したり、サポートセンターの電話番号が目立つようにスタンプを押したりしてもよい。 The change step changes the degree of attention so that the telephone number of the support center is changed to viewed when it is determined that the information has been viewed, and the telephone number of the support center is viewed when it is determined that the information is not viewed. . In this way, it is possible to visually grasp which support center telephone number has been browsed or not browsed. For example, you can check it by checking the check box of the phone number of the support center. For example, it may be viewed by pressing a stamp on the telephone number of the support center. Further, the attention level may be changed by changing the color / size of the telephone number of the support center or pressing a stamp so that the telephone number of the support center is conspicuous.
　検出ステップは、表示されたサポートセンターの電話番号に対するアクションを検出する。アクションは、例えば、ジェスチャーや、手の動き、視線の動き、などである。閲覧中の画像を取得して画像解析をすることで、サポートセンターの電話番号に対するアクションを検出できる。また、ウェアラブル端末のセンサ情報や、閲覧者に装着されたセンサ情報などから、サポートセンターの電話番号に対するアクションを検出してもよい。例えば、視線を検知するセンサ、モーションセンサ、加速度センサなど。 Detecting step detects an action for the phone number of the displayed support center. The action is, for example, a gesture, a hand movement, a line-of-sight movement, or the like. The action for the telephone number of the support center can be detected by acquiring the image being browsed and analyzing the image. Moreover, you may detect the action with respect to the telephone number of a support center from the sensor information of a wearable terminal, the sensor information with which the viewer was mounted | worn. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
　アクション結果表示ステップは、ウェアラブル端末の表示板に、表示板を透過して見えるサポート対象に対して、アクションに応じた結果を拡張現実として表示する。例えば、サポートセンターの電話番号を消すアクションを検出したらサポートセンターの電話番号の表示を消してよい。例えば、サポートセンターの電話番号に電話を掛けるアクションを検出したら電話を掛けた結果（発信中など）を表示してもよい。もちろん他のアクションでもよい。 In the action result display step, the result corresponding to the action is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board. For example, when an action for deleting the telephone number of the support center is detected, the display of the telephone number of the support center may be deleted. For example, when an action to make a call to a support center telephone number is detected, a result of making a call (during outgoing call etc.) may be displayed. Of course, other actions are possible.
　位置方向ステップは、ウェアラブル端末の端末位置と撮像方向とを取得する。例えば、端末位置は、ウェアラブル端末のＧＰＳ（Ｇｌｏｂａｌ　Ｐｏｓｉｔｉｏｎｉｎｇ　Ｓｙｓｔｅｍ）から取得できる。例えば、撮像方向は、ウェアラブル端末で撮像する場合は、ウェアラブル端末の地磁気センサや加速度センサから取得できる。これら以外から取得してもよい。 The position / direction step acquires the terminal position and the imaging direction of the wearable terminal. For example, the terminal position can be acquired from the GPS (Global Positioning System) of the wearable terminal. For example, the imaging direction can be acquired from a geomagnetic sensor or an acceleration sensor of the wearable terminal when imaging is performed with the wearable terminal. You may acquire from other than these.
　推測ステップは、端末位置と撮像方向とに基づいて、サポート対象のサポ―ト対象位置を推測する。端末位置と撮像方向が分かっていれば、撮像されたサポート対象のサポート対象位置を推測することができる。 The estimation step estimates the support target position to be supported based on the terminal position and the imaging direction. If the terminal position and the imaging direction are known, the support target position of the captured support target can be estimated.
　また、特定ステップは、サポート対象位置と画像解析とから、サポート対象を特定してもよい。例えば、同じチェーン店のサポート対象であっても、店舗によってサポートセンターの電話番号が異なるケースもあるので、サポート対象位置を推測しないと一意的に特定できないことがある。例えば、東京都港区店であると特定できれば、東京都港区店のサポートセンターの電話番号を表示できる。 In the specifying step, the support target may be specified from the support target position and the image analysis. For example, even if the support target is the same chain store, there are cases where the phone number of the support center differs depending on the store. For example, if it can be specified that the store is Minato-ku, Tokyo, the phone number of the support center of the Minato-ku, Tokyo can be displayed.
　ガイドライン表示ステップは、ウェアラブル端末の表示板に、サポート対象を撮像するためのガイドラインを拡張現実として表示する。例えば、枠や十字などのガイドラインを表示してもよい。ガイドラインに沿って撮像してもらうことで画像解析がしやすくなる。 In the guideline display step, the guideline for imaging the support target is displayed as augmented reality on the display board of the wearable terminal. For example, guidelines such as a frame or a cross may be displayed. Image analysis is facilitated by having images taken along the guidelines.
　また、取得ステップは、ガイドラインに沿って撮像された画像を取得してもよい。ガイドラインに沿って撮像された画像だけを取得して画像解析することで、効率良くサポート対象を特定できる。 In addition, in the acquisition step, an image captured along the guideline may be acquired. By acquiring only images captured along the guidelines and analyzing the images, it is possible to efficiently identify the support target.
　選択受付ステップは、ウェアラブル端末の表示板を透過して見えるサポート対象に対して、選択対象の選択を受け付ける。例えば、ウェアラブル端末の表示板を透過して見えるサポート対象を一定時間見ることで選択対象の選択を受け付けてもよい。例えば、ウェアラブル端末の表示板を透過して見えるサポート対象にタッチして選択対象の選択を受け付けてもよい。例えば、ウェアラブル端末の表示板を透過して見えるサポート対象にカーソルを合わせることで選択対象の選択を受け付けてもよい。例えば、視線を検知するセンサ、モーションセンサ、加速度センサなど。 The selection accepting step accepts selection of a selection target for a support target that appears through the display panel of the wearable terminal. For example, the selection of the selection target may be accepted by looking at the support target that is seen through the display board of the wearable terminal for a certain period of time. For example, the selection of the selection target may be received by touching the support target that is seen through the display board of the wearable terminal. For example, the selection of the selection target may be received by placing the cursor on the support target that can be seen through the display board of the wearable terminal. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
　また、電話番号表示ステップは、ウェアラブル端末の表示板に、表示板を透過して見える選択対象にだけ合わせて、サポートセンターの電話番号を拡張現実として表示してもよい。選択された選択対象にだけ合わせてサポートセンターの電話番号を拡張現実として表示するので、ピンポイントにサポートセンターの電話番号を把握することができる。特定された全てのサポート対象にサポートセンターの電話番号を表示すると表示板の画面が煩わしくなることがある。 In the telephone number display step, the telephone number of the support center may be displayed as augmented reality on the display board of the wearable terminal only in accordance with the selection target that can be seen through the display board. Since the telephone number of the support center is displayed as augmented reality according to the selected selection object, the telephone number of the support center can be grasped pinpointly. If the phone number of the support center is displayed on all identified support targets, the screen of the display board may become troublesome.
　上述した手段、機能は、コンピュータ（ＣＰＵ、情報処理装置、各種端末を含む）が、所定のプログラムを読み込んで、実行することによって実現される。プログラムは、例えば、コンピュータにインストールされるアプリケーションであってもよいし、コンピュータからネットワーク経由で提供されるＳａａＳ（ソフトウェア・アズ・ア・サービス）形態であってもよいし、例えば、フレキシブルディスク、ＣＤ（ＣＤ－ＲＯＭなど）、ＤＶＤ（ＤＶＤ－ＲＯＭ、ＤＶＤ－ＲＡＭなど）等のコンピュータ読取可能な記録媒体に記録された形態で提供されてもよい。この場合、コンピュータはその記録媒体からプログラムを読み取って内部記憶装置または外部記憶装置に転送し記憶して実行する。また、そのプログラムを、例えば、磁気ディスク、光ディスク、光磁気ディスク等の記憶装置（記録媒体）に予め記録しておき、その記憶装置から通信回線を介してコンピュータに提供するようにしてもよい。 The means and functions described above are realized by a computer (including a CPU, an information processing apparatus, and various terminals) reading and executing a predetermined program. The program may be, for example, an application installed on a computer, or may be in the form of SaaS (software as a service) provided from a computer via a network, for example, a flexible disk, a CD It may be provided in a form recorded on a computer-readable recording medium such as a CD-ROM (DVD-ROM, DVD-RAM, etc.). In this case, the computer reads the program from the recording medium, transfers it to the internal storage device or the external storage device, stores it, and executes it. The program may be recorded in advance in a storage device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and provided from the storage device to a computer via a communication line.
　上述した機械学習の具体的なアルゴリズムとしては、最近傍法、ナイーブベイズ法、決定木、サポートベクターマシン、強化学習などを利用してよい。また、ニューラルネットワークを利用して、学習するための特徴量を自ら生成する深層学習（ディープラーニング）であってもよい。 As a specific algorithm for the machine learning described above, a nearest neighbor method, a naive Bayes method, a decision tree, a support vector machine, reinforcement learning, or the like may be used. Further, deep learning may be used in which a characteristic amount for learning is generated by using a neural network.
　以上、本発明の実施形態について説明したが、本発明は上述したこれらの実施形態に限るものではない。また、本発明の実施形態に記載された効果は、本発明から生じる最も好適な効果を列挙したに過ぎず、本発明による効果は、本発明の実施形態に記載されたものに限定されるものではない。

  As mentioned above, although embodiment of this invention was described, this invention is not limited to these embodiment mentioned above. The effects described in the embodiments of the present invention are only the most preferable effects resulting from the present invention, and the effects of the present invention are limited to those described in the embodiments of the present invention. is not.

Claims (13)

  1. 　ウェアラブル端末の表示板に、サポート対象のサポートセンターの電話番号を表示するウェアラブル端末表示システムであって、
    　ウェアラブル端末の視界に入ったサポート対象の画像を取得する画像取得手段と、
    　前記画像を画像解析して、前記サポート対象を特定する特定手段と、
    　前記サポート対象のサポートセンターの電話番号を収集する収集手段と、
    　前記ウェアラブル端末の表示板に、前記表示板を透過して見える前記サポート対象に対して、前記サポートセンターの電話番号を拡張現実として表示する電話番号表示手段と、
    を備えるウェアラブル端末表示システム。     A wearable terminal display system that displays a phone number of a support center to be supported on a display panel of a wearable terminal,
    Image acquisition means for acquiring an image of a support target that has entered the field of view of the wearable terminal;
    A means for analyzing the image and identifying the support target;
    A collecting means for collecting a telephone number of the support center to be supported;
    Phone number display means for displaying the phone number of the support center as augmented reality for the support object seen through the display board on the display board of the wearable terminal;
    A wearable terminal display system.
  2. 　前記特定手段は、前記ウェアラブル端末の視界の中央にあるサポート対象だけを特定する請求項１に記載のウェアラブル端末表示システム。 The wearable terminal display system according to claim 1, wherein the specifying unit specifies only a support target in the center of the field of view of the wearable terminal.
  3. 　前記収集手段は、予めサポートセンターの電話番号が登録されたデータベースを参照して、前記サポート対象のサポートセンターの電話番号を収集する請求項１に記載のウェアラブル端末表示システム。 The wearable terminal display system according to claim 1, wherein the collection means collects the support center telephone numbers with reference to a database in which support center telephone numbers are registered in advance.
  4. 　前記収集手段は、前記サポート対象に予め紐付けられたＷｅｂコンテンツにアクセスして、前記サポートセンターの電話番号を収集する請求項１に記載のウェアラブル端末表示システム。 The wearable terminal display system according to claim 1, wherein the collection unit accesses a Web content linked in advance to the support target and collects the telephone number of the support center.
  5. 　前記収集手段は、前記サポート対象をインターネット検索して、検索されたＷｅｂコンテンツから前記サポートセンターの電話番号を収集する請求項１に記載のウェアラブル端末表示システム。 The wearable terminal display system according to claim 1, wherein the collection unit searches the support target on the Internet and collects the telephone number of the support center from the searched Web content.
  6. 　前記表示されたサポートセンターの電話番号が閲覧されたかどうかを判定する判定手段と、
    　前記閲覧されたと判定された場合、サポートセンターの電話番号を閲覧済みに変更する変更手段と、を備える請求項１に記載のウェアラブル端末表示システム。     Determining means for determining whether or not the displayed telephone number of the support center has been viewed;
    The wearable terminal display system according to claim 1, further comprising: a changing unit that changes the telephone number of the support center to “read” when it is determined that the browsing has been performed.
  7. 　前記表示されたサポートセンターの電話番号が閲覧されたかどうかを判定する判定手段と、
    　前記閲覧されていないと判定された場合、サポートセンターの電話番号が閲覧されるように注目度を変更する変更手段と、を備える請求項１に記載のウェアラブル端末表示システム。     Determining means for determining whether or not the displayed telephone number of the support center has been viewed;
    The wearable terminal display system according to claim 1, further comprising a changing unit that changes a degree of attention so that a telephone number of a support center is browsed when it is determined that the browsing is not performed.
  8. 　前記表示されたサポートセンターの電話番号に対するアクションを検出する検出手段と、
    　前記ウェアラブル端末の表示板に、前記表示板を透過して見える前記サポート対象に対して、前記アクションに応じた結果を拡張現実として表示するアクション結果表示手段と、を備える請求項１に記載のウェアラブル端末表示システム。     Detecting means for detecting an action for the displayed support center telephone number;
    The wearable according to claim 1, further comprising: an action result display unit configured to display a result corresponding to the action as an augmented reality on the display board of the wearable terminal with respect to the support target that is seen through the display board. Terminal display system.
  9. 　前記ウェアラブル端末の、端末位置と撮像方向と、を取得する位置方向取得手段と、
    　前記端末位置と前記撮像方向とに基づいて、前記サポート対象のサポート対象位置を推測する推測手段と、
    を備え、
    　前記特定手段は、前記サポート対象位置と前記画像解析とから、前記サポート対象を特定する請求項１に記載のウェアラブル端末表示システム。     Position and direction acquisition means for acquiring a terminal position and an imaging direction of the wearable terminal;
    Based on the terminal position and the imaging direction, an estimation unit that estimates the support target position of the support target;
    With
    The wearable terminal display system according to claim 1, wherein the specifying unit specifies the support target from the support target position and the image analysis.
  10. 　前記ウェアラブル端末の表示板に、前記サポート対象を撮像するためのガイドラインを拡張現実として表示するガイドライン表示手段を備え、
    　前記取得手段は、前記ガイドラインに沿って撮像された前記画像を取得する請求項１に記載のウェアラブル端末表示システム。     Guideline display means for displaying a guideline for imaging the support target as augmented reality on a display board of the wearable terminal,
    The wearable terminal display system according to claim 1, wherein the acquisition unit acquires the image captured along the guideline.
  11. 　前記ウェアラブル端末の表示板を透過して見える前記サポート対象に対して、選択対象の選択を受け付ける選択受付手段を備え、
    　前記電話番号表示手段は、前記ウェアラブル端末の表示板に、前記表示板を透過して見える前記選択対象にだけ合わせて、前記サポートセンターの電話番号を拡張現実として表示する請求項１に記載のウェアラブル端末表示システム。     A selection accepting unit that accepts selection of a selection target for the support target that is seen through the display board of the wearable terminal,
    2. The wearable according to claim 1, wherein the telephone number display means displays the telephone number of the support center as an augmented reality on the display board of the wearable terminal only in accordance with the selection target that can be seen through the display board. Terminal display system.
  12. 　ウェアラブル端末の表示板に、サポート対象のサポートセンターの電話番号を表示するウェアラブル端末表示方法であって、
    　ウェアラブル端末の視界に入ったサポート対象の画像を取得する画像取得ステップと、
    　前記画像を画像解析して、前記サポート対象を特定する特定ステップと、
    　前記サポート対象のサポートセンターの電話番号を収集する収集ステップと、
    　前記ウェアラブル端末の表示板に、前記表示板を透過して見える前記サポート対象に対して、前記サポートセンターの電話番号を拡張現実として表示する電話番号表示ステップと、を備えるウェアラブル端末表示方法。     A wearable terminal display method for displaying a phone number of a support center to be supported on a display panel of a wearable terminal,
    An image acquisition step for acquiring a supported image that has entered the field of view of the wearable device;
    A specific step of analyzing the image and specifying the support target;
    A collecting step of collecting telephone numbers of the supported support centers;
    A wearable terminal display method comprising: a phone number display step of displaying a phone number of the support center as an augmented reality on the display board of the wearable terminal with respect to the support object that can be seen through the display board.
  13. 　コンピュータに、
    　ウェアラブル端末の視界に入ったサポート対象の画像を取得する画像取得ステップと、
    　前記画像を画像解析して、前記サポート対象を特定する特定ステップと、
    　前記サポート対象のサポートセンターの電話番号を収集する収集ステップと、
    　前記ウェアラブル端末の表示板に、前記表示板を透過して見える前記サポート対象に対して、前記サポートセンターの電話番号を拡張現実として表示する電話番号表示ステップと、を実行させるためのプログラム。
          On the computer,
    An image acquisition step for acquiring a supported image that has entered the field of view of the wearable device;
    A specific step of analyzing the image and specifying the support target;
    A collecting step of collecting telephone numbers of the supported support centers;
    A program for causing the display board of the wearable terminal to execute a telephone number display step of displaying the telephone number of the support center as an augmented reality with respect to the support object that can be seen through the display board.
PCT/JP2017/019809 2017-05-26 2017-05-26 Wearable terminal display system, wearable terminal display method and program WO2018216221A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/019809 WO2018216221A1 (en) 2017-05-26 2017-05-26 Wearable terminal display system, wearable terminal display method and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/019809 WO2018216221A1 (en) 2017-05-26 2017-05-26 Wearable terminal display system, wearable terminal display method and program

Publications (1)

Publication Number Publication Date
WO2018216221A1 true WO2018216221A1 (en) 2018-11-29

Family

ID=64395475

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/019809 WO2018216221A1 (en) 2017-05-26 2017-05-26 Wearable terminal display system, wearable terminal display method and program

Country Status (1)

Country Link
WO (1) WO2018216221A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009282864A (en) * 2008-05-23 2009-12-03 Hideyoshi Kawai System for image recognition information, information server, information providing method, and information providing program
JP2012008290A (en) * 2010-06-23 2012-01-12 Softbank Mobile Corp Spectacle type display device and server
JP2013038668A (en) * 2011-08-10 2013-02-21 Casio Comput Co Ltd Display device, display method and program
JP2015219850A (en) * 2014-05-21 2015-12-07 シャープ株式会社 Information management system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009282864A (en) * 2008-05-23 2009-12-03 Hideyoshi Kawai System for image recognition information, information server, information providing method, and information providing program
JP2012008290A (en) * 2010-06-23 2012-01-12 Softbank Mobile Corp Spectacle type display device and server
JP2013038668A (en) * 2011-08-10 2013-02-21 Casio Comput Co Ltd Display device, display method and program
JP2015219850A (en) * 2014-05-21 2015-12-07 シャープ株式会社 Information management system

Similar Documents

Publication Publication Date Title
US11227326B2 (en) Augmented reality recommendations
US11630861B2 (en) Method and apparatus for video searching, terminal and storage medium
US20180247361A1 (en) Information processing apparatus, information processing method, wearable terminal, and program
TWI418763B (en) Mobile imaging device as navigator
US20140330814A1 (en) Method, client of retrieving information and computer storage medium
JP6887198B2 (en) Wearable device display system, wearable device display method and program
CN106649525A (en) Method and device for displaying webpage information
JP2016031591A (en) Advertisement effect measurement system, advertisement effect measurement terminal, program for advertisement effect measurement terminal, and advertisement effect measurement method
CN111680686A (en) Signboard information identification method, signboard information identification device, signboard information identification terminal and storage medium
WO2018198320A1 (en) Wearable terminal display system, wearable terminal display method and program
WO2018216221A1 (en) Wearable terminal display system, wearable terminal display method and program
TWI661351B (en) System of digital content as in combination with map service and method for producing the digital content
WO2019021446A1 (en) Wearable terminal display system, wearable terminal display method and program
WO2018216220A1 (en) Wearable terminal display system, wearable terminal display method and program
US9911237B1 (en) Image processing techniques for self-captured images
WO2019003359A1 (en) Wearable terminal display system, wearable terminal display method, and program
WO2019021447A1 (en) Wearable terminal display system, wearable terminal display method and program
JP6762470B2 (en) Wearable device display system, wearable device display method and program
Yang et al. Indoor query system for the visually impaired
CN110287872A (en) A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal
JP6491124B2 (en) Reading rate measuring system, method and program
CN112035692B (en) Picture information searching method and device, computer system and readable storage medium
WO2018179232A1 (en) Map-associated sensor information display system, map-associated sensor information display method, and program
CN116126179A (en) Method and device for searching operation control of augmented reality equipment and related equipment
JP5667479B2 (en) Information processing apparatus, information acquisition method, and information acquisition program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17911030

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17911030

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP