WO2018216221A1 - Système d'affichage de terminal portable, procédé et programme d'affichage de terminal portable - Google Patents

Système d'affichage de terminal portable, procédé et programme d'affichage de terminal portable Download PDF

Info

Publication number
WO2018216221A1
WO2018216221A1 PCT/JP2017/019809 JP2017019809W WO2018216221A1 WO 2018216221 A1 WO2018216221 A1 WO 2018216221A1 JP 2017019809 W JP2017019809 W JP 2017019809W WO 2018216221 A1 WO2018216221 A1 WO 2018216221A1
Authority
WO
WIPO (PCT)
Prior art keywords
support
wearable terminal
display
telephone number
target
Prior art date
Application number
PCT/JP2017/019809
Other languages
English (en)
Japanese (ja)
Inventor
俊二 菅谷
Original Assignee
株式会社オプティム
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社オプティム filed Critical 株式会社オプティム
Priority to PCT/JP2017/019809 priority Critical patent/WO2018216221A1/fr
Publication of WO2018216221A1 publication Critical patent/WO2018216221A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to a wearable terminal display system and a wearable terminal display method for displaying a collected support center telephone number as an augmented reality for a support object that can be seen through the display board on the display board of the wearable terminal. And program.
  • Patent Document 1 An information display system that allows a user to quickly cope with a trouble in an electronic device.
  • Patent Document 1 has a problem that a support center can be called only when an electronic device trouble occurs.
  • the present invention identifies a support target from an image of a wearable terminal field of view, and displays the support center telephone number collected according to the support target as an augmented reality display on the display panel of the wearable terminal. It is an object to provide a system, a wearable terminal display method, and a program.
  • the present invention provides the following solutions.
  • the invention according to the first aspect is a wearable terminal display system for displaying a phone number of a support center to be supported on a display board of the wearable terminal, and an image for acquiring an image of a support target that has entered the field of view of the wearable terminal
  • An acquisition unit an image analysis unit that analyzes the image to identify the support target; a collection unit that collects a telephone number of the support center to be supported; and a display plate on the display plate of the wearable terminal.
  • a wearable terminal display system comprising: a telephone number display unit that displays the support center telephone number as an augmented reality for the support object that is transparent.
  • the invention according to the first aspect is a wearable terminal display method for displaying a phone number of a support center to be supported on a display board of the wearable terminal, and an image for acquiring a support target image entering the field of view of the wearable terminal An acquisition step; an image analysis of the image to identify the support target; a collection step of collecting telephone numbers of the support center to be supported; and a display board on the display board of the wearable terminal.
  • a wearable terminal display method comprising: a telephone number display step of displaying the support center telephone number as an augmented reality for the support object that appears transparent.
  • the invention according to the first aspect includes an image acquisition step of acquiring, in a computer, an image of a support target that has entered the field of view of the wearable terminal, a specific step of analyzing the image and specifying the support target, A collecting step of collecting a phone number of a support center to be supported, and displaying the phone number of the support center as an augmented reality on the display board of the wearable terminal with respect to the support object that is seen through the display board A telephone number display step is provided.
  • the phone number of the support center to be supported can be displayed on the wearable terminal display board.
  • FIG. 1 is a schematic diagram of a wearable terminal display system.
  • FIG. 2 is an example in which the telephone numbers of the support centers to be supported are collected and displayed on the display board of the wearable terminal.
  • the wearable terminal display system of the present invention is a system that displays the collected support center telephone numbers as augmented reality on the display board of the wearable terminal for a support object that can be seen through the display board.
  • a wearable terminal is a terminal with a field of view, such as a smart glass or a head-mounted display.
  • FIG. 1 is a schematic diagram of a wearable terminal display system which is a preferred embodiment of the present invention.
  • the wearable terminal display system includes image acquisition means, identification means, collection means, and telephone number display means that are realized by a control unit reading a predetermined program.
  • determination means, change means, detection means, action result display means, position / direction acquisition means, estimation means, guideline display means, and selection reception means may be provided. These may be application type, cloud type or others.
  • Each means described above may be realized by a single computer or may be realized by two or more computers (for example, a server and a terminal).
  • the image acquisition means acquires a supported image that has entered the field of view of the wearable terminal. You may acquire the image imaged with the camera of the wearable terminal. Or even if it is other than a wearable terminal, as long as such an image can be acquired, it does not matter.
  • the image may be a moving image or a still image. In order to display the telephone number of the support center in real time, a real-time image is preferable.
  • the identification means identifies the support target by analyzing the image. For example, it is specified whether the support target is a JCB credit card, iPhone, or Weekly Shonen Jump. Support target can be specified from appearance, color, shape, size, mark, etc. The support target is not limited to these. Further, if it takes time to specify all the supported support targets, only the support target at the center of the field of view of the wearable terminal may be specified. By identifying only the support target in the center of the field of view, the time required for identification can be greatly reduced. The accuracy of image analysis may be improved by machine learning. For example, machine learning is performed using a past image to be supported as teacher data.
  • Collecting means collects the telephone number of the support center according to the support target.
  • the support center telephone numbers corresponding to the support target may be collected with reference to a database in which the support center telephone numbers are registered in advance. Further, the telephone number of the support center may be collected by accessing Web contents linked in advance to the support target.
  • the URL can be collected from the Web content by assigning a URL that links the support target and the telephone number of the support center.
  • the telephone number of the support center may be collected from the Web content searched by searching the support target on the Internet. For example, there are cases where the telephone number of the support center is posted on the homepage to be supported, and it can be collected from the Internet search.
  • the support center telephone number may be collected from an SNS (social networking service) or a word-of-mouth site.
  • the telephone number display means displays the telephone number of the support center as augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board.
  • the phone number of the support center drawn with a broken line is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target drawn with a solid line that can be seen through the display board.
  • the solid line is the real thing
  • the broken line is the augmented reality.
  • the judging means judges whether or not the displayed telephone number of the support center has been browsed. It may be determined whether the telephone number of the support center has been browsed by acquiring the image being browsed and analyzing the image. Further, it may be determined whether or not the telephone number of the support center has been browsed from the sensor information of the wearable terminal or the sensor information attached to the viewer. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
  • the change means changes the attention level so that the phone number of the support center is changed to browsed when it is determined that it has been browsed, and the phone number of the support center is browsed when it is determined that it has not been browsed. .
  • the attention level may be changed by changing the color / size of the telephone number of the support center or pressing a stamp so that the telephone number of the support center is conspicuous.
  • Detecting means detects an action for the phone number of the displayed support center.
  • the action is, for example, a gesture, a hand movement, a line-of-sight movement, or the like.
  • the action for the telephone number of the support center can be detected by acquiring the image being browsed and analyzing the image.
  • the action result display means displays the result corresponding to the action as an augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board. For example, when an action for deleting the telephone number of the support center is detected, the display of the telephone number of the support center may be deleted. For example, when an action to make a call to a support center telephone number is detected, a result of making a call (during outgoing call etc.) may be displayed. Of course, other actions are possible.
  • the position direction means acquires the terminal position and the imaging direction of the wearable terminal.
  • the terminal position can be acquired from the GPS (Global Positioning System) of the wearable terminal.
  • the imaging direction can be acquired from a geomagnetic sensor or an acceleration sensor of the wearable terminal when imaging is performed with the wearable terminal. You may acquire from other than these.
  • the estimation means estimates the support target position to be supported based on the terminal position and the imaging direction. If the terminal position and the imaging direction are known, the support target position of the captured support target can be estimated.
  • the specifying means may specify the support target from the support target position and the image analysis. For example, even if the support target is the same chain store, there are cases where the phone number of the support center differs depending on the store. For example, if it can be specified that the store is Minato-ku, Tokyo, the phone number of the support center of the Minato-ku, Tokyo can be displayed.
  • the guideline display means displays the guideline for imaging the support target as augmented reality on the display board of the wearable terminal.
  • guidelines such as a frame or a cross may be displayed. Image analysis is facilitated by having images taken along the guidelines.
  • the acquisition unit may acquire an image taken along the guideline.
  • the selection accepting unit accepts selection of a selection target for a support target that is seen through the display board of the wearable terminal.
  • the selection of the selection target may be accepted by looking at the support target that is seen through the display board of the wearable terminal for a certain period of time.
  • the selection of the selection target may be received by touching the support target that is seen through the display board of the wearable terminal.
  • the selection of the selection target may be received by placing the cursor on the support target that can be seen through the display board of the wearable terminal.
  • a sensor that detects a line of sight a motion sensor, an acceleration sensor, and the like.
  • the telephone number display means may display the telephone number of the support center as augmented reality on the display board of the wearable terminal only in accordance with the selection target that can be seen through the display board. Since the telephone number of the support center is displayed as augmented reality according to the selected selection object, the telephone number of the support center can be grasped pinpointly. If the phone number of the support center is displayed on all identified support targets, the screen of the display board may become troublesome.
  • the wearable terminal display method of the present invention is a method of displaying the collected telephone numbers of the support center as augmented reality on the display board of the wearable terminal with respect to the support object that can be seen through the display board.
  • the wearable terminal display method includes an image acquisition step, a specific step, a collection step, and a telephone number display step. Although not shown, similarly, a determination step, a change step, a detection step, an action result display step, a position / direction acquisition step, an estimation step, a guideline display step, and a selection reception step may be provided.
  • the support target image that has entered the field of view of the wearable terminal is acquired. You may acquire the image imaged with the camera of the wearable terminal. Or even if it is other than a wearable terminal, as long as such an image can be acquired, it does not matter.
  • the image may be a moving image or a still image. In order to display the telephone number of the support center in real time, a real-time image is preferable.
  • the support target is specified by analyzing the image. For example, it is specified whether the support target is a JCB credit card, iPhone, or Weekly Shonen Jump.
  • Support target can be specified from appearance, color, shape, size, mark, etc. The support target is not limited to these. Further, if it takes time to specify all the supported support targets, only the support target at the center of the field of view of the wearable terminal may be specified. By identifying only the support target in the center of the field of view, the time required for identification can be greatly reduced.
  • the accuracy of image analysis may be improved by machine learning. For example, machine learning is performed using a past image to be supported as teacher data.
  • the telephone number of the support center corresponding to the support target is collected.
  • the support center telephone numbers corresponding to the support target may be collected with reference to a database in which the support center telephone numbers are registered in advance. Further, the telephone number of the support center may be collected by accessing Web contents linked in advance to the support target.
  • the URL can be collected from the Web content by assigning a URL that links the support target and the telephone number of the support center.
  • the telephone number of the support center may be collected from the Web content searched by searching the support target on the Internet. For example, there are cases where the telephone number of the support center is posted on the homepage to be supported, and it can be collected from the Internet search.
  • the support center telephone number may be collected from an SNS (social networking service) or a word-of-mouth site.
  • the phone number of the support center is displayed on the display board of the wearable terminal as an augmented reality with respect to the support object that can be seen through the display board.
  • the phone number of the support center drawn with a broken line is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target drawn with a solid line that can be seen through the display board.
  • the solid line is the real thing
  • the broken line is the augmented reality.
  • the determination step determines whether or not the displayed support center telephone number has been browsed. It may be determined whether the telephone number of the support center has been browsed by acquiring the image being browsed and analyzing the image. Further, it may be determined whether or not the telephone number of the support center has been browsed from the sensor information of the wearable terminal or the sensor information attached to the viewer. For example, a sensor that detects a line of sight, a motion sensor, an acceleration sensor, and the like.
  • the change step changes the degree of attention so that the telephone number of the support center is changed to viewed when it is determined that the information has been viewed, and the telephone number of the support center is viewed when it is determined that the information is not viewed. .
  • it is possible to visually grasp which support center telephone number has been browsed or not browsed. For example, you can check it by checking the check box of the phone number of the support center. For example, it may be viewed by pressing a stamp on the telephone number of the support center.
  • the attention level may be changed by changing the color / size of the telephone number of the support center or pressing a stamp so that the telephone number of the support center is conspicuous.
  • Detecting step detects an action for the phone number of the displayed support center.
  • the action is, for example, a gesture, a hand movement, a line-of-sight movement, or the like.
  • the action for the telephone number of the support center can be detected by acquiring the image being browsed and analyzing the image. Moreover, you may detect the action with respect to the telephone number of a support center from the sensor information of a wearable terminal, the sensor information with which the viewer was mounted
  • the result corresponding to the action is displayed as an augmented reality on the display board of the wearable terminal with respect to the support target that can be seen through the display board.
  • the display of the telephone number of the support center may be deleted.
  • a result of making a call may be displayed.
  • other actions are possible.
  • the position / direction step acquires the terminal position and the imaging direction of the wearable terminal.
  • the terminal position can be acquired from the GPS (Global Positioning System) of the wearable terminal.
  • the imaging direction can be acquired from a geomagnetic sensor or an acceleration sensor of the wearable terminal when imaging is performed with the wearable terminal. You may acquire from other than these.
  • the estimation step estimates the support target position to be supported based on the terminal position and the imaging direction. If the terminal position and the imaging direction are known, the support target position of the captured support target can be estimated.
  • the support target may be specified from the support target position and the image analysis. For example, even if the support target is the same chain store, there are cases where the phone number of the support center differs depending on the store. For example, if it can be specified that the store is Minato-ku, Tokyo, the phone number of the support center of the Minato-ku, Tokyo can be displayed.
  • the guideline for imaging the support target is displayed as augmented reality on the display board of the wearable terminal.
  • guidelines such as a frame or a cross may be displayed. Image analysis is facilitated by having images taken along the guidelines.
  • an image captured along the guideline may be acquired.
  • the selection accepting step accepts selection of a selection target for a support target that appears through the display panel of the wearable terminal.
  • the selection of the selection target may be accepted by looking at the support target that is seen through the display board of the wearable terminal for a certain period of time.
  • the selection of the selection target may be received by touching the support target that is seen through the display board of the wearable terminal.
  • the selection of the selection target may be received by placing the cursor on the support target that can be seen through the display board of the wearable terminal.
  • a sensor that detects a line of sight a motion sensor, an acceleration sensor, and the like.
  • the telephone number of the support center may be displayed as augmented reality on the display board of the wearable terminal only in accordance with the selection target that can be seen through the display board. Since the telephone number of the support center is displayed as augmented reality according to the selected selection object, the telephone number of the support center can be grasped pinpointly. If the phone number of the support center is displayed on all identified support targets, the screen of the display board may become troublesome.
  • the means and functions described above are realized by a computer (including a CPU, an information processing apparatus, and various terminals) reading and executing a predetermined program.
  • the program may be, for example, an application installed on a computer, or may be in the form of SaaS (software as a service) provided from a computer via a network, for example, a flexible disk, a CD It may be provided in a form recorded on a computer-readable recording medium such as a CD-ROM (DVD-ROM, DVD-RAM, etc.).
  • the computer reads the program from the recording medium, transfers it to the internal storage device or the external storage device, stores it, and executes it.
  • the program may be recorded in advance in a storage device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and provided from the storage device to a computer via a communication line.
  • a nearest neighbor method a naive Bayes method, a decision tree, a support vector machine, reinforcement learning, or the like may be used.
  • deep learning may be used in which a characteristic amount for learning is generated by using a neural network.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Le problème décrit par la présente invention est d'identifier une cible de support à partir d'une image dans le champ de vision d'un terminal portable et d'afficher sur une plaque d'affichage du terminal portable, sous forme de réalité augmentée, le numéro de téléphone d'un centre de support collecté correspondant à la cible de support. La solution selon l'invention porte sur un système d'affichage de terminal portable, pour afficher le numéro de téléphone d'un centre de support d'une cible de support sur la plaque d'affichage du terminal portable, qui comprend un moyen d'acquisition d'image pour acquérir une image de la cible de support qui a pénétré dans le champ de vision du terminal portable, un moyen d'identification qui effectue une analyse d'image sur l'image susmentionnée pour identifier la cible de support, un moyen de collecte qui collecte le numéro de téléphone d'un centre de support de la cible de support, et un moyen d'affichage de numéro de téléphone qui, sur la plaque d'affichage du terminal portable, affiche le numéro de téléphone d'un centre de support en réalité augmentée sur la cible de support visible à travers la plaque d'affichage.
PCT/JP2017/019809 2017-05-26 2017-05-26 Système d'affichage de terminal portable, procédé et programme d'affichage de terminal portable WO2018216221A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/019809 WO2018216221A1 (fr) 2017-05-26 2017-05-26 Système d'affichage de terminal portable, procédé et programme d'affichage de terminal portable

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/019809 WO2018216221A1 (fr) 2017-05-26 2017-05-26 Système d'affichage de terminal portable, procédé et programme d'affichage de terminal portable

Publications (1)

Publication Number Publication Date
WO2018216221A1 true WO2018216221A1 (fr) 2018-11-29

Family

ID=64395475

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/019809 WO2018216221A1 (fr) 2017-05-26 2017-05-26 Système d'affichage de terminal portable, procédé et programme d'affichage de terminal portable

Country Status (1)

Country Link
WO (1) WO2018216221A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009282864A (ja) * 2008-05-23 2009-12-03 Hideyoshi Kawai 画像認識情報システム、情報サーバ、情報提供方法および情報提供プログラム
JP2012008290A (ja) * 2010-06-23 2012-01-12 Softbank Mobile Corp 眼鏡型表示装置及びサーバ
JP2013038668A (ja) * 2011-08-10 2013-02-21 Casio Comput Co Ltd 表示装置、表示方法及びプログラム
JP2015219850A (ja) * 2014-05-21 2015-12-07 シャープ株式会社 情報管理システム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009282864A (ja) * 2008-05-23 2009-12-03 Hideyoshi Kawai 画像認識情報システム、情報サーバ、情報提供方法および情報提供プログラム
JP2012008290A (ja) * 2010-06-23 2012-01-12 Softbank Mobile Corp 眼鏡型表示装置及びサーバ
JP2013038668A (ja) * 2011-08-10 2013-02-21 Casio Comput Co Ltd 表示装置、表示方法及びプログラム
JP2015219850A (ja) * 2014-05-21 2015-12-07 シャープ株式会社 情報管理システム

Similar Documents

Publication Publication Date Title
US11227326B2 (en) Augmented reality recommendations
US11630861B2 (en) Method and apparatus for video searching, terminal and storage medium
US20180247361A1 (en) Information processing apparatus, information processing method, wearable terminal, and program
US8897498B2 (en) Mobile imaging device as navigator
US10540378B1 (en) Visual search suggestions
US20140330814A1 (en) Method, client of retrieving information and computer storage medium
WO2014176938A1 (fr) Procédé et appareil de récupération d'informations
JP2016031591A (ja) 広告効果測定システム、広告効果測定端末及び広告効果測定端末用プログラム、並びに、広告効果測定方法
JP6887198B2 (ja) ウェアラブル端末表示システム、ウェアラブル端末表示方法およびプログラム
CN106649525A (zh) 显示网页信息的方法及装置
CN111680686A (zh) 招牌信息识别方法、装置、终端及存储介质
WO2018198320A1 (fr) Système d'affichage de terminal portable, procédé et programme d'affichage de terminal portable
WO2018216221A1 (fr) Système d'affichage de terminal portable, procédé et programme d'affichage de terminal portable
TWI661351B (zh) 結合地圖服務的數位內容系統與數位內容產生方法
WO2019021446A1 (fr) Système d'affichage de terminal portable, procédé d'affichage de terminal portable et programme
WO2018216220A1 (fr) Système d'affichage de terminal vestimentaire, procédé et programme d'affichage de terminal vestimentaire
US9911237B1 (en) Image processing techniques for self-captured images
WO2019003359A1 (fr) Système d'affichage de terminal portable, procédé d'affichage de terminal portable et programme
WO2019021447A1 (fr) Système d'affichage de terminal portable, procédé d'affichage de terminal portable et programme
JP6762470B2 (ja) ウェアラブル端末表示システム、ウェアラブル端末表示方法およびプログラム
Yang et al. Indoor query system for the visually impaired
CN110287872A (zh) 一种基于移动终端的兴趣点视线方向识别方法及装置
CN112035692B (zh) 图片信息搜索方法和装置、计算机系统和可读存储介质
JP6343412B1 (ja) 地図連動センサ情報表示システム、地図連動センサ情報表示方法およびプログラム
CN116126179A (zh) 扩展现实设备搜索操作控件的方法、装置、及相关设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17911030

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17911030

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP