CN103577071A - Product usage instruction display system and method - Google Patents
Product usage instruction display system and method Download PDFInfo
- Publication number
- CN103577071A CN103577071A CN201210255942.5A CN201210255942A CN103577071A CN 103577071 A CN103577071 A CN 103577071A CN 201210255942 A CN201210255942 A CN 201210255942A CN 103577071 A CN103577071 A CN 103577071A
- Authority
- CN
- China
- Prior art keywords
- image
- accessory
- product
- project
- picked
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
Provided is a product usage instruction display system and method. The product usage instruction display method comprises the steps of obtaining product models and accessory items which are selected by a user and required to be checked, and obtaining usage instruction contents of the accessory items; obtaining accessory item images picked up by an image pickup device of a handheld device and enabling the picked-up images to be located in a detecting region preset on a display screen of the handheld device; comparing the images in the detecting region with all of accessory images in a product image sample data bank and confirming an accessory image matched with the picked-up images; displaying the usage instruction contents of the accessory items through the display screen in an augmented reality mode when matched accessory images are found. By using the product usage instruction display system and method, a product usage instruction required to be browsed by the user can be displayed in an electronic mode.
Description
Technical field
The present invention relates to a kind of products instruction display system and method, relate in particular to a kind of products instruction display system method on handheld device screen.
Background technology
When user need to understand the use function of a certain product, need to browse the products instruction of hard copy, because product may be sold to many country variants or area, manufacturer, for increasing the facility of selling operation, can print multilingual at products instruction.
But, when user browses products instruction, often only read the familiar language version of individual, the inconvenience that so not only causes user to browse, also causes the waste in printing cost and resource.Meanwhile, hard copy products instruction also easily occurs because properly not preserving the situation of losing, to make traditional products instruction in the use, the puzzlement and inconvenience that easily cause user to browse.
Summary of the invention
In view of above content, be necessary to provide a kind of products instruction display system, the form that it can be electronic shows the products instruction that user need to browse.
In view of above content, be also necessary to provide a kind of products instruction display packing, the form that it can be electronic shows the products instruction that user need to browse.
A display system, is applied to handheld device, and this system comprises: the first acquisition module, and product type and the accessory project of for obtaining needs that user selects, checking, and obtain the operation instructions content of this accessory project; The second acquisition module, for obtaining the image of this accessory project of the camera head picked-up of handheld device, and makes the image of this picked-up be positioned at the default detection area of handheld device display screen; Image comparison module, for comparing image in this detection area and all accessory images in product image sample data storehouse, determines an accessory image with the Image Matching of this picked-up; Display module, for when finding the accessory image of coupling, by the operation instructions content of this accessory project, is presented on display screen in the mode of augmented reality.
A display packing, is applied to handheld device, and the method comprises: the first obtaining step, obtains product type and accessory project that needs that user selects are checked, and obtains the operation instructions content of this accessory project; The second obtaining step, obtains the image of this accessory project of the camera head picked-up of handheld device, and makes the image of this picked-up be positioned at the default detection area of handheld device display screen; Image comparison step, compares image in this detection area and all accessory images in product image sample data storehouse, determines an accessory image with the Image Matching of this picked-up; Step display, when finding the accessory image of coupling, by the operation instructions content of this accessory project, is presented on display screen in the mode of augmented reality.
Compared to prior art, described products instruction display system and method, its can electronization form (as augmented reality form) show the products instruction that user need to browse, effectively avoided traditional hard copy products instruction to lose the generation of situation, provide simultaneously user more the mode of intuition browse, obtain the operation instruction information of Related product.
Accompanying drawing explanation
Fig. 1 is the applied environment schematic diagram of products instruction display system of the present invention.
Fig. 2 is the functional block diagram of products instruction display system of the present invention.
Fig. 3 is the process flow diagram of products instruction display packing of the present invention.
Fig. 4 is a schematic diagram in the image sample data of product described in the present invention storehouse.
Fig. 5 is scanning product bar code, the schematic diagram of automatic acquisition product item.
Fig. 6 A and Fig. 6 B are the schematic diagram of default detection area.
Fig. 7 is the schematic diagram of the similarity of each accessory image in the image in the default detection area of calculating and product image sample data storehouse.
Fig. 8 A and Fig. 8 B are the exemplary plot of augmented reality display mode.
Main element symbol description
| Handheld device | ?2 |
| Display screen | ?20 |
| Camera head | ?22 |
| Storer | ?23 |
| Products instruction display system | ?24 |
| Processor | ?25 |
| Product image sample data storehouse | ?30 |
| Detection area | ?40 |
| The first acquisition module | ?240 |
| The second acquisition module | ?241 |
| Image comparison module | ?242 |
| Display module | ?243 |
Embodiment
As shown in Figure 1, be the applied environment schematic diagram of products instruction display system of the present invention.In the present embodiment, this products instruction display system 24 runs in a handheld device 2.Described handheld device 2 also comprises display screen 20, camera head 22, storer 23 and the processor 25 being connected with data line by signal wire.In the present embodiment, described handheld device 2 is smart mobile phone.Described display screen 20 can be resistive touch screen or capacitive touch screen.
Described camera head 22 is for the image of the product accessories that absorbs user and need to check, and the image of picked-up is stored in storer 23.
Described storer 23 is for storing the program code of described products instruction display system 24 and the data such as product image sample data storehouse 30 of downloading from back-end host.Described product image sample data storehouse 30 is for storing the accessory image of different product and the operation instructions of each accessory, consult shown in Fig. 4, described product image sample data storehouse 30 comprises, but be not limited to the operation instructions (as explanations such as keypress function, circuit installations) of product type (as DVDR800), accessory project (as main frame), accessory image and each accessory.
In the present embodiment, described product image sample data storehouse 30 is stored in back-end host, and handheld device 2 can be connected to this back-end host by network.It should be noted that, described product image sample data storehouse 30 can't recording means image itself, record be the memory address of accessory image, as E: Template DVDR800 Image HostObverse.jpg.In like manner, the particular content of each accessory operation instructions also can not be recorded in described product image sample data storehouse 30, but records the memory address of each operation instructions, as E: Template DVDR800 Manual HostObverse.txt.
In the present embodiment, described products instruction display system 24 is downloaded and is mounted to handheld device 2 from back-end host by network modules built-in in handheld device 2.In other embodiments, described product image sample data storehouse 30 also can download to handheld device 2, and handheld device 2 can be by the product image sample data storehouse 30 of storing in network modules access back end main frame.Described products instruction display system 24 shows for the form with electronic (as augmented reality form) the product accessories operation instructions that user need to browse, and detailed process is described below.
In the present embodiment, described products instruction display system 24 can be divided into one or more modules, described one or more module is stored in described storer 23 and is configured to and carried out by one or more processors (the present embodiment is a processor 25), to complete the present invention.For example, consult shown in Fig. 2, described products instruction display system 24 is divided into the first acquisition module 240, the second acquisition module 241, image comparison module 242 and display module 243.The alleged module of the present invention has been the program segment of a specific function, than program, is more suitable in describing the implementation of software in handheld device 2, about the function of each module, will in the process flow diagram of Fig. 3, specifically describe.
As shown in Figure 3, be the process flow diagram of products instruction display packing of the present invention.
Step S10, the first acquisition module 240 obtains product type and the accessory project that need to check.In the present embodiment, provide two kinds of methods to obtain the product type that need to check.
Method one, manually choose, handheld device 2 shows a drop-down list on display screen 20, and this drop-down list comprises the product of Multiple Type, when user selects the product of a certain model, the first acquisition module 240 determines that the product type that this user selects is the product type that need to check.
Method two, chooses automatically, consults shown in Fig. 5, and user is by taking the bar code image of this product, and the first acquisition module 240 identifies the model of this product from this bar code image, and on display screen 20, lists all accessory projects that this product type comprises.For example, user can choose " A " in list, thereby chooses the image in main frame front.
In the present embodiment, when user chooses after a certain accessory project, the first acquisition module 240, by according to the memory address of operation instructions corresponding to this accessory project, obtains the content of these accessory project operation instructions.In other embodiments, user also can manually choose a certain accessory project, but by the definite accessory image of subsequent step S12, obtains the operation instructions of the corresponding accessory project of this accessory image.Use the benefit of manually choosing accessory project to be, can obtain operation instructions content accurately.
Step S11, the second acquisition module 241 obtains the image of this accessory project of camera head 22 picked-ups, and makes the image of this picked-up be positioned at the default detection area of display screen 20 40.Particularly, consult shown in Fig. 6, after accessory project is determined, the second acquisition module 241 is checked prompting user product accessories to needs is taken, user can suitably adjust the camera lens of camera head 22, makes the accessory image of picked-up be positioned at the default detection area of display screen 20 40.
In the present embodiment, the second acquisition module 241 is by according to the profile of user-selected product type and accessory project, adjust shape and position (as the square or rectangular region) of this detection area 40 on display screen 20, or the prompting user user that adjusts handheld device 2 to (as directly to or laterally), make the user can be with best browsing mode operation and the operation instructions content that shows Related product accessory.For example, if user selects accessory A(in Fig. 5, be the main frame front image of DVDR800), detection area 40 as shown in Figure 6A, is the telepilot image of DVDR800 if user selects accessory B(in Fig. 5), detection area 40 is as shown in Figure 6B.
Step S12, the image in these detection area 40 of image comparison module 242 comparison and all accessory images in product image sample data storehouse 30, determine an accessory image with the Image Matching of this picked-up.
Particularly, the image in image comparison module 242 these detection area 40 of calculating and the similarity of each the accessory image in product image sample data storehouse 30, determine that a similarity is greater than the accessory image that the accessory image of preset value is coupling.In the present embodiment, this preset value is 95%.For example, suppose the image of picked-up as shown in Figure 6A, the similarity value calculating as shown in Figure 7.As can be seen from Figure 7, the main frame front image that the accessory the most similar to image in Fig. 6 A detection area 40 is DVDR800, similarity is 98%.Wherein, calculate two similarities between image and can use many methods of the prior art, as disclosed U.S. Patent application on July 15th, 2010, publication number is US20100177967A1.
Step S13, image comparison module 242 judges whether to find the accessory image of coupling.If do not find the accessory image of coupling, flow process is returned to step S11, and the product accessories that prompting user checks needs re-starts shooting.If find the accessory image of coupling, perform step S14.
Step S14, display module 243 is the operation instructions content of this accessory project, in the mode of augmented reality (Augmented Reality is called for short AR), is presented on display screen 20.
Particularly, if user has and manually chooses accessory project in step S10, the operation instructions content of the accessory project that display module 243 is manually chosen this user, is presented on display screen 20 in the mode of augmented reality.If user does not manually choose accessory project in step S10, display module 243 is the operation instructions content of accessory project corresponding to the accessory image of this coupling, in the mode of augmented reality, is presented on display screen 20.
Wherein, augmented reality is a kind of position or angle of calculating the image that camera head 22 absorbs, and additionally adds the technology of respective image, reaches can virtual world be enclosed within to real world on display screen 20 and carry out interactive effect.
For example, consult shown in Fig. 8 A, on display screen 20, show the instant video of camera head 22 picked-up accessory projects, simultaneously, the operation instructions content of accessory project is presented on display screen 20 together by the mode of augmented reality, consults the content of explaining in square.When user selects certain to explain square, the detailed functions of the corresponding button of this note square will further be presented on display screen 20.Consult shown in Fig. 8 B, when user selects note square corresponding to " volume adjustment " button, the detailed functions of " volume adjustment " button will show.
Finally it should be noted that, above embodiment is only unrestricted in order to technical scheme of the present invention to be described, although the present invention is had been described in detail with reference to preferred embodiment, those of ordinary skill in the art is to be understood that, can modify or be equal to replacement technical scheme of the present invention, and not depart from the spirit and scope of technical solution of the present invention.
Claims (10)
1. a products instruction display system, is applied to handheld device, it is characterized in that, this system comprises:
The first acquisition module, product type and the accessory project of for obtaining needs that user selects, checking, and obtain the operation instructions content of this accessory project;
The second acquisition module, for obtaining the image of this accessory project of the camera head picked-up of handheld device, and makes the image of this picked-up be positioned at the default detection area of handheld device display screen;
Image comparison module, for comparing image in this detection area and all accessory images in product image sample data storehouse, determines an accessory image with the Image Matching of this picked-up;
And
Display module, for when finding the accessory image of coupling, by the operation instructions content of this accessory project, is presented on display screen in the mode of augmented reality.
2. products instruction display system as claimed in claim 1, is characterized in that, described the first acquisition module also for: from the product bar code image of camera head picked-up, automatically identify the product type that need to check.
3. products instruction display system as claimed in claim 1, is characterized in that, described the second acquisition module also for: according to the profile of user-selected product type and accessory project, adjust shape and the position of this detection area on display screen.
4. products instruction display system as claimed in claim 1, is characterized in that, described image comparison module determines that the accessory image of coupling comprises:
Calculate image in this detection area and the similarity of each the accessory image in product image sample data storehouse, determine that a similarity is greater than the accessory image that the accessory image of preset value is coupling.
5. products instruction display system as claimed in claim 1, is characterized in that, described display module also for: by the operation instructions content of accessory project corresponding to the accessory image of this coupling, in the mode of augmented reality, be presented on display screen.
6. a products instruction display packing, is applied to handheld device, it is characterized in that, the method comprises:
The first obtaining step, obtains product type and accessory project that needs that user selects are checked, and obtains the operation instructions content of this accessory project;
The second obtaining step, obtains the image of this accessory project of the camera head picked-up of handheld device, and makes the image of this picked-up be positioned at the default detection area of handheld device display screen;
Image comparison step, compares image in this detection area and all accessory images in product image sample data storehouse, determines an accessory image with the Image Matching of this picked-up; And
Step display, when finding the accessory image of coupling, by the operation instructions content of this accessory project, is presented on display screen in the mode of augmented reality.
7. products instruction display packing as claimed in claim 6, is characterized in that, the method also comprises: from the product bar code image of camera head picked-up, automatically identify the product type that need to check.
8. products instruction display packing as claimed in claim 6, is characterized in that, the method also comprises: according to the profile of user-selected product type and accessory project, adjust shape and the position of this detection area on display screen.
9. products instruction display packing as claimed in claim 6, is characterized in that, described image comparison step comprises:
Calculate image in this detection area and the similarity of each the accessory image in product image sample data storehouse, determine that a similarity is greater than the accessory image that the accessory image of preset value is coupling.
10. products instruction display packing as claimed in claim 6, is characterized in that, the method also comprises: by the operation instructions content of accessory project corresponding to the accessory image of this coupling, in the mode of augmented reality, be presented on display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210255942.5A CN103577071A (en) | 2012-07-23 | 2012-07-23 | Product usage instruction display system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210255942.5A CN103577071A (en) | 2012-07-23 | 2012-07-23 | Product usage instruction display system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103577071A true CN103577071A (en) | 2014-02-12 |
Family
ID=50048958
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210255942.5A Pending CN103577071A (en) | 2012-07-23 | 2012-07-23 | Product usage instruction display system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103577071A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105744375A (en) * | 2016-02-23 | 2016-07-06 | 四川长虹电器股份有限公司 | Method of quickly matching illustrated specification with television side |
| CN106447356A (en) * | 2016-09-27 | 2017-02-22 | 美的智慧家居科技有限公司 | Method, server, terminal and system for assisting installation of electric appliances |
| CN106848943A (en) * | 2017-02-22 | 2017-06-13 | 广东电网有限责任公司教育培训评价中心 | The process methods of exhibiting of cable terminal, system and processing method |
| CN107870673A (en) * | 2017-11-28 | 2018-04-03 | 深圳市蓝游网络科技有限公司 | Specification implementation method based on AR technologies |
| CN108009176A (en) * | 2016-10-28 | 2018-05-08 | 百度在线网络技术（北京）有限公司 | Specification methods of exhibiting, device and equipment based on AR technologies |
| CN108596719A (en) * | 2018-04-18 | 2018-09-28 | 北京小米移动软件有限公司 | Image display method and apparatus |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020044104A1 (en) * | 1999-03-02 | 2002-04-18 | Wolfgang Friedrich | Augmented-reality system for situation-related support of the interaction between a user and an engineering apparatus |
| US20100304787A1 (en) * | 2009-05-28 | 2010-12-02 | Min Ho Lee | Mobile terminal and method for displaying on a mobile terminal |
| US20100309225A1 (en) * | 2009-06-03 | 2010-12-09 | Gray Douglas R | Image matching for mobile augmented reality |
| WO2011105671A1 (en) * | 2010-02-25 | 2011-09-01 | 연세대학교 산학협력단 | System and method for providing a user manual using augmented reality |
| CN102238466A (en) * | 2010-04-20 | 2011-11-09 | 上海博路信息技术有限公司 | Mobile phone system with mobile augmented reality |
| CN102398600A (en) * | 2010-09-13 | 2012-04-04 | 现代自动车株式会社 | System for controlling in-vehicle device using augmented reality and method thereof |
| US20120105447A1 (en) * | 2010-11-02 | 2012-05-03 | Electronics And Telecommunications Research Institute | Augmented reality-based device control apparatus and method using local wireless communication |
-
2012
- 2012-07-23 CN CN201210255942.5A patent/CN103577071A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020044104A1 (en) * | 1999-03-02 | 2002-04-18 | Wolfgang Friedrich | Augmented-reality system for situation-related support of the interaction between a user and an engineering apparatus |
| US20100304787A1 (en) * | 2009-05-28 | 2010-12-02 | Min Ho Lee | Mobile terminal and method for displaying on a mobile terminal |
| US20100309225A1 (en) * | 2009-06-03 | 2010-12-09 | Gray Douglas R | Image matching for mobile augmented reality |
| WO2011105671A1 (en) * | 2010-02-25 | 2011-09-01 | 연세대학교 산학협력단 | System and method for providing a user manual using augmented reality |
| CN102238466A (en) * | 2010-04-20 | 2011-11-09 | 上海博路信息技术有限公司 | Mobile phone system with mobile augmented reality |
| CN102398600A (en) * | 2010-09-13 | 2012-04-04 | 现代自动车株式会社 | System for controlling in-vehicle device using augmented reality and method thereof |
| US20120105447A1 (en) * | 2010-11-02 | 2012-05-03 | Electronics And Telecommunications Research Institute | Augmented reality-based device control apparatus and method using local wireless communication |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105744375A (en) * | 2016-02-23 | 2016-07-06 | 四川长虹电器股份有限公司 | Method of quickly matching illustrated specification with television side |
| CN106447356A (en) * | 2016-09-27 | 2017-02-22 | 美的智慧家居科技有限公司 | Method, server, terminal and system for assisting installation of electric appliances |
| CN108009176A (en) * | 2016-10-28 | 2018-05-08 | 百度在线网络技术（北京）有限公司 | Specification methods of exhibiting, device and equipment based on AR technologies |
| CN108009176B (en) * | 2016-10-28 | 2022-07-19 | 百度在线网络技术（北京）有限公司 | Specification display method, device and equipment based on AR technology |
| CN106848943A (en) * | 2017-02-22 | 2017-06-13 | 广东电网有限责任公司教育培训评价中心 | The process methods of exhibiting of cable terminal, system and processing method |
| CN107870673A (en) * | 2017-11-28 | 2018-04-03 | 深圳市蓝游网络科技有限公司 | Specification implementation method based on AR technologies |
| CN108596719A (en) * | 2018-04-18 | 2018-09-28 | 北京小米移动软件有限公司 | Image display method and apparatus |
| CN108596719B (en) * | 2018-04-18 | 2022-12-06 | 北京小米移动软件有限公司 | Image display method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210072942A1 (en) | Augmented reality quick-start and user guide | |
| CN107888978B (en) | KEY code burning method and device and computer readable storage medium | |
| CN103577071A (en) | Product usage instruction display system and method | |
| US8848088B2 (en) | Product identification using mobile device | |
| CN105933772B (en) | Exchange method, interactive device and interactive system | |
| KR20150024526A (en) | Information Obtaining Method and Apparatus | |
| JP2010219789A5 (en) | Image processing system, control method thereof, and program | |
| CN104902078A (en) | Mobile terminal, control method and system of screen rotation in mobile terminal | |
| CN107861750B (en) | Label management method, label management device and intelligent terminal | |
| KR20180131621A (en) | Content-based search and retrieval of brand images | |
| AU2014271204B2 (en) | Image recognition of vehicle parts | |
| US20140358712A1 (en) | Shopping guide system, shopping guide management device and method | |
| US20190163707A1 (en) | Off-line electronic documentation solutions | |
| EP2990961A1 (en) | Method, apparatus, and electronic device for establishing virtual directory | |
| CN109359582B (en) | Information searching method, information searching device and mobile terminal | |
| CN108256071B (en) | Method and device for generating screen recording file, terminal and storage medium | |
| KR20180121273A (en) | Method for outputting content corresponding to object and electronic device thereof | |
| KR20130038547A (en) | System for dual-searching image using region of interest set and method therefor | |
| CN108268206B (en) | Method and device for adjusting display result of object in interface and mobile equipment | |
| US20150138077A1 (en) | Display system and display controll device | |
| CN109271543B (en) | Thumbnail display method and device, terminal and computer-readable storage medium | |
| JP6857373B1 (en) | Information processing equipment, information processing methods, and programs | |
| CN108021648B (en) | Question searching method and device and intelligent terminal | |
| KR102178172B1 (en) | Terminal and service providing device, control method thereof, computer readable medium having computer program recorded therefor and image searching system | |
| WO2015100070A1 (en) | Presenting information based on a video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140212 |