CN101141567A - Image capturing and displaying apparatus and image capturing and displaying method - Google Patents

Image capturing and displaying apparatus and image capturing and displaying method Download PDF

Info

Publication number
CN101141567A
CN101141567A CN 200710153620 CN200710153620A CN101141567A CN 101141567 A CN101141567 A CN 101141567A CN 200710153620 CN200710153620 CN 200710153620 CN 200710153620 A CN200710153620 A CN 200710153620A CN 101141567 A CN101141567 A CN 101141567A
Authority
CN
Grant status
Application
Patent type
Prior art keywords
image
display
user
information
section
Prior art date
Application number
CN 200710153620
Other languages
Chinese (zh)
Other versions
CN101141567B (en )
Inventor
伊藤大二
佐古曜一郎
海老泽观
飞鸟井正道
鹤田雅明
Original Assignee
索尼株式会社;索尼计算机娱乐公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Abstract

An image capturing and displaying apparatus is disclosed. The image capturing and displaying apparatus includes an image capturing section, a display section, a user's information obtaining section, and a control section. The image capturing section captures an image such that a direction in which a user sees a subject is a direction of the subject. The display section is disposed in front of eyes of the user and displays the image captured by the image capturing section. The user's information obtaining section obtains information about a motion and a physical situation of the user. The control section controls an operation of the image capturing section or an operation of the display section corresponding to information obtained by the user's information obtaining section.

Description

图像获取和显示设备以及图像获取和显示方法相关申请的交叉引用本发明包含与2006年9月8日提交的日本专利申请2006 -244685以及2007年9月27提交的日本专利申请2006 - 261975相关的主题,这些申请的全部内容通过引用并入在此。 The image capturing and displaying apparatus and method for image acquisition and display relevant cross-referenced application of the present invention includes Japanese Patent and September 8, 2006 filed in Japan Patent 2006-244685 and September 27, 2007 filed 2006--261975 related theme, the entire contents of these applications are incorporated herein by reference. 技术领域本发明涉及图像获取和显示设备以及图像获取和显示方法,它们被配置为沿着作为被摄对象方向的用户可视方向捕获被摄对象图像, 并且在他或者她戴上例如作为眼镜型安装单元或者头盔型安装单元的设备时,在他或者她的眼睛前面显示所捕获的图像。 Technical Field The present invention relates to an image capturing and displaying apparatus and an image capturing and displaying method that are configured to capture an image of the subject along a direction visible to the user as the direction of a subject, and put his or her glasses type as e.g. when the device unit or a helmet mounted type mounting unit, the captured image is displayed in front of his or her eyes. 背景技术已经在日本专利申请公开HEI 8 - 126031、 HEI 9 - 27970、和HEI 9 - 185009中提出了许多使用眼镜型安装单元或者头盔型安装单元的设备,它们具有布置在用户眼睛前面并且显示图像的显示部分。 BACKGROUND There has been disclosed in Japanese Patent Publication HEI 8 - 126031, HEI 9 - 27970, and HEI 9 - 185009 proposed apparatus use of many glasses type mounting unit or a helmet type mounting unit, which has disposed in front of the user's eyes and displays an image the display section. 发明内容然而,特别是从帮助用户视觉以及扩展他或者她的视觉能力的观点上看,相关技术中的设备不控制图像获取操作和显示操作。 SUMMARY However, especially from the point of view to help users visually and expand his or her visual ability point of view, the related art device does not control the image acquisition operation and display operation. 考虑到上述情形,所期望的是协助用户的视野以及扩展他或者她的视觉能力。 Taking into account the above circumstances, it is desirable to assist the user's field of vision and expand his or her visual ability. 此外,还期望恰当地控制显示操作和图像获取操作以便与用户的情况(例如,希望、视觉状态、身体情况等)相对应地协助用户的视野以及扩展他或者她的视觉能力。 In addition, also desirable to appropriately control the image capturing operation and the display operation to the user (e.g., desired, visual state, physical condition, etc.) corresponding to assist and extend the user's view of his or her visual ability. 此外,还期望恰当地控制显示操作和图像获取操作以便与外部情况(例如,周围环境、被摄对象、日期与时间、位置等)相对应地进行这些操作。 In addition, also desirable to appropriately control the image capturing operation and the display operation to be performed relative to external circumstances (e.g., the surrounding environment, subject, date and time, location, etc.) of these operations.

根据本发明的实施例,提供了一种图像获取和显示设备。 According to an embodiment of the present invention, there is provided an image capturing and displaying apparatus. 该图像获取和显示设备包括图像获取部分、显示部分、用户信息获得部分、 和控制部分。 The image capturing and displaying apparatus includes an image acquisition section, a display section, the user information obtaining section, and a control section. 图像获取部分这样获取图像,以便使用户看到被摄对象的方向就是被摄对象的方向。 The image acquisition is the direction of the subject image obtaining section so that the direction, so that the user sees a subject. 显示部分布置在用户眼睛的前面并且显示由图像获取部分获取的图像。 A display section disposed in front of eyes of the user and displaying the partial image acquired by the image acquisition. 用户信息获得部分获得有关用户的运动和身体情况的信息。 The user information obtaining section obtains information about the user's movement and physical condition. 控制部分与由用户信息获得部分获得的信息相对应地控制图像获取部分的操作或者显示部分的操作。 And the control information obtaining section by the user information obtaining part corresponding to control operation of the image capturing section or the operation of the display. 根据本发明的实施例,提供了一种图像获取和显示设备的图像获取和显示方法。 According to an embodiment of the present invention, there is provided an image capturing and displaying method of an image capturing and displaying apparatus. 该图像获取和显示设备包括图像获取部分和显示部分。 The image capturing and displaying apparatus includes an image acquisition section and a display section. 图像获取部分这样获取图像,以便使用户看到被摄对象的方向就是被摄对象的方向。 The image acquisition is the direction of the subject image obtaining section so that the direction, so that the user sees a subject. 显示部分布置在用户眼睛的前面并且显示由图像获取部分获取的图像。 A display section disposed in front of eyes of the user and displaying the partial image acquired by the image acquisition. 获得有关用户运动或者用户身体情况的信息。 Obtain information about the movement of the user or the user's physical condition. 与所获得的信息相对应地控制图像获取部分的操作或者显示部分的操作。 Information corresponding to the obtained image capturing operation control section or the operation of the display. 根据本发明的实施例,提供了一种图像获取和显示设备。 According to an embodiment of the present invention, there is provided an image capturing and displaying apparatus. 该图像获取和显示设备包括图像获取部分、显示部分、外部信息获得部分、 和控制部分。 The image capturing and displaying apparatus includes an image acquisition section, a display section, an external information obtaining section, and a control section. 图像获取部分这样获取图像,以便使用户看到被摄对象的方向就是被摄对象的方向。 The image acquisition is the direction of the subject image obtaining section so that the direction, so that the user sees a subject. 显示部分布置在用户眼睛的前面并且显示由图^^获取部分获取的图像。 A display section disposed in front of the user's eyes and displays an image acquired by the acquisition section ^^ FIG. 外部信息获得部分获得外部信息。 External information obtaining section obtains external information. 控制部分与由外部信息获得部分获得的信息相对应地控制图像获取部分的操作或者显示部分的操作。 The control portion by the external information obtaining section information corresponding to the obtained control operation of the image capturing section or the operation of the display. 根据本发明的实施例,提供了一种图像获取和显示设备的图像获取和显示方法。 According to an embodiment of the present invention, there is provided an image capturing and displaying method of an image capturing and displaying apparatus. 该图像获取和显示设备包括图像获取部分和显示部分。 The image capturing and displaying apparatus includes an image acquisition section and a display section. 图像获取部分这样获取图像,以便使用户看到被摄对象的方向就是被摄对象的方向。 The image acquisition is the direction of the subject image obtaining section so that the direction, so that the user sees a subject. 显示部分布置在用户眼睛的前面并且显示由图像获取部分获取的图像。 A display section disposed in front of eyes of the user and displaying the partial image acquired by the image acquisition. 获得外部信息。 Access to external information. 与所获得的信息相对应地控制图像获取部分的操作或者显示部分的操作。 Information corresponding to the obtained image capturing operation control section or the operation of the display. 根据本发明的实施例,当用户戴上例如眼镜型安装单元或者头盔型安装单元这样的图像获取和显示设备时,用户看到布置在他或者她 According to an embodiment of the present invention, for example, when a user puts on the image capturing and displaying apparatus such as glasses or a helmet type mounting unit type mounting unit, the user sees in his or her arrangement

前面的显示部分。 Portion of the front of the display. 当使显示部分显示由图像获取部分获取的图像时,用户可以利用显示部分在他或者她的正常视觉方向看见所获取的场景图像。 When the display section displays an image acquired by the image acquisition section, the user can see the display portion using the acquired scene image in his or her normal visual direction. 在这种情况下,虽然用户通过本发明实施例中的图像获取和显示设备在他或者她的正常视觉方向上看到场景,但是他或者她看到在显示部分上显示的图像作为他或者她的正常视觉场景中的场景。 In this case, although the embodiment of the user image capturing and displaying apparatus according to the present invention seen through a scene in his or her normal visual direction, but he or she sees an image displayed on the display section as his or her normal visual scene scene. 当与例如用户的希望、视野、身体情况等这样的用户情况相对应地改变显示部分上显示的图像的显示模式时,可以帮助或者扩展他或者她的可视能力。 When the display mode, for example, the user image and the case of such a user's desire, vision, body condition etc. should be changed is displayed on the display portion opposed, or helps extend his or her visual ability. 当例如显示远景图像(telescopic image)时,用户可以看见他或者她通常不能看见的远处场景。 When the vision of the image (telescopic image) such as the display, the user can see that he or she usually can not see the distant scene. 当用户用他或者她的弱视力眼睛阅读书本或者报纸时,如果显示部分放大了其中的字符,则他或者她可以清楚地看到它们。 When a user with his or her weak-sighted eyes to read a book or newspaper, if part of the enlarged characters can show he or she can clearly see them. 换句话说,当与用户的情况相对应地控制图像获取部分和显示部分的操作以及所获取的图像的显示模式时,可以提供其中用户感觉舒服的视觉情况。 In other words, when the user corresponding to the display mode control section and the image capturing operation and the acquired image display portion may be provided where the user feels comfortable vision situation. 才艮据本发明的实施例,当用户戴上作为例如眼镜型安装单元或者头盔型安装单元的图像获取和显示设备时,用户看到布置在他或者她前面的显示部分。 According to the embodiment of the present embodiment was Gen invention, when a user wears the glasses as the image type or helmet-type mounting unit mounting unit acquisition and display device, for example, the user sees in his or her front of the display section is disposed. 当使显示部分显示由图像获取部分获取的图像时, 用户可以利用显示部分在他或者她的正常视觉方向上看见所获取的场景图像。 When the display section displays an image acquired by the image acquisition section, the user can see the display portion using the acquired scene image on his or her normal visual direction. 在这种情况下,虽然用户通过本发明实施例中的图像获取和显示设备在他或者她的正常视觉方向上看到场景,但是他或者她看到显示部分上显示的图像作为他或者她的正常视觉场景中的场景。 In this case, the image acquired while the user Example embodiments of the present invention and the display device to see a scene in his or her normal visual direction, but he or she sees an image displayed on the display section as his or her normal visual scene scene. 当与例如周围环境状态、被摄对象情况等这样的外部情况相对应地改变在显示部分上显示的图像的显示模式时,可以帮助或者扩展他或者她的视觉能力。 When combined with an external case of such a state of the surrounding environment, like the case of the subject corresponding to change the display mode of an image displayed on the display portion, or can help extend his or her visual ability. 当例如显示远景图像时,用户可以看见他或者她通常不能看见的远处场景。 For example, when an image is displayed vision, the user can see that he or she usually can not see the distant scene. 当用户用他或者她的弱视力眼睛阅读书本或者报紙时,如 When you read a book or newspaper in his or her weak-sighted eyes, as

果显示部分放大了其中的字符并且调整了其亮度和对比度,则他或者她可以清楚地看到它们。 If the character display portion in which an enlarged and adjusts its brightness and contrast, he or she can clearly see them. 换句话说,当与外部信息相对应地控制图像获取部分和显示部分的操作以及所获取的图像的显示模式时,可以向用户提供其中用户感觉舒服或者感兴趣的视觉情况。 In other words, when the external information corresponding to the display mode control section and the image capturing operation and the acquired image display section may be provided where the user feels comfortable vision situation or interest to the user. 根据本发明的实施例,由布置在用户前面的显示部分显示由图像获取部分获取的图像,即,在作为被摄对象方向的用户视觉方向上获取的图像。 According to an embodiment of the present invention, the display portion of the image acquisition by the image acquired by the display section disposed in front of the user, i.e., acquired in the user's visual direction as the direction of the subject image. 当与用户的操作或者有关他或者她的身体情况的信息相对应地控制图像获取部分的操作或者显示部分的操作时,实质上可以协助和扩展他或者她的视觉能力。 When a user's operation or information about his or her physical condition is controlled corresponding to the image acquisition operation section or the operation of the display, and can help substantially expand his or her visual ability. 因为通过与用户的希望或者所确定的与代表他或者她的运动或者身体情况的信息相对应的情况相对应地控制图像获取部分或者显示部分来改变显示模式,所以没有向他或者她施加操作负担。 Because the case on behalf of his or her information to the motion or physical situation corresponding to a corresponding control of the image capturing section or the display portion through the desired user or the determined change the display mode, there is no operational burden is imposed to his or her . 此外, 因为恰当地控制了图像获取部分和显示部分,所以图像获取和显示设备具有高度的用户友好性。 Further, since the proper control of the image acquisition section and a display section, the image capturing and displaying apparatus has high user-friendliness. 此外,因为显示部分可以变为通过状态(through state),即透明或者半透明,而不是显示由图像获取部分获取的图像,所以携带图像获取和显示设备的用户可以没有困难地生活。 Further, since the display section can become the through state (through state), i.e., a transparent or semitransparent, instead of displaying an image acquired by the acquisition section image, the user carries the image capturing and displaying apparatus can live without difficulty. 因此,在用户的正常生活中,可以有效地获得本发明实施例的益处。 Thus, the user's normal life, the benefits can be efficiently obtained embodiment of the present invention. 根据本发明的实施例,由布置在用户前面的显示部分显示由图像获取部分获取的图像,即,在作为被摄对象方向的用户视觉方向中获取的图像。 According to an embodiment of the present invention, the display portion of the image acquisition by the image acquired by the display section disposed in front of the user, i.e., acquired in the user's visual direction as the direction of the subject image. 当与外部信息相对应地控制图像获取部分的操作或者显示部分的操作时,实质上可以协助和扩展他或者她的视觉能力。 When the external control information corresponding to the image capturing section or an operation part of the operation of the display, and can help substantially extend his or her visual ability. 因为通过与所确定的、与外部信息相对应的周围环境、被摄对象类型、它的情况等相对应地控制图像获取部分或者显示部分来改变显示模式,所以没有向他或者她施加操作负担。 Since by the determined information to the external corresponding to surroundings of the subject type, it is a case like controlled corresponding to the image capturing section or the display section to change the display mode, there is no operational burden is imposed to him or her. 此外,因为恰当地控制了图像获取部分和显示部分,所以图像获取和显示设备具有高度的用户友好性。 Further, since the proper control of the image acquisition section and a display section, the image capturing and displaying apparatus has high user-friendliness. 此外,因为显示部分可以变为通过状态,即透明或者半透明,而 Further, since the display section can become the through state, namely transparent or semitransparent, and

不是显示由图像获取部分获取的图像,所以戴上图像获取和显示设备的用户可以没有困难地生活。 Instead of displaying the image acquired by the acquiring part of the image, so put on image capturing and displaying user equipment can live without difficulty. 因此,在用户的正常生活中,可以有效地获得本发明实施例的益处。 Thus, the user's normal life, the benefits can be efficiently obtained embodiment of the present invention. 根据以下对附图中说明的本发明最佳模式实施例的详细说明,本发明的这些及其他目的、特征和优点将变得更为明显。 The following detailed description of the best mode embodiment of the present invention illustrated in the drawings, these and other objects, features and advantages of the present invention will become more apparent. 附图说明图1是描述根据本发明实施例的图像获取和显示设备的示范性外观的示意图;图2是示出根据本发明第一实施例的图像获取和显示设备的框图;图3A、图3B、和图3C是分别描述根据本发明实施例的通过状态、正常获取图像显示状态、和远景图像显示状态的示意图;图4A和图4B是分别描述根据本发明实施例的通过状态和广角变焦图像显示状态的示意图;图5A和图5B是分别描述根据本发明实施例的正常获取图像显示状态/通过状态和放大图像显示状态的示意图;图6A和图6B是分别描述根据本发明实施例的正常获取图像显示状态/通过状态和调整图像显示状态的示意图;图7A和图7B是分别描述#»据本发明实施例的正常获取图像显示状态/通过状态和增加了红外灵敏度的获取图像显示状态的示意图;图8A和图8B是分别描述根据本发明实施例的正常获取图像显示状态 BRIEF DESCRIPTION OF DRAWINGS Figure 1 is a schematic diagram of an exemplary acquisition and the appearance of the image display apparatus according to an embodiment of the present invention; FIG. 2 is a block diagram illustrating acquisition and the image display apparatus according to a first embodiment of the present invention; Figures 3A, FIG. 3B, and 3C are described by the state according to an embodiment of the present invention, a normally captured image display diagram showing a state of the state, and vision image display; FIGS. 4A and 4B are described by way of example of a state and a wide-angle zoom embodiment of the present invention showing a state of the image display; FIGS. 5A and 5B are described according to an embodiment of the present invention the normally captured image display state / view showing a state displayed by the state and the enlarged image; FIGS. 6A and 6B are described according to an embodiment of the present invention. normally captured image display state / view showing a state displayed by the status and adjusting the image; FIGS. 7A and 7B depict # »according to the normal embodiment of the present invention acquires an image display state / through state and an increased acquisition infrared sensitivity image display state a schematic view; FIGS. 8A and 8B are described separately acquired normal image display state according to an embodiment of the present invention /通过状态和增加了紫外灵敏度的获取图像显示状态的示意图;图9A、图9B和图9C是分别描述根据本发明的实施例的通过状态、两个分离图像显示状态、和四个分离图像显示状态的示意图;图IO是示出根据本发明第一实施例的控制处理的流程图;图IIA和图IIB是示出根据本发明第一实施例的监视显示启动触发确定处理的流程图;图12A和图12B是示出根据本发明第一实施例的图像控制触发 / Acquires a schematic image display state via a state UV sensitivity and increased; FIGS. 9A, 9B and 9C are respectively described by the state according to an embodiment of the present invention, two separate image display state, and four separate image display showing a state; FIG IO is a flowchart illustrating a control process according to the first embodiment of the present invention; Figures IIA and IIB is a flowchart showing determination processing according to the first embodiment of the monitor display start trigger of the present invention; FIG. 12A and 12B are diagrams illustrating an image control trigger according to a first embodiment of the present invention

确定处理的流程图;图13A和图13B是示出根据本发明第一实施例的图像控制触发确定处理的流程图;图14是示出根据本发明笫一实施例的图像控制触发确定处理的流程图;图15是示出根据本发明第一实施例的图像控制触发确定处理的流程图;图16是示出根据本发明第一实施例的图像控制触发确定处理的流程图;图17A和图17B是示出根据本发明第一实施例的图像控制触发确定处理的流程图;图18A和图18B是示出根据本发明第一实施例的监视显示完成触发确定处理的流程图;图19是示出根据本发明第一实施例的监视显示完成触发确定处理的流程图;图20是示出根据本发明第二实施例的图像获取和显示设备的框图;图21A和图21B是分别描述根据本发明第二实施例的未调整图像显示状态和调整图像显示状态的示意图;图22A和图22B是描述根据本发明第二实施例的突出显示 Determination process flowchart; FIGS. 13A and 13B are diagrams illustrating an image of a first embodiment of a control embodiment of the present invention, a flowchart of a trigger determination processing; FIG. 14 is a diagram showing an image control trigger determination process according to an embodiment of the present invention Zi of flowchart; FIG. 15 is a flowchart showing determination processing according to the image control trigger to the first embodiment of the present invention; FIG. 16 is a flowchart showing trigger determination process according to the image control of the first embodiment of the present invention; FIGS. 17A and FIG. 17B is an image illustrating a first embodiment of a control embodiment of the present invention, a trigger determination processing flowchart; FIGS. 18A and 18B are a flowchart illustrating a first embodiment of the monitor according to the present invention display completion trigger determination process; FIG. 19 is a diagram illustrating a first embodiment of the monitor according to the present invention display completion trigger determination process flowchart; FIG. 20 is a diagram illustrating an image acquisition of a second embodiment of the present invention and a block diagram of a display device; FIGS. 21A and 21B are separately described according to a second embodiment of the present invention is not adjusted image display state and an adjusted state is a schematic view of an image display; FIGS. 22A and 22B describing the second embodiment of the projection display device according to the present invention. 图像显示状态的示意图;图23是示出根据本发明第二实施例的图像控制触发确定处理的流程图;图24A和图24B是示出根据本发明第二实施例的图像控制触发确定处理的流程图;图25是示出根据本发明第二实施例的图像控制触发确定处理的流程图;图26是示出根据本发明第二实施例的图像控制触发确定处理的流程图; Showing an image display state; FIG. 23 is a flowchart showing an image trigger determination process according to a second embodiment of the control of the present invention; FIGS. 24A and 24B are diagrams showing image control trigger determination process according to a second embodiment of the present invention. flowchart; FIG. 25 is a flowchart showing determination processing according to the image control trigger a second embodiment of the present invention; FIG. 26 is a flowchart illustrating an image trigger determination process according to a second embodiment of the control of the present invention;

图27是示出根据本发明第二实施例的图像控制触发确定处理的流程图;图28A和图28B是示出根据本发明第二实施例的图像控制触发确定处理的流程图;图29A和图29B是示出根据本发明笫二实施例的图像控制触发确定处理的流程图;以及图30A和图30B是示出根据本发明第二实施例的图像控制触发确定处理的流程图。 FIG 27 is a flowchart illustrating an image trigger determination process according to the control of the second embodiment of the present invention; FIGS. 28A and 28B is a flowchart illustrating an image trigger determination process according to a second embodiment of the control of the present invention; FIGS. 29A and FIG 29B is a flowchart showing determination processing according to the image control trigger undertaking of the second embodiment of the present invention; and a flowchart showing determination processing of FIGS. 30A and 30B are diagrams illustrating an image control trigger according to a second embodiment of the present invention. 具体实施方式接下来,将以下列次序描述根据本发明第一实施例的图像获取和显示设备以及图像获取和显示方法。 DETAILED DESCRIPTION Next, will be described in the following order and the image capturing and displaying apparatus according to the image capturing and displaying method of the first embodiment of the present invention. 【l.图像获取和显示设备的示范性外观】 [2,图像获取和显示设备的示范性结构】 【3.示范性显示图像】 【4.用户情况的确定】 【5.示范性操作】【6.笫一实施例的效果、修改、和扩展】 【l.图像获取和显示设备的示范外观l图l示出了根据本发明第一实施例的、作为眼镜型显示相机的图像获取和显示设备1的示范性外观。 [L. The image capturing and displaying apparatus] An exemplary appearance of [2, the image capturing and displaying apparatus] [3. Exemplary structure of exemplary display images] [4 determines the user's situation] [5] [Exemplary Operation 6. the effect of an embodiment Zi, modifications, and extensions] [l. exemplary appearance of image capturing and displaying apparatus of FIG. l l shows an image acquisition camera according to the first embodiment of the present invention, as a spectacle-type display and the display exemplary appearance of the apparatus 1. 图像获取和显示设备1包括具有半圃形状的安装单元,其从两个头侧面部分中的每一个到头后面部分围绕用户的头部。 The image capturing and displaying apparatus 1 comprises a Po shape having a semi-mounted unit, which surrounds the user's head from each of the head portions of the two rear side portions of the head. 如图1所示,用户通过将图像获取和显示设备l的预定部分悬挂在他或者她耳朵的两个耳廓上来戴上该图像获取和显示设备l。 As shown in FIG. 1, the user image capturing and displaying a predetermined portion of the apparatus l suspended in his or her auricle two ear worn onto the image capturing and displaying apparatus l. 在图1所示的安装状态下,用于左眼和右眼的一对显示部分2 刚好布置在用户眼睛的前面,即,在常规眼镜的透镜位置处。 In the mounted state shown in FIG. 1, a pair of left and right eye display section 2 is arranged immediately in front of the eyes of the user, i.e. the lens position, in the conventional glasses. 显示部分2包括例如液晶面板。 The display section 2 includes, for example, a liquid crystal panel. 通过控制显示部分2的透射率,它们可以变为如图l所示的通过状态、即透明或者半透明。 By controlling the transmittance of the display section 2, they can become the through state as shown in FIG. L, i.e., a transparent or translucent. 当显示部分2已经变 While the display sections 2 has become

为通过状态时,即使用户象戴眼镜那样连续戴上图像获取和显示设备1,该设备也不会影响他或者她的正常生活。 It is through the state, even if the user as continuous wear glasses as image acquisition and display device 1, the device will not affect his or her normal life. 在用户戴上图像获取和显示设备1的状态下,图像获取透镜3a 被前向布置,以便使它沿着作为被摄对象方向的用户视觉方向获取被摄对象的图像。 The user puts on the image capturing and displaying apparatus 1 in a state of the image capturing lens 3a is disposed forward, so that it acquires an image of the subject along the user's visual direction as the direction of the subject. 此外,布置了照亮图像获取透镜3a的图像获取方向的发光部分4a。 Furthermore, the arrangement of the luminescent image illuminated image capturing lens 3a fetch direction portion 4a. 发光部分4a包括例如LED (发光二极管)。 4a comprises a light emitting portion, for example, LED (Light Emitting Diode). 还布置了在图像获取和显示设备1的安装状态下被插入到用户的左右耳孔中的一对耳机扬声器5a(图1中仅仅示出了左侧耳机扬声器5a)。 Also disposed in the image capturing and displaying are inserted into the user's ear canal around the mounted state of the device 1 in the pair of earphone speakers 5a (FIG. 1 shows only the left earphone speakers 5a). 此外,收集外部声音的麦克风6a和6b分别布置在右眼显示部分2的右边和左眼显示部分2的左边。 Further, the external sound collected by the microphones 6a and 6b are disposed in the right-eye display section 2 display the left eye and the right side portion 2. 图l仅仅是示例性的。 Figure l is merely exemplary. 因此,可以有许多用户戴上图像获取和显示设备1的结构。 Thus, there may be many user puts on the image capturing and displaying apparatus 1 of the structure. 只要图像获取和显示设备1是眼镜型安装单元或者头盔型安装单元,并且只要至少根据这个实施例、显示部分2刚好布置在用户眼睛的前面而且图像获取透镜3a的图像获取方向是用户的视觉方向,即在用户的前面,则图像获取和显示设备l的结构就不局限于图l所示的那个。 As long as the image capturing and displaying apparatus 1 is an eyeglass-type mounting unit or a helmet type mounting unit and as long as at least according to this embodiment, the display portion 2 disposed just in front of the eyes of the user and the image acquiring image capturing direction of the lens 3a is the user's visual direction , i.e. in front of the user, the image capturing and displaying apparatus l is not limited to the configuration of that shown in Figure l. 此外,虽然示出了其中两个显示部分2与用户的两只眼睛相对应地布置的结构,但是可以与用户的一只眼睛相对应地布置一个显示部分2。 In addition, although a display section 2 in which two of the user's eyes corresponding to the arranged structure, but may be arranged in correspondence to one eye of a user display section 2. 同样地,耳机扬声器5a可以不必是左右立体声扬声器。 Similarly, the earphone speakers 5a may not necessarily be left and right stereo speakers. 作为替代,可以与用户的一只耳朵相对应地布置一个耳机扬声器。 Alternatively, a user may be disposed corresponding to one ear the earpiece speaker. 类似地, 可以布置麦克风6a和6b之一。 Similarly, one may be arranged microphones 6a and 6b. 另外,图像获取和显示设备l可以不必具有任何麦克风和任何耳机扬声器。 Further, the image capturing and displaying apparatus l may not necessarily have any microphones and any earphone speakers. 另外,图像获取和显示设备l可以不必具有发光部分4a。 Further, the image capturing and displaying apparatus having a light emitting portion may not necessarily l 4a. 【2.图像获取和显示设备的示范性结构】图2示出了图像获取和显示设备1的示范性内部结构。 2. [Exemplary structure of image capturing and displaying apparatus] FIG 2 illustrates an exemplary internal configuration of the image capturing and displaying apparatus 1. 系统控制器IO包含微计算机,其包括例如CPU(中央处理单元)、 ROM (只读存储器)、RAM (随机存取存储器)、非易失性存储器 IO system controller comprising a microcomputer, which includes, for example, a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), nonvolatile memory

部分、和接口部分。 Section, and interface section. 系统控制器10是控制图像获取和显示设备1中的全部部分的控制部分。 The system controller 10 is a control section to control the image capturing and displaying all portions of the apparatus 1. 系统控制器10与用户情况相对应地控制图像获取和显示设备1 的每个部分。 The system controller 10 corresponding to the case where the user controls the image capturing and displaying apparatus 1 of each section. 换句话说,系统控制器10与检测和确定用户情况的操作程序相对应地进行操作,并且与确定结果相对应地操作和控制每个部分。 In other words, the system controller 10 determines that the user and the case where the detection operation of the program corresponding to the operation, and corresponds to the operation and control of each section and the determination result. 因此,如图2所示,系统控制器10在功能上包括确定用户情况的用户情况确定功能10a和与确定结果相对应地控制和命令每个部分的操作控制功能10b。 Thus, as shown, the system controller 10 functionally includes a user 2 determines the user's situation determination function 10a and a corresponding control command and operation control function 10b of each portion and the determination result. 在图像获取和显示设备l中布置了图像获取部分3、图像获取控制部分11、和获取图像信号处理部分15,作为获取在用户前面的图像的结构。 Disposed in the image capturing and displaying apparatus l in the image capturing section 3, image capturing control section 11, and the captured image signal processing section 15, a user acquires an image in front of a structure. 图像获取部分3包括透镜系统(其具有图像获取透镜3a(如图1 所示)、光围、变焦透镜、聚焦透镜等),使透镜系统执行聚焦操作和变焦操作的驱动系统,以及固态图像传感器阵列,其中固态图像传感器阵列检测由透镜系统获得的获取图像的光、将光转换为电、并且生成与电相对应的获取图像信号。 The image acquisition section 3 includes a lens system (having the image capturing lens 3a (shown in Figure 1), the light around, a zoom lens, a focus lens), the lens system to perform a focusing operation and a zoom driving system operation, and a solid-state image sensor array, wherein the optical image acquiring solid state image sensor array detection obtained by the lens system, converts light into electricity, and generates an electrical signal corresponding to the acquired image. 固态图像传感器阵列包含例如CCD (电荷耦合器件)传感器阵列或者CMOS (互补金属氧化物半导体) 传感器阵列。 E.g. solid state image sensor array comprises CCD (charge coupled device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array. 获取图像信号处理部分15包括采样保持/AGC (自动增益控制) 电路和视频A/D转换器,其中该采样保持/AGC电路调整由图像获取部分3中的固态图像传感器阵列所获得的信号的增益并且修整该信号的波形。 Acquiring an image signal processing section 15 includes a sample holding AGC (Automatic Gain Control) circuit and a video A / D converter, wherein the sample hold / AGC circuit adjusts the signal of the solid-state image sensor array section 3 obtained by the image acquisition gain / and shaping of the waveform of the signal. 获取图像信号处理部分15获得获取图像信号作为数字数据。 Acquiring an image signal processing section 15 obtains a captured image signal as digital data. 获取图像信号处理部分15为所获取的图像信号执行白平衡处理、亮度处理、彩色信号处理、振动校正处理等。 Acquiring an image signal processing section 15 performs image signal processing of the acquired white balance, luminance processing, color signal processing, the vibration correction processing. 图像获取控制部分11与从系统控制器10接收的命令相对应地控制图像获取部分3和获取图像信号处理部分15的操作。 The image acquisition section 11 controls the operation of the image corresponding to the command from a system controller 10 acquires reception section 3 and the captured image signal processing section 15 is controlled. 图像获取控制部分11例如开启和关闭图像获取部分3和获取图像信号处理部分15的操作。 The image capturing control section 11, for example, the opening and closing operation of the image capturing section 3 and captured image signal processing section 15. 另外,图像获取控制部分11控制图像获取部分3以(通过马达)执行自动聚焦操作、自动曝光调整操作、光團调整操作、变 Further, the image capturing control section 11 controls the image capturing section 3 (by motor) performs autofocus operation, automatic exposure adjustment operation, the optical adjustment operation group, becomes

焦操作等。 Coke operations. 另外,图像获取控制部分11包括定时发生器。 Further, the image capturing control section 11 includes a timing generator. 图像获取控制部分11利用由定时发生器生成的定时信号,控制固态图像传感器阵列和图像获取控制部分11中的采样保持/AGC电路和视频A/D转换器。 The image capturing control section 11 using the timing signals generated by the timing generator, the control solid state image sensor array and the image acquisition control section 11 of the sample hold / AGC circuit and the video A / D converter. 另外,图像获取控制部分ll可以利用定时信号改变获取图像的帧频。 Further, the image capturing control section ll may be utilized to change the timing of acquiring the frame rate of the image signal. 另外,图像获取控制部分11控制固态图像传感器阵列和获取图像信号处理部分15的图像获取灵敏度和信号处理,为了控制图像获取灵敏度,图像获取控制部分11控制例如已经从固态图像传感器阵列读取的信号的增益、黑电平设置、获取图像信号处理中的数字数据的各种类型的系数、振动校正处理的校正量等。 Further, the image capturing control section 11 controls the solid state image sensor array and the captured image signal processing section 15 the image capturing sensitivity and the signal processing, in order to control the image capturing sensitivity, the image capturing control section 11 controls, for example, a signal that has been read from the solid state image sensor array gain, black level setting, various types of coefficients acquired image signal processing digital data, a correction amount of the vibration correction process, and the like. 关于图像获取灵敏度调整,图像获取控制部分11可以执行总灵敏度调整,而与波段和用于诸如红外线区和紫外线区之类的特定波段的特定灵敏度调整无关。 Respect to the image capturing sensitivity adjustments, the image capturing control section 11 can perform an overall sensitivity adjustment, to adjust for the sensitivity and the specific band specific band region such as infrared and ultraviolet regions of the class independent. 可以通过在图像获取透镜系统中插入波长滤波器,以及通过为所获取的图像信号执行波长滤波计算处理,来执行波长特定的灵敏度调整。 In the image acquisition by inserting a wavelength filter lens system, and the image signal obtained by performing a wavelength filter calculation process is performed to adjust the sensitivity of a particular wavelength. 在这些情况下,图像获取控制部分11可以通过插入波长滤波器和/或指定滤波计算系数来控制灵敏度。 In these cases, the image capturing control section 11 can control sensitivity by inserting a wavelength filter and / or specifying a filter calculation coefficient. 作为向用户显示数据的结构,图像获取和显示设备l包括显示部分2、显示图像处理部分12、显示驱动部分13、和显示控制部分14。 As the structure of the data displayed to the user, the image capturing and displaying apparatus l comprises a display section 2, the display image processing section 12, a display driving section 13, and a display control section 14. 将其图像已经由图像获取部分3获取并然后由获取图像信号处理部分15处理的获取图像信号提供给显示图像处理部分12。 An image which has been acquired by the image acquisition section 3 and supplied to the display image processing section 12 acquires the image signal processing section 15 is then processed by the captured image signal. 显示图像处理部分12例如是所谓的视频处理器。 Display image processing section 12, for example, a so-called video processor. 显示图像处理部分12为所提供的获取图像信号执行各种类型的显示处理。 Display image processing section 12 performs various types of display process to acquire an image signal supplied. 显示图像处理部分12 可以为获取图像信号执行例如亮度级调整、色彩校正、对比度调整、 锐度(边缘增强)调整等。 Display image processing section 12 may perform, for example, brightness level adjustment, color correction, contrast adjustment, sharpness (edge ​​enhancement) adjustment, to obtain an image signal. 另外,显示图像处理部分12可以生成其中放大获取图像信号的一部分的放大图像和缩小图像,分离图像以便进行分离显示,组合图像,生成字符图像和图形图像,以及将所生成的图像和获取图像相叠加。 Further, the display image processing section 12 may generate wherein enlarge image of a portion of the acquired image signal and the reduced image, the separate image for separate display the combined image to generate a character image and a graphic image, and the generated image and the acquired image with superimposed. 换句话说,显示图像处理部分12可以为作为获取图像信号的数字图像信号执行各种类型的处理。 In other words, the display image processing section 12 may acquire the digital image signals to perform various types of processing as. 显示驱动部分13包含像素驱动电路,其在例如为液晶显示器的 A display driving section 13 includes a pixel drive circuit in a liquid crystal display, for example,

显示部分2上显示从显示图像处理部分12提供的图像信号。 On the display section 2 displays an image signal supplied from the display image processing section 12. 换句话说,显示驱动部分13以预定的水平/垂直驱动定时将基于图像信号的驱动信号施加到显示部分2中以矩阵形状形成的每个像素中,以导致显示部分2显示图像。 In other words, display driving section 13 at a predetermined horizontal / vertical driving timing for each pixel applied to the display portion 2 is formed in a matrix shape in an image signal based on the drive signal to cause the display sections 2 display an image. 另外,显示驱动部分13控制每个像素的透射率,以导致显示部分2变为通过状态。 Further, the display driving section 13 controls the transmittance of each pixel to cause the display sections 2 become the through state. 显示控制部分14与从系统控制器10接收的命令相对应地控制显示图像处理部分12的处理和操作以及显示驱动部分13的操作。 A display operation portion 14 displays the image corresponding to the control command from the system controller 10 and the reception processing section 12 and the operation of the display driving section 13 is controlled. 换句话说,显示控制部分14使显示图像处理部分12执行上述各种类型的处理。 In other words, the display control section 14 causes the display section 12 performs various types of image processing described above. 另外,显示控制部分14控制显示驱动部分13,以导致显示部分2在通过状态和图像显示状态之间切换显示状态。 Further, the display control section 14 controls the display driving section 13 to cause the display sections 2 to switch the display state between the through state and the image display state. 在以下的描述中,其中显示部分2变为透明或者半透明的状态被称为"通过状态",而其中显示部分2显示图像的操作(及其状态)被称为"监视显示状态"。 In the following description, wherein the display portion 2 becomes transparent or translucent state is called "through state", wherein the display operation of the image display portion 2 (and its state) is referred to as a "monitor display state." 另外,图像获取和显示设备1还包括声音输入部分6、声音信号处理部分16、和声音输出部分5。 Further, the image capturing and displaying apparatus 1 further includes a sound input section 6, audio signal processing section 16, and a sound output section 5. 声音输入部分6包括图1所示的麦克风6a和6b,以及麦克风放大部分,其处理由麦克风6a和6b获得的声音信号。 Sound input section 6 includes the microphones 6a shown in FIG. 1 and 6b, and a microphone amplifying section that processes sound signals obtained by the microphones 6a and 6b. 声音信号处理部分16包含例如A/D转换器、数字信号处理器、 D/A转换器等。 A sound signal processing section 16 comprises, for example, A / D converter, a digital signal processor, D / A converter or the like. 声音信号处理部分16将从声音输入部分6提供的声音信号转换为数字数据,并且在系统控制器10的控制下执行音量调整、音质调整、音响效果等处理。 A sound signal processing section 16 converts the sound signal from the sound input section 6 into digital data, and perform volume adjustment under control of the system controller 10, to adjust the sound quality, sound processing and the like. 声音信号处理部分16将产生的声音信号转换为模拟信号,并且将模拟信号提供给声音输出部分5。 Sound signal into a sound signal processing section 16 generates an analog signal, and supplies the analog signal to the sound output section 5. 声音信号处理部分16不局限于执行数字信号处理的结构。 A sound signal processing section 16 is not limited to the structure performing the digital signal processing. 相反,声音信号处理部分16可以利用模拟放大器和模拟滤波器执行信号处理。 Instead, the sound signal processing section 16 may use an analog amplifier and analog filter performs signal processing. 声音输出部分5包括图1所示的一对耳机扬声器5a以及用于耳机扬声器5a的放大器电路。 Shown in FIG. 1 includes a pair of earphone speakers 5a and an amplifier circuit for the earphone speakers 5a sound output section 5. 声音输入部分6、声音信号处理部分16、和声音输出部分5允许用户通过图像获取和显示设备1听到外部声音。 Sound input section 6, audio signal processing section 16, and a sound output section 5 allow the user to hear an external sound through the image capturing and displaying apparatus. 声音输出部分5可以被构造为所谓的骨质(osseous)传导扬声 The sound output section 5 may be configured as a so-called bone (osseous) conduction speaker

器。 Device. 另外,图像获取和显示设备1包括照明(lighting)部分4和照明控制部分18。 Further, the image capturing and displaying apparatus 1 comprises an illumination (Lighting) section 4 and an illumination control portion 18. 照明部分4包含图1所示的发光部分4a (例如,发光二极管)以及导致发光部分4a发光的发光电路。 Illumination section 4 shown in Figure 1 comprises a light emitting portion 4a (e.g., LED) and a light emission section 4a to emit light led to the light emitting circuit. 照明控制部分18 使照明部分4与从系统控制器IO提供的命令相对应地执行发光操作。 The lighting control section 18 causes the illumination section 4 perform the light emission operation corresponding to a command supplied from the system controller IO.

因为照明部分4中的发光部分4a被布置为使发光部分4a向前方照亮,所以照明部分4在用户的视觉方向上执行照明操作。 Because the lighting section 4 in the light emitting portion 4a is arranged to illuminate the light emitting part 4a forwardly, the illumination section 4 performs a lighting operation in the user's visual direction. 作为获得用户信息的结构,图像获取和显示设备l包括视觉传感器19、加速度传感器20、陀螺仪21、生物学传感器22、和输入部分17。 As the user information structure is obtained, image capturing and displaying apparatus l comprises a visual sensor 19, acceleration sensor 20, gyro 21, biological sensor 22, and an input portion 17.

视觉传感器19检测有关用户视觉的信息。 Visual sensor 19 detects information about user's visual sense. 视觉传感器19是能够检测有关用户视觉的信息的传感器,这些信息诸如为视线方向、焦距、 瞳孔扩张、眼底模式、眼皮开/合等。 Visual sensor 19 capable of detecting information about user's visual sensors, information such as a gaze direction, focal distance, pupil dilation, retinal pattern, eyelid opening / closing the like. 加速度传感器20和陀螺仪21输出与用户运动相对应的信号。 20 and the gyro 21 output signals corresponding to the user motion acceleration sensor. 加速度传感器20和图像获取控制部分11是检测用户的头部、颈部、整个身体、臂、腿等的运动的传感器。 The acceleration sensor 20 and the image capturing control section 11 is a sensor for detecting motion of the user's head, neck, whole body, arms, legs and the like. 生物学传感器22检测用户的生物学信息。 The biological information sensor 22 detects biological user. 生物学传感器22是检测例如用户的心率信息、脉搏信息、出汗信息、脑波信息、皮肤电反应(GSR)、体温、血压、呼吸活动信息等的传感器。 Biological sensor 22 detects for example heart rate information to a user, the sensor pulse information, perspiration information, brain wave information, galvanic skin response (the GSR), body temperature, blood pressure, respiratory activity information and the like. 生物学传感器22的检测信号变为这样的信息,利用该信息来确定紧张状态、兴奋状态、平静状态、催眠状态、舒适状态、不舒适状态等。 Biological sensor detection signal 22 becomes such information, use this information to determine the state of tension, an excited state, a calm state, hypnotic state, a comfortable state, an uncomfortable status. 输入部分17是用户利用其手动输入信息的部分。 User using the input portion 17 is a portion manually input information. 输入部分17 中形成了用户可以利用其输入他或者她的视野的开关。 Input portion 17 is formed by using a user can input his or her field of vision of the switch.

利用视觉传感器19、加速度传感器20、陀螺仪21、生物学传感器22、和输入部分17,获得有关戴上图像获取和显示设备1的用户的运动或者身体情况的信息作为用户信息,并且将其提供给系统控制器IO。 The visual sensor 19, acceleration sensor 20, gyro 21, biological sensor 22, and an input section 17, to obtain the relevant information put on the image capturing and displaying apparatus 1, the user movement or physical condition as the user information, and provides to the system controller IO. 在用户情况确定功能10a的处理中,系统控制器IO确定与所获得的用户信息相对应的用户希望或者情况。 In the process of the user's situation determination function 10a, the system controller determines that the user IO information corresponding to the obtained user wishes or information. 在操作控制功能10b的处 At operation control function 10b of the

理中,系统控制器10与所确定的用户希望或者情况相对应地控制图像获取操作和显示操作。 Management, the system controller 10 determines desired by the user or corresponding to the case of controlling the image capturing operation and the display operation. 换句话说,系统控制器10命令图像获取控制部分11控制获取图像信号处理部分15的操作,并且命令显示控制部分14控制显示图像处理部分12和显示驱动部分13的操作。 In other words, the system controller 10 commands the image capturing control section 11 controls the operation of the captured image signal processing section 15, and commands the display control section 14 controls the display image processing section 12 and display drive operation portion 13. 作为图像获取和显示设备l中获得用户信息的结构,已经示范性地说明了视觉传感器19、加速度传感器20、陀螺仪21、生物学传感器22、和输入部分17。 An image acquisition and display configuration information to obtain the user device l has been exemplarily illustrates a visual sensor 19, acceleration sensor 20, gyro 21, biological sensor 22, and an input portion 17. 然而,图像获取和显示设备1可以不必包括全部这些传感器。 However, the image capturing and displaying apparatus 1 may not necessarily include all of these sensors. 另外,图像获取和显示设备l可以包括诸如检测用户的语音的传感器和检测嘴唇的运动的传感器之类的其它传感器。 Further, the image capturing and displaying apparatus l can include other sensors such as a motion detecting a user's voice and the detection sensor lips sensor or the like. 【3.示范性显示图像】系统控制器10与用户希望或者情况相对应地控制图像获取操作和显示操作。 3. [Exemplary display images] The system controller 10 and corresponding to the case or the user wishes to control the image capturing operation and the display operation. 因此,用户识别显示部分2的各种显示模式。 Thus, the user identification portion 2 displays various display modes of. 图3A到图3C至图9A到图9C示范性地说明了各种显示模式。 3A to 3C to FIGS. 9A to 9C illustrate an exemplary various display modes. 图3A示出了其中显示部分2处于通过状态下的状态。 3A shows a state in which the display sections 2 are in the through state. 换句话说。 in other words. 在这个状态下,显示部分2是简单的透明平面部件,而且用户可通过透明的显示部分2看到视野中的场景。 In this state, the display sections 2 are simple transparent planar members and the user can see a scene in the field of view through the transparent display section 2. 图3B示出了其中由图像获取部分3获取的图像被显示在处于监视显示状态下进行操作的显示部分2上的状态。 FIG 3B shows a case where the image acquired by the image acquisition section 3 is displayed in a state of operating state on the display section 2 is in the monitoring. 图像获取部分3、获取图像信号处理部分15、显示图像处理部分12、和显示驱动部分13 在图3A所示的状态下进行操作,以便使它们正常地在显示部分2上显示获取的图像。 The image acquisition section 3, the captured image signal processing section 15, display image processing section 12, and the display driving section 13 operate in the state shown in FIGS. 3A, so that they are normally displayed on the display section 2 of the image acquisition. 在这种情况下,显示部分2上显示的获取图像(正常获取的图像)几乎与在通过状态下进行操作的显示部分2上显现的图像相同。 In this case, the acquired display image (normally captured image) on the display section 2 is almost the operation display appears in a state in part 2 of the same image. 换句话说,在这个状态下,用户可看到正常的视野作为获取的图像。 In other words, in this state, the user sees a normal visual field as a captured image. 图3C示出了其中系统控制器10导致图像获取部分3通过图像获取控制部分11获取远景图像并且将远景图像显示在显示部分2上的状态。 3C shows an example in which the system controller 10 causes the image capturing section 3 acquires the control section 11 acquires the image and the vision vision image display state in the display portion 2 through the image. 相比之下,当系统控制器10导致图像获取部分3通过图像获取控制部分11获取广角图像时,在显示部分2上显示近距离广角图像 In contrast, when the system controller 10 causes the image capturing section 3 acquires the control section 11 acquiring a wide-angle image on the display section 2 display a wide angle image through the image close

(未示出)。 (Not shown). 虽然图像获取部分3通过驱动图像获取部分3的变焦透镜来执行远景和广角控制,但是获取图像处理部分15可以通过处理信号来执行这些控制。 Although the image acquisition section 3 acquires the zoom lens driving section 3 through the vision and wide-angle image control is performed, but the processing section 15 acquires the image may perform these controls by processing signals. 图4A示出了其中显示部分2处于通过状态、例如用户正在读取报纸的状态。 4A shows an example in which the display sections 2 are in the through state, for example the user is reading the newspaper state. 图4B示出了所谓的广角变焦状态。 4B shows a so-called wide angle zoom state. 换句话说,图4B示出了这样的状态,在该状态下,获取近焦距变焦图像并且将其显示在显示部分2上,以便例如放大报纸中的字符。 In other words, FIG. 4B shows a state, in this state, the near focus zoom image acquisition and displayed on the display section 2, for example, in a newspaper enlarged character. 图5A示出了这样的状态,其中显示部分2显示正常获取的图像或者显示部分2处于通过状态下。 5A shows a state in which the display sections 2 display a normally captured portion 2 in the through state or display the image. 此时,当系统控制器10命令显示图像处理部分12通过显示控制部分14执行图像放大处理时,在显示部分2上显示如图5B所示的放大图像。 At this time, when the system controller 10 commands the display image processing section 12 control section 14 performs the image enlargement processing, on the display section 2 display an enlarged image as shown in FIG 5B by the display. 图6A示出了这样的状态,其中显示部分2显示正常获取的图像或者显示部分2处于通过状态下。 6A shows a state in which the display sections 2 display a normally captured portion 2 in the through state or display the image. 特别地,图6A示出了其中用户正在读取报纸或者书本的状态。 In particular, FIG. 6A shows a user is reading a newspaper or a state in which the book. 在这种情况下,假定因为周围是昏暗的, 所以用户不能用正常获取的图像或者在显示部分2的通过状态下看见报纸等中的字符。 In this case, it is assumed that since the surroundings are dim, the user can not use a normally captured image or the like to see in newspaper characters in the status display portion 2. 在这种情况下,系统控制器lO命令图像获取控制部分ll (图像获取部分3和获取图像信号处理部分15)增加图像获取灵敏度,和/ 或使显示控制部分14 (显示图像处理部分12和显示驱动部分13)增加亮度和调整对比度和锐度,以便在显示部分2上显示比图6A所示的图像更锐化的、如图6B所示的图像。 In this case, the system controller commands the image capturing control section lO LL (image capturing section 3 and captured image signal processing section 15) to increase the image capturing sensitivity and / or causes the display control section 14 (display image processing section 12 and the display driving section 13) to increase the brightness and adjust the contrast and sharpness on the display section 2 to display an image shown in FIG. 6A sharper than that of the image shown in FIG. 6B. 相反,当系统控制器10使照明部分4执行照明操作时,可以在显示部分2上锐利地显示图像。 Conversely, when the system controller 10 causes the lighting section 4 performs lighting operation, displays an image displayed sharply portion 2. 图7A示出了这样的状态,其中显示部分2显示正常获取的图像或者显示部分2处于通过状态下。 7A shows a state in which the display sections 2 display a normally captured portion 2 in the through state or display the image. 在这种情况下,用户正处于其中孩子正在睡觉的黑暗卧室中。 In this case, the user is in which children are sleeping in the dark bedroom. 因为用户正处于黑暗房间中,所以他或者她不能利用正常获取的图像或者在显示部分2的通过状态下清楚地看见孩子。 Because the user is in a dark room, so he or she can not use normally captured image or the display is clearly visible through the child under section 2 of the state.

此时,当系统控制器10命令图像获取控制部分11 (图像获取部分3和获取图像信号处理部分15 )增加红外图像获取灵敏度时,在显示部分2上显示如图7B所示的红外获取图像,以便使用户能够看见孩子们的睡着面部等。 At this time, when the system controller 10 commands the image capturing control section 11 (image capturing section 3 and captured image signal processing section 15) to increase the infrared image capturing sensitivity, on the display section 2 display the infrared image acquisition shown in FIG. 7B, so that the user can see the children's sleeping face and so on. 图8A示出了这样的状态,其中显示部分2显示正常获取的图像或者显示部分2处于通过状态下。 8A shows a state in which the display sections 2 display a normally captured portion 2 in the through state or display the image. 当系统控制器10命令图像获取控制部分11 (图像获取部分3和获取图像信号处理部分15)增加紫外图像获取灵敏度时,在显示部分2上显示如图8B所示的、具有紫外线分量的获取图像。 When the system controller 10 commands the image capturing control section 11 (image capturing section 3 and captured image signal processing section 15) to increase the ultraviolet image capturing sensitivity display on the display section 2 as shown in FIG. 8B, acquiring an image having an ultraviolet component . 图9A示出了其中显示部分2处于通过状态下的状态。 9A shows a state in which the display sections 2 are in the through state. 当系统控制器10命令显示控制部分14 (显示图像处理部分12像时,可以在显示部分2上显示图9B所示的图像。换句话说,显示部分2的屏幕被分离为区域AR1和AR2,其中区域AR1处于通过状态或者处于正常图像显示状态,而区域AR2处于放大图像显示状态。图9C示出了另一个示范性分离显示。在这种情况下,显示部分2的屏幕被分离为区域AR1、 AR2、 AR3、和AR4,这些区域显示以预定时间段间隔获取的图像的帧。系统控制器10使显示图像处理部分12以0.5秒的间隔从所获取的图像信号中提取一帧,并且以区域AR1、 AR2、 AR3、 AR4、 AR1、 AR2等的次序显示所提取的帧。在这种情况下,分离地在显示部分2上显示所谓的闪烁显示模式(strobe display mode )的图像。在上文中已经示范性地说明了各种类型的显示图像。然而,在这个实施例中,通过控制图像获取部分3、获取图像信号处理 When the system controller 10 commands the display control section 14 (display image processing section 12 o'clock like, may be displayed on the image display portion 2 as shown in FIG. 9B. In other words, the display screen section 2 is separated into areas AR1 and AR2 of, wherein in the area AR1 through state or in a normal image display state and area AR2 is in an enlarged image display state. FIG. 9C shows another exemplary separation display. in this case, the display screen section 2 is separated into areas AR1 , AR2, AR3, and AR4, the region display frame acquired at intervals of a predetermined period of the image. the system controller 10 causes the display image processing section 12 at intervals of 0.5 seconds to extract a signal obtained from the image, and to sequence regions AR1, AR2, AR3, AR4, AR1, AR2 and the like of the extracted display frame. in this case, separately on the display section 2 displays an image called flashing mode (strobe display mode) in the this paper has been exemplarily described various types of display images. However, in this embodiment, by controlling the image capturing section 3, the captured image signal processing 部分15、 显示图像处理部分12、和显示驱动部分13的每个处理和每个操作, 可以实现各种类型的显示模式。例如,预计有许多类型的显示模式,诸如远景显示模式、广角显示模式、在从远景显示模式到广角显示模式的范围中变化的缩小显示模式和放大显示模式、图像放大显示模式、图像缩小显示模式、可变 Section 15, the display image processing section 12, and each process and each operation of the display driving section 13, various types of display modes can be achieved. For example, there are many types of expected display modes, such as vision display mode, a wide angle display mode , from the perspective display mode to the narrow wide display mode change display mode and enlarged display mode, an image enlargement display mode, an image reduction display mode, a variable

帧频显示模式(以高帧频获取图像)、高亮度显示模式、低亮度显示模式、可变对比度显示模式、可变锐度显示模式、增加了灵敏度的获取图像显示模式、增加了红外灵敏度的获取图像显示模式、增加了紫外灵敏度的获取图像显示模式、图像效果显示模式(诸如马赛克图像、 亮度反转图像、柔焦图像、部分屏幕突出显示图像、具有可变颜色氛围图像等)、緩慢显示模式、逐帧显示模式、与这些显示模式相结合的分离显示模式、与通过状态和获取图像相结合的分离显示模式、闪烁显示模式、具有所获取图像中的一个帧的静止图像显示模式等。 Frame rate display mode (an image acquired at a high frame rate), high brightness display mode, a low brightness display mode, a variable contrast display mode, a variable sharpness display mode, an increased sensitivity captured image display mode, an increased infrared sensitivity acquiring an image display mode, an increased ultraviolet sensitivity captured image display mode, image effect display modes (such as a mosaic image, a brightness inverted image, a soft focus image, a partial screen highlight image, an image having variable color atmosphere, etc.), display slow mode, the display mode frame by frame, combined with the separation of these display modes the display mode, the state and the captured image by combining the split display mode, flashing mode, a still image of one frame is acquired display mode. 【4.用户情况的确定】如上所述,作为获得用户信息的结构,根据这个实施例的图像获取和显示设备1包括视觉传感器19、加速度传感器20、陀螺仪21、 生物学传感器22、和输入部分17。 [4] determining the user's situation as described above, as the user information structure is obtained, image capturing and displaying the embodiment of apparatus 1 includes a visual sensor 19 according to this, the acceleration sensor 20, gyro 21, biological sensor 22, and an input section 17. 视觉传感器19检测有关用户视觉的信息。 Visual sensor 19 detects information about user's visual sense. 视觉传感器19可以包括例如图像获取部分,其接近显示部分2之一布置并且用于获取用户眼睛的图像。 Visual sensor 19 may comprise, for example, an image capturing section, one of which is close to the display portion 2 is arranged and for acquiring the image of the user's eye. 由系统控制器10获得通过图像获取部分获取的用户眼睛的图像。 The system controller 10 is obtained by the image acquisition section acquiring the image of the user's eyes. 用户情况确定功能10a分析该图像,并且检测与分析结果相对应的视线方向、焦距、瞳孔扩张、眼底模式、眼皮开/合等。 User's situation determination function 10a analyzes the image and the detection and analysis results corresponding to the gaze direction, focal distance, pupil dilation, retinal pattern, eyelid opening / closing the like. 因此, 用户情况确定功能10a可以确定与所检测的结果相对应的用户情况和希望。 Thus, the user's situation determination function 10a can determine a user's situation detected result and the corresponding desired. 作为替代,视觉传感器19可以包含发光部分和光接收部分,其中发光部分接近显示部分2之一布置并且向用户的眼睛发光,而光接收部分接收从眼睛反射的光。 Alternatively, the visual sensor 19 may comprise a light emitting portion and a light receiving portion, wherein the light emitting portion 2 is disposed near the display and one of the light emitting portion to the user's eye, and the light receiving portion receives light reflected from the eye. 通过例如利用与接收的光相对应的信号来检测用户眼睛的晶状体的厚度,可以检测用户眼睛的焦距。 Through, for example using the received light corresponding to the detected thickness of the user's eye lens, the focal length of the user's eye can be detected. 通过检测用户眼睛的视线方向,系统控制器10可以确定在显示部分2上显示的图像中用户正在聚焦的部分。 By detecting the user's eye gaze direction, the system controller 10 may determine that the partial image on the display section 2 the user is focused on the display. 另外,系统控制器IO可以识别用户眼睛的视线方向作为操作输入。 Further, the system controller IO may identify the user's eye gaze direction as an operation input. 例如,当用户向左和向右移动视线时,系统控制器10可以识别出这些操作作为到图像获取和显示设备1的预定操作输入。 For example, when the user moves the left and the right line of sight, the system controller 10 can recognize these operations as predetermined operation inputs to the image capturing and displaying apparatus 1. 通过检测用户眼睛的焦距,系统控制器IO可以确定用户正聚焦 By detecting the focal length of the user's eye, the system controller may determine that the user is focusing IO

其上的场景是在远处还是在近处。 Scene which is at a distance or in the vicinity. 系统控制器10可以与确定结果相对应地执行变焦控制、放大控制、缩小控制等。 The system controller 10 may determine the result and the like corresponding to the zoom control, enlargement control, reduction control. 例如,当用户观看远处场景时,系统控制器10可以执行远景显示操作。 For example, when the user views the distant scene, the system controller 10 may perform a telescopic display operation. 当在通过状态下检测到瞳孔扩张时,可以确定周围的亮度。 When a dilation of pupils is detected in the through state may be determined ambient brightness. 当在监视显示状态下检测到瞳孔扩张时,可以确定用户对所显示的图像感觉到眩目等。 When the monitor display when the dilation of pupils is detected in the state, may determine that the user feels dazzled on the displayed image. 可以与确定的结果相对应地调整亮度、图像获取灵敏度等。 Can be adjusted corresponding to the brightness, image capturing sensitivity and the result of the determination. 当检测用户的眼底模式时,可以与检测结果相对应地验证用户。 When detecting the user's fundus pattern, the user can verify the correspondence with the detection result. 因为眼底模式对于每个用户而言都是唯一的,所以可以标识戴上图像获取和显示设备l的用户。 Since the fundus pattern is unique, it is possible to identify the image capturing and displaying apparatus wear l user for each user. 可以与所标识的结果相对应地控制图像获取和显示设备l。 It can be controlled with the results corresponding to the identified image capturing and displaying apparatus l. 作为替代,系统控制器10可以仅仅为预定用户控制监视显示。 Alternatively, the system controller 10 may control the monitor display only for the predetermined user. 当检测到用户的眼皮开/合操作时,可以确定用户眼睛的瞪眼和疲劳。 When detecting the user's eyelid open / close operation, it may determine the user's eye fatigue and stare. 另外,可以将眼皮的开/合操作识别为用户故意的操作输入。 Further, the opening / closing operation of the eyelids may be identified as an operation input intended by the user. 当用户已经执行了眼皮的开/合操作三次时,这些动作可以被确定为是预定的操作输入。 When the user has performed the opening / closing operations of the eyelids three times, these actions may be determined as a predetermined operation input. 加速度传感器20和陀螺仪21输出与用户运动相对应的信息。 20 and the gyro 21 output information corresponding to the user motion accelerometer. 加速度传感器20检测例如沿线性方向的运动。 The acceleration sensor 20 detects, for example, a linear motion direction. 陀螺仪21适当地检测旋转系统的运动和振动。 Gyro 21 suitably detects the motion and vibration of the rotating system. 取决于加速度传感器20和陀螺仪21布置在图像获取和显示设备1中的位置,它们可以检测用户整个身体的运动或者他或者她身体的每个部分的运动。 Depending on the acceleration sensor 20 and gyro 21 is disposed in the image capturing and displaying apparatus 1 positions, they can detect the user's whole body movement or motion of each portion of his or her body. 当加速度传感器20和陀螺仪21布置在图1所示的B艮镜型图像获取和显示设备l中时,即,当加速度传感器20和陀螺仪21检测用户头部的运动时,加速度传感器20的信息变为作为用户头部或者他或者她整个身体的运动的加速度信息。 When the acceleration sensor 20 and gyro 21 l acquisition and display device disposed in the image B Gen mirror type illustrated in Figure 1, i.e., when the motion of the acceleration sensor 20 and the gyro 21 detects the user's head, the acceleration sensor 20 information becomes acceleration information as the user's head or his or her entire body in motion. 在这种情况下,陀螺仪21的信息变为作为用户头部或者他或者她整个身体的运动的角速度和振动的信息。 In this case, the information gyro 21 becomes angular velocity and vibration information as the user's head or his or her whole body movement. 因此,可以检测用户从颈部移动头部的动作。 Thus, a user action can be detected from the movement of the head and neck. 例如,可以确定用 For example, can be determined

户向上看的状态以及他或者她向下看的状态。 Family status, and the point of view of looking down his or her state. 当用户向下看时,可以确定他或她正在看近处的被摄对象,例如他或者她正在阅读书本等。 When you look down, you can make sure he or she is looking at near the subject, for example, he or she is reading books and so on. 相反,当用户向上看时,可以确定他或者她正在看远处的被摄对象。 In contrast, when the user looks up, he or she can be determined by looking at a distant subject. 当系统控制器10已经检测到用户从他或者她的颈部移动他或者她的头部的动作时,系统控制器IO可以将其识别为用户故意的动作。 When the system controller 10 has detected that the user moves his or her operation of the head from his or her neck, the system controller IO may recognize it as a user's intentional action. 例如,如果用户已经向左边晃动他或者她的颈部两次,则系统控制器10可以将该动作确定为预定的操作输入。 For example, if the user has shaking his or her neck to the left twice, the system controller 10 can determine the action as a predetermined operation input. 取决于加速度传感器20和陀螺仪21,它们能够确定用户是处于停止状态(非行走状态)、行走状态、还是处于跑步状态。 Depending on the acceleration sensor 20 and the gyro 21, they can determine that the user is in a stop state (non-walking state), a walking state, or in a running state. 另外,加速度传感器20和陀螺仪21能检测从站立状态到坐着状态的状态改变或者从坐着状态到站立状态的状态改变。 Further, the acceleration sensor 20 and gyro 21 can detect the change from a standing state to a sitting state or a state change from a standing state to a sitting state. 当加速度传感器20和陀螺仪21与头盔安装单元分离并且布置在用户的一只手臂或者一只脚处时,它们可以仅仅检测该手臂或者脚的运动.生物学传感器22检测例如心率信息(心率)、脉搏信息(脉搏率)、出汗信息、脑电波信息(例如,a波、p波、e波、和3波的信息)、皮肤电反应、体温、血压、呼吸活动(例如,呼吸速度、深度、 和肺活量)等作为用户的生物学信息。 When the acceleration sensor 20 and the gyro unit 21 is separated from the helmet-mounted and disposed at a user's arm or a foot, the they can only detect the movement of the arm or legs. Biological sensor 22 detects for example heart rate information (heart rate) , pulse information (pulse rate), perspiration information, brain wave information (e.g., a-wave, P-wave, E wave, 3 wave and information), galvanic skin response, body temperature, blood pressure, respiratory activity (e.g., respiration rate, depth, and vital capacity) or the like as the biological information of the user. 系统控制器10可以确定用户是否处于与所检测的信息相对应的紧张状态、兴奋状态、情绪平静状态、舒适状态、或不舒适状态。 The system controller 10 can determine whether the user is in a state of tension and the detected information corresponding to the excited state, emotional state of calm, comfort status, or uncomfortable state. 可以与所检测的生物学信息相对应地确定用户是否已经戴上了图像获取和显示设备l。 It can be determined corresponding to the detected biological information whether the user has put on the image capturing and displaying apparatus l. 例如,当用户还没有戴上图像获取和显示设备1时,系统控制器10可以控制图像获取和显示设备1以便在其中仅仅检测生物学信息的待机状态下进行操作。 For example, when the user has not put on the image capturing and displaying apparatus 1, the system controller 10 may control the image capturing and displaying apparatus 1 to operate in a standby mode in which only biological information is detected. 当系统控制器10检测到与所检测到的生物学信息相对应地用户已经戴上图像获取和显示设备1时,系统控制器10可以导通图像获取和显示设备1的电源。 When the system controller 10 detects the detected biological information corresponding to the user has put on the image capturing and displaying apparatus 1, the system controller 10 may turn on the image capturing and displaying apparatus 1 is the power supply. 相反,当用户已经脱掉了图像获取和显示设备1时,系统控制器10 可以将图像获取和显示设备1恢复为待机状态。 In contrast, when the user 1 has been off the image capturing and displaying apparatus, the system controller 10 may be an image capturing and displaying apparatus 1 to standby state. 另外,由生物学传感器22检测到的信息可用于验证用户(识别 Furthermore, detected by the biological sensor 22 may be used to verify the user information (identification

已经戴上图像获取和显示设备l的用户)。 It has put on the image capturing and displaying apparatus user l). 当生物学传感器22布置在眼镜型图像获取和显示设备1的安装框架中时,在用户的头侧面部分或者头后面部分上检测到上述信息。 When the biological sensor 22 is disposed capturing and displaying apparatus 1 is mounted in a frame spectacles-type image, on the head side portion or the back portion of the user's head to said detected information. 作为替代,生物学传感器22可以与图像获取和显示设备1的安装框架分离并且布置在用户身体的一个预定位置处。 Alternatively, the biological sensor 22 can acquire and display apparatus 1 is separated from the mounting frame and arranged at a predetermined position of the user's body with the image. 输入部分17是用户可以利用其输入他或者她的视野信息的部分。 Input section 17 is part of its user may utilize his or her vision input information. 当用户输入他或者她的视野信息、例如视野值以及有关近视、远视、散光、老花眼等的信息时,系统控制器10可以与用户的视野相对应地控制图像的显示。 When the user inputs information of his or her field of vision, for example, the value of the field of view and information about myopia, hyperopia, astigmatism, presbyopia or the like, the system controller 10 may control the display of the image corresponding to the user's view. 【5.示范性操作】在根据本发明这个实施例的图像获取和显示设备l中,系统控制器10与由视觉传感器19、加速度传感器20、陀螺仪21、生物学传感器22、和输入部分17所检测的用户信息相对应地控制图像获取操作和显示操作。 [5] In the exemplary operation of the image acquisition to this embodiment of the present invention and the display device l, the system controller 10 by the visual sensor 19, acceleration sensor 20, gyro 21, biological sensor 22, and an input section 17 user information corresponding to the detected control the image capturing operation and the display operation. 因此,显示部分2执行与用户的希望和情况相对应的显示操作,以便协助和扩展用户的视觉。 Thus, the display section 2 performs the operation desired by the user and corresponding to the case, in order to assist and extend the user's visual. 接下来,将描述在系统控制器10的控制下的各种类型的示范性操作。 Next, various types of exemplary operations under the control of the system controller 10 will be described. 图10示出了作为系统控制器10的操作控制功能10b的控制处理。 FIG. 10 shows a control process as the operation control function 10b of the system controller 10. 在步骤FlOl,系统控制器10控制显示控制部分14以使显示部分2变为通过状态。 In step FlOl, 10 system controller controls the display control section 14 to cause the display sections 2 to become the through state. 当最初导通图像获取和显示设备l时,流程前进到步骤FIOI。 When initially turned on the image capturing and displaying apparatus l, the flow proceeds to step FIOI. 在步骤FIOI,系统控制器10控制显示部分2变为通过状态。 In step FIOI, 10 system controller controls the display sections 2 become the through state. 当显示部分2处于通过状态时,流程前进到步骤F102。 When the display sections 2 are in the through state, the flow proceeds to step F102. 在步骤F102,系统控制器10确定是否已经出现了监视显示状态启动触发。 In step F102, the system controller 10 determines whether or not there have been a monitor display state start trigger. 当系统控制器10确定已经与由用户情况确定功能10a确定的用户希望或者情况相对应地启动了监视显示状态时,出现监视显示状态启动触发。 When the system controller 10 determines the user has determined the desired situation determination function 10a corresponding to a user or a case where a monitor display state start, a monitor display state start trigger occurs. 系统控制器10确定是否已经与用户的操作、用户的有意运动(被识别为操作的运动)、或者用户的无意运动或者情况(包括对用 The system controller 10 determines whether the user's operation, a user's intentional motion (movement operation is identified as a), or a user's unintentional motion or situation (including with

户的识别)相对应地出现了监视显示状态启动触发。 Identify households) occurred corresponding to a monitor display state start trigger. 稍后将描述这些具体示例。 Specific examples of these will be described later. 当确定结果表示已经出现了监视显示状态启动触发时,流程前进到步骤F103。 When the determined result denotes that has occurred when a monitor display state start trigger, the flow advances to step F103. 在步骤F103,系统控制器IO执行监视显示启动控制。 In step F103, the system controller performs IO monitor display start control. 换句话说,系统控制器IO命令图像获取控制部分11使图像获取部分3和获取图像信号处理部分15执行正常的图像获取操作。 In other words, the system controller IO commands the image capturing control section 11 causes the image capturing section 3 and captured image signal processing section 15 performs a normal image capturing operation. 另外,系统控制器10命令显示控制部分14使显示图像处理部分12和显示驱动部分13导致显示部分2显示所获取的图像信号作为正常获取的图像。 Further, the system controller 10 commands the display control section 14 causes the display image processing section 12 and display driving section 13 cause the display section 2 displays an image signal obtained as a normally captured image. 在这个处理过程中,将如图3A所示的通过状态切换为如图3B 所示的、用于正常获取图像的监视显示状态。 In this process, the state shown in FIG. 3A as shown in FIG. 3B switch, for monitoring the normally captured image display state. 当显示部分2显示正常获取的图像(其与用户在通过状态下所看到的场景相同)时,流程前进到步骤F104。 When the display sections 2 display a normally captured image (which is the same as the user sees in the through state of the scene), the flow proceeds to step F104. 在步骤F104,系统控制器IO监控是否已经出现了图像控制触发。 In step F104, the system controller IO monitor whether an image control trigger has occurred. 在步骤F105,系统控制器10监控是否已经出现了监视显示状态完成触发。 In step F105, the system controller 10 monitors whether or not there have been a monitor display state completion trigger. 当系统控制器IO确定需要与由用户情况确定功能10a确定的用户希望或者情况相对应地在监视显示状态中改变显示图像模式时,出现了图像控制触发。 When the system controller determines that IO is determined by the user with the desired situation determination function 10a corresponding to a user or a case where the monitor display state to change the display image mode, an image control trigger occurs. 当系统控制器10确定需要与由用户情况确定功能10a所确定的用户希望或者情况相对应地完成监视显示状态并且将监视显示状态切换到通过状态时,出现监视显示状态完成触发。 When the system controller 10 determines that the desired function is determined by the user where the user determined or the case 10a corresponding to complete the monitor display state and switch the monitor display state to the through state, a monitor display state completion trigger occurs. 系统控制器10确定是否已经与用户的操作、用户的有意运动(被识别为操作的运动)、或者用户的无意运动或者情况(用户的身体情况、用户的识别等)相对应地出现了监视显示状态完成触发。 The system controller 10 determines whether the user's operation, a user's intentional motion (movement operation is identified as a), or a user's unintentional motion or situation (physical condition, the user of the user identification and the like) corresponding to a monitor display appears state completion trigger. 稍后将描述这些具体示例。 Specific examples of these will be described later. 当确定结果表示已经出现了图像控制触发时,流程从步骤F104 前进到步骤F106。 When the determined result denotes that has occurred when the image control trigger, the flow advances from step F104 to step F106. 在步骤F106,系统控制器10控制获取图像的显示操作。 In step F106, 10 system controller acquires an image display operation. 换句话说,系统控制器10命令图像获取控制部分11和显示控制部分14使显示部分2以与在这个时间点上的用户希望或者情况相对应的显示模式显示图像。 In other words, the system controller 10 commands the image capturing control section 11 and the display control section 14 causes the display section 2 to the user at this point in time corresponding to the desired or where the image display mode. 在步骤F106系统控制器10已经控制了显示模式之后,流程返回到步骤F104或者F105。 After step F106 the system controller 10 has controlled the display mode, the flow returns to step F104 or F105. 在步骤F104或者步猓F105,系统控制器IO监控是否已经出现了触发。 Guo step in step F104 or F105, the system controller IO monitor whether there have been triggered. 当确定结果表示已经出现了监视显示状态完成触发时,流程从步骤F105返回到步骤F101。 When the determined result denotes that has occurred when a monitor display state completion trigger, the flow returns from step F105 to step F101. 在步骤FIOI,系统控制器10命令图像获取控制部分11完成图像获取操作,并且命令显示控制部分14使显示部分2变为通过状态。 In step FIOI, the system controller 10 commands the image capturing control section 11 to complete the image capturing operation and commands the display control section 14 causes the display sections 2 to become the through state. 在用户戴上图像获取和显示设备l并且导通其电源时,系统控制器10中的操作控制功能10b执行图IO所示的控制处理。 When the user puts on the image capturing and displaying apparatus l and its power supply is turned on, the system control process shown in the operation control function controller 10 10b executes IO. 在这个处理过程中,与监视显示状态启动触发是否已经出现的确定结果相对应地执行监视显示启动控制。 In this process, the monitor display state start trigger has occurred if the determination result corresponding to the monitor display start control is performed. 与图像控制触发是否已经出现的确定结果相对应地控制显示模式。 Whether the trigger has occurred and controls the image control corresponding to the determination result display mode. 与监视显示状态完成触发是否后将参考图IIA和图IIB到图19A和图19B描述触发确定和控制的具体示例。 And whether or not a monitor display state completion trigger will IIA and IIB with reference to FIGS. 19A and 19B, a specific example is described to determine and control the trigger. 图IIA和图IIB到图19A和图19B示出了系统控制器10的用户情况确定功能10a的示范性处理。 IIA and IIB to FIGS. 19A and 19B show a case where the user of the system controller 10 determines an exemplary processing function 10a. 假定这些处理与图10所示的操作控制功能lOb的处理并行地执行。 FIG assumed that the processing operation of the processing control function 10 shown lOb are executed in parallel. 执行这些并行处理,以便例如当系统控制器10正在执行图IO所示的处理时,作为中断处理定期地执行图IIA和图IIB到图19A和图19B所示的检测处理。 These perform parallel processing, so that when the system controller 10 executes the processing shown in the IO is, as an interrupt process executes IIA and IIB detection process shown in FIGS. 19A and 19B to, for example, periodically. 图IIA和图IIB到图19A和图19B所示的处理的程序可以内置于执行图10所示的处理的程序中。 IIA and IIB FIGS 19A and 19B to the processing procedures shown may be built in the program 10 performs the processing shown in FIG. 作为替代,这些程序可以是定期调用的其它程序。 Instead, these programs may be other programs regularly call. 换句话说,这些程序的结构不局限于特定的结构。 In other words, the structure of these programs is not limited to a particular structure. 参考图IIA和图IIB,描述确定是否已经出现了导致将通过状态切换到监视显示状态的监视显示状态启动触发的示范性处理。 Referring to FIG IIA and IIB, description has occurred is determined whether the result in the monitor display is switched to the monitor display state start trigger exemplary process state by state. 图IIA和图11B示出了检测作为监视显示启动操作的用户运动的示范性处理。 FIGS IIA and 11B illustrate an exemplary process of detecting a monitor display start operation of the user's movement. 在图11A所示的步骤F200,系统控制器10监控由加速度传感器20或者陀螺仪21检测的信息(加速度信号或者角速度信号)。 In the step shown in FIG. 11A F200, the system controller 10 monitors the information from the acceleration sensor 20 or 21 detects the gyro (angular velocity signal or acceleration signal). 定义了诸如上下晃动颈部两次、横向晃动颈部一次、转动颈部一 Defined as shaking the neck up and down twice, shaking the neck of a lateral, a rotation of the neck

次等之类的预定运动为表示用户命令图像获取和显示设备1在监视显示状态下进行操作的操作。 Predetermined motion such as inferior showing a user commands the image capturing and displaying apparatus 1 to operate in the monitor display operation state. 当系统控制器IO确定用户已经执行了表示他或者她命令图像获取和显示设备1与加速度传感器20和/或陀螺仪21所检测的信息相对应地启动监视显示状态的运动时,流程从步骤F201前进到步骤F202。 When the system controller determines that the user has performed IO indicates that he or she commands the image capturing and displaying apparatus 1 motion state of the acceleration sensor 20 and / or gyro 21 information corresponding to the detected start the monitor display, the flow advances from step F201 advances to step F202. 在步骤F202,系统控制器10确定已经出现了用于所获取图像信号的监视显示状态启动触发。 In step F202, the system controller 10 determines that a monitor has occurred for the image signal acquired display state start trigger. 当在步骤F202的确定结果表示已经出现了监视显示状态启动触发时,流程从图10所示的步骤F102前进到步骤F103。 When the determined result at step F202 indicates has occurred when a monitor display state start trigger, the process step shown in FIG. 10 F102 proceeds to step F103. 在步骤F103, 系统控制器10控制显示部分2启动所获取图像的显示操作。 In step F103, 10 system controller display section 2 starts the operation of the image acquired. 作为加速度传感器20和/或陀螺仪21的信息而被检测的并且命令图像获取和显示设备1在监视显示状态下进行操作的用户预定运动的其它示例为跳跃、摆手、晃动手臂、晃动脚等。 As the acceleration sensor 20 and / or information gyro 21 is detected and commands the image capturing and displaying apparatus 1 on the monitor display other examples, a user predetermined movement operating state of the jump, waved, shaking the arm, shaking the foot like. 图11B是确定是否已经与视觉传感器19的信息相对应地出现了监视显示状态启动触发的示范性处理。 11B is determined corresponding to whether there has been an exemplary process monitor display state start trigger sensor 19 and the visual information. 在步骤F210,系统控制器10分析由视觉传感器19检测的信息。 Information in step F210, 10 is detected by the analysis system controller 19 of the visual sensor. 当将获取用户眼睛图像的图像获取部分布置为视觉传感器19时,系统控制器10分析由该图像获取部分获取的图像。 When the acquired image of the user's eye image acquisition section arrangement, part of the image acquisition system controller 10 analyzes the image acquired by the visual sensor 19 it is. 当假定用户连续眨眼三次的特定动作已经被定义为用户命令图像获取和显示设备l以监视显示状态进行操作的一个操作时,系统控制器10通过分析所获取的图像来监控动作。 When the user is assumed that the specific action blinked successively three times has been defined as a user commands the image capturing and displaying a l operation device operates to monitor display state, the system controller 10 monitors the action by analyzing the acquired image. 当系统控制器10已经检测到用户已经连续眨眼三次时,流程从步骤F211前进到步骤F212。 When the system controller 10 has detected that the user has blinked successively three times, the flow proceeds from step F211 to step F212. 在步骤F212,系统控制器10确定已经出现了用于所获取图像信号的监视显示状态启动触发。 In step F212, the system controller 10 determines that a monitor has occurred for the image signal acquired display state start trigger. 当在步骤F212的确定结果表示已经出现了监视显示状态启动触发时,流程从图10所示的步骤F102前进到步骤F103。 When the determined result at step F212 indicates has occurred when a monitor display state start trigger, the process step shown in FIG. 10 F102 proceeds to step F103. 在步骤F103, 系统控制器10控制显示部分2以便以监视显示状态启动所获取图像的显示操作。 In step F103, 10 system controller controls the display section 2 so as to display the display operation start to monitor the status of the acquired image. 与由视觉传感器19检测的信息相对应地被检测并且命令图像获取和显示设备1以监视显示状态进行操作的用户动作的其它示例包括 And corresponding to the information detected by the visual sensor 19 detects the command and other examples of image capturing and displaying a user to monitor the operation state of the operation display device comprising

转动眼球、横向移动它们两次、上下移动它们两次等。 Turning the eye, two lateral movement thereof, and the like and move them up and down twice. 除了与用户的有意动作相对应地将图像获取和显示设备1从通过状态切换到监视显示状态的这些示范性处理之外,还可以有其它动作。 In addition to corresponding to the image capturing and displaying apparatus 1 is switched from the through state to the monitor display state of these exemplary processing operation of the user's intentional addition, there may be other actions. 为了将通过状态切换到监视显示状态,例如,可以布置开关。 In order to switch the monitor display state to the through state, for example, it may be arranged a switch. 可以与开关的操作相对应地切换显示状态。 Display state can be switched to be opposed to the operation switch. 当用户已经从输入部分17输入了视野信息时,系统控制器10 可以确定已经出现了监视显示状态启动触发。 When the view information has been input from the user input section 17, the system controller 10 may determine that a monitor display state has occurred start trigger. 作为替代,当用户已经戴上图像获取和显示设备l时,系统控制器10可以确定已经出现了监视显示状态启动触发。 Alternatively, when the user has put on the image capturing and displaying apparatus L, the system controller 10 may determine that a monitor display state has occurred start trigger. 因为系统控制器10可以确定用户是否已经与生物学传感器22检测的信息相对应地戴上了图像获取和显示设备l,所以当生物学传感器22已经检测到例如脉搏、脑电波、皮肤电反应等时,系统控制器10可以确定已经出现了监视显示状态启动触发。 Because the information whether the system controller 10 may determine that the user has been detected by the biological sensor 22 and corresponding to put the image capturing and displaying apparatus L, so that when the biological sensor 22 has detected a pulse, for example, brain wave, galvanic skin response, etc. the system controller 10 may determine that there have been a monitor display state start trigger. 在这种情况下,当用户刚好戴上了图像获取和显示设备1时,图像获取和显示设备1以监视显示状态进行操作。 In this case, when the user just put on the image capturing and displaying apparatus 1, the image capturing and displaying apparatus 1 to operate in the monitor display state. 作为替代,当预定用户已经戴上了图像获取和显示设备l时,它可以以监视显示状态开始操作。 Alternatively, when a predetermined user has put on the image capturing and displaying apparatus L, it may be displayed in the status monitor start operation. 可以与由视觉传感器19检测到的眼底模式以及由生物学传感器22检测到的信号相对应地识别用户。 It may correspond to identify the user and detected by the visual sensor 19 and a signal fundus pattern detected by the biological sensor 22. 当已经登记了使用图像获取和显示设备1的用户的眼底模式和生物学信息时,系统控制器10可以确定该预定用户是否已经戴上了图像获取和显示{更备1。 When already registered using image capturing and displaying fundus pattern and the biological information of the user apparatus 1, the system controller 10 may determine whether or not the predetermined user has put on the image capturing and displaying apparatus 1 {more. 因此,当预定用户戴上图像获取和显示设备1时,系统控制器IO对他或者她进行验证。 Accordingly, when the predetermined user puts on the image capturing and displaying apparatus 1, the system controller for his or her IO verified. 当图像获取和显示设备l已经识别出预定用户时,系统控制器10确定已经出现了监视显示状态启动触发,并且控制图像获取和显示设备1以监视显示状态进行操作。 When the image capturing and displaying apparatus l has recognized the predetermined user, the system controller 10 determines that a monitor display state has occurred start trigger, and controls the image capturing and displaying apparatus 1 to operate in the monitor display state. 当允许将图像获取和显示设备1的功能仅仅用于预定用户时,可以将这样的个人验证添加为确定是否已经出现了监视显示状态启动触发的条件。 While allowing the function of the image capturing and displaying apparatus 1 is only for a predetermined user, such a personal authentication may be added to determine whether a condition has occurred in the monitor display state start trigger. 当与上述监视显示启动触发相对应地在显示部分2上显示获取 When the monitor display start trigger and corresponding to the display on the display section 2 acquires

的图像时,如图9B所示,区域AR1可以在显示部分2的屏幕上处于通过状态,而且可以在作为屏幕一部分的区域AR2中显示所获取的图像。 When the image shown in Figure 9B, area AR1 may be on screen portion 2 is in the status display, and the acquired image may be displayed as part of the screen in the area AR2. 接下来,参考图12A和图12B到图17A和图17B,描述作为图10所示的步骤F104中的处理的、确定是否已经出现了图像控制触发的示范性处理。 Next, with reference to FIGS. 12A and 12B to 17A and 17B, the description shown in FIG. 10 as step F104 in the process, it is determined whether the process has occurred exemplary image control trigger. 图12A示出了与用户视线的移动相对应地控制变焦操作的示范性处理。 FIG 12A illustrates an exemplary processing line of sight with the mobile user controlled corresponding zoom operation.

在图12A所示的步骤F300,系统控制器10分析由视觉传感器19检测到的信息。 In the step shown in FIG. 12A F300, the system 10 analyzes the information to the controller 19 is detected by the visual sensor. 例如,当将获取用户眼睛图像的图像获取部分布置为视觉传感器19时,系统控制器10分析所获取的图像。 For example, when the user image of the eye acquired image capturing section 19 is arranged, the system controller 10 analyzes the image acquired by the visual sensor.

当系统控制器10已经检测到用户的视觉方向已经向下移动时, 流程从步骤F301前进到步骤F302。 When the system controller 10 has detected that the user's visual direction has moved downward, the flow advances from step F301 to step F302. 在步骤F302,系统控制器10确定已经出现了放大(广角变焦)显示切换触发。 In step F302, the system controller 10 determines the amplification has occurred (wide angle zoom) display switching trigger.

当在步骤F302的确定结果表示已经出现了广角变焦切换触发时,流程从图10所示的步骤F104前进到F106。 When the determined result at step F302 indicates there have been a wide-angle zoom switching trigger process step shown in FIG. 10 F104 proceeds to F106. 在步骤F106,系统控制器10命令图像获取控制部分11执行放大操作。 In step F106, the system controller 10 commands the image capturing control section 11 performs amplification operation. 因此,显示部分2显示如图4B所示的图像。 Thus, the display sections 2 display an image as shown in FIG. 4B.

当用户的视线向下移动时,他或者她正在阅读报纸或者书本或者正在观看非常接近眼睛的位置。 When the user moves down the line of sight, he or she is reading a newspaper or a book or are very close eye viewing position. 因此,当放大图像时,它为近视或者老花眼的用户进行了适当的显示。 Accordingly, when the enlarged image, which was displayed to the user appropriate myopia or presbyopia.

图12B是与用户颈部(头部)的运动以及他或者她眼睛的焦距相对应地控制变焦操作的示范性处理。 12B is a motion of the user neck (head) and the focal length of his or her eyes corresponding to exemplary process controls the zoom operation.

在图12B所示的步骤F310,系统控制器10分析由视觉传感器19检测到的信息,并且检测与分析结果相对应的用户眼睛的焦距和视觉方向。 In the step shown in FIG. 12B F310, the system 10 analyzes the information to the controller 19 is detected by the visual sensor, and detects the focal length corresponding to the analysis result and visual direction of user's eyes. 在步骤F311,系统控制器10监控由加速度传感器20和陀螺仪21检测的信息(加速度信号和角速度信号),并且确定与所检测的信息相对应的、用户颈部的运动。 Corresponding to the motion of the user's neck at step F311, the system controller 10 monitors information determined by the gyro 20 and detected by the acceleration sensor 21 (acceleration signal and angular velocity signal), and the detected information.

此后,在步骤F312和步骤F313,系统控制器10与有关用户眼 Thereafter, in step F312 and step F313, the system controller 10 and the user-related eye

在看近处位置还是在看远处位置。 Watching nearby position or looking at the distant location. 当系统控制器IO确定用户正在看近处位置(特别是,他或者她的手)时,流程从步骤F312前进到步骤F314。 When the system controller determines that the user is seeing a near IO position (especially, his or her hand), the flow advances from step F312 to step F314. 在步骤F314,系统控制器10确定已经出现了放大(广角变焦)显示切换触发。 In step F314, the system controller 10 determines the amplification has occurred (wide angle zoom) display switching trigger. 在步骤F316, 系统控制器10计算与用户眼睛的焦距以及他或者她颈部(头部)的定向相对应的恰当变焦放大率。 Proper zoom magnification corresponding to the step F316, the system controller 10 calculates the focal length of the user's eyes and the orientation of his or her neck (head) of. 当系统控制器IO确定用户正在看远处位置时,流程从步骤F313 前进到步骤F315。 When the system controller determines that the user is looking IO distant position, the flow advances from step F313 to step F315. 在步骤F315,系统控制器10确定已经出现了远景变焦显示切换触发。 In step F315, the system controller 10 determines vision has occurred zoom display switching trigger. 在步骤F316,系统控制器IO计算与用户眼睛的焦距以及他或者她颈部(头部)的定向相对应的恰当变焦放大率。 In step F316, the system controller calculates the focal length IO user's eyes and his or her neck orientation (head) corresponding to the proper zoom magnification. 当已经执行了步骤F314和步骤F316的处理或者步骤F315和步骤F316的处理时,流程从如图10所示的步骤F104前进到步骤F106。 When the process of step F314 has been performed and the processing of step F316 and step F316 or step F315, the flow proceeds from the step shown in FIG. 10 F104 to step F106. 在步骤F106,系统控制器10命令图像获取控制部分11利用所计算的放大率执行变焦操作。 In step F106, the system controller 10 commands the image capturing control section 11 to perform a zoom operation with the calculated magnification. 因此,显示部分2显示与用户正在看的场景相对应的、如图4B 所示的放大图像或者如图3C所示的远景图像。 Thus, the display portion 2 displays the user is looking at a scene corresponding to the enlarged image shown in Figure 4B or a telescopic image as shown in FIG. 3C. 这样的操作变为协助近视和远视的用户的功能。 Such an operation becomes a function to assist users of myopia and hyperopia. 在图12A和图12B中,示范性地说明了由显示驱动部分13的变焦操作改变显示图像的处理。 In FIGS. 12A and 12B, illustrates an exemplary operation of changing the zoom driving section 13 by the display of the display images. 作为替代,系统控制器10可以导致显示图像处理部分12与用户的视觉方向、他或者她眼睛的焦距、他或者她颈部的定向等相对应地执行图像放大处理、图像缩小处理等。 Alternatively, the system controller 10 may cause the display image processing section 12 and the user's visual direction, the focal length of his or her eyes, the orientation of his or her neck and the like corresponding to the image enlargement processing is performed, the image reduction processing. 图13A示出了从输入部分17输入有关用户视野的信息的示范性处理。 FIG 13A shows a field of view about the user input from the input section 17 an exemplary process information. 当已经从输入部分17输入了有关用户视野的信息时,流程从图13A所示的步骤F400前进到步骤F401。 When information about user's visual field has been input from the input section 17, the step of the flow shown in FIG. 13A F400 proceeds to step F401. 在步骤F401,系统控制器IO确定已经出现了视野基础显示切换触发。 In step F401, the system controller determines IO has occurred based vision display switching trigger. 在步骤F402,系统控制器10计算与视野的值相对应的放大率。 The value of the field of view 10 of the system controller calculates in step F402 corresponds to magnification. 当已经执行了步骤F401和步骤F402的处理时,流程从图10所示的步骤F104前进到步骤F106。 When the process of step F401 has been performed and the step F402, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在步骤F106,系统控制器10命令 In step F106, the system controller 10 commands

显示图像处理部分12以所计算的放大率执行放大显示操作。 Display image processing section 12 to perform the calculated magnification enlarged display operation. 在这个处理过程中,显示部分2显示与用户视野相对应的放大图像。 In this process, the display portion 2 displays the user field of view corresponding to an enlarged image. 作为替代,系统控制器10可以将用户的眼底模式和视野信息相关联地预先存储到例如内部存储器中。 Alternatively, the system controller 10 may fundus pattern of the user and view information stored in advance in association, for example, internal memory. 通过检测用户他或者她的眼底模式来识别用户。 Detecting a user to identify the user by his or her eyes mode. 系统控制器10可以命令显示部分2显示与用户视野相对应的放大图像。 The system controller 10 may command the display sections 2 display the user field of view corresponding to an enlarged image. 图13B示出了对例如老花眼和散光并且应对黑暗环境的用户而言应对降低了的对于亮度、模糊度等的灵敏度的示范性处理。 FIG 13B shows an exemplary process sensitivity for luminance blur degree of presbyopia and astigmatism, for example, respond to the user and respond to dark in terms of reduced. 在步骤F410,系统控制器10监控由加速度传感器20和陀螺仪21检测的信息(加速度信号和角速度信号),并且确定与所检测的结果相对应的用户运动。 In step F410, the system controller 10 monitors information determined by the gyro 20 and detected by the acceleration sensor 21 (acceleration signal and angular velocity signal), and the detected result corresponding to the user motion. 例如,系统控制器10确定用户是否与检测结果相对应地处于其中他或者她不在行走的休息状态下。 For example, the system controller 10 determines whether the user corresponding to the detection result in the state that he or she is not walking resting therein. 在步骤F411, 系统控制器IO分析由视觉传感器19检测的信息,并且检测与分析结果相对应的用户眼睛的焦距、他或者她眼睛的瞳孔扩张、以及眼皮开合(screw-up )(他或者她的眼皮状态)。 In step F411, the system controller IO analyzes information detected by the visual sensor 19, and detects the focal length corresponding to the analysis result of the user's eyes, his or her eye pupil dilation, opening and closing of eyelids and (screw-up) (he or her eyelids state). 当确定结果表示用户处于休息状态并且正在看近距离或者正闭合(screw up )他或者她的眼皮时,流程从步骤F412前进到步骤F413。 When the determination result indicates that the user is at rest and is closed to see close or positive (screw up) his or her eyelids, the flow advances from step F412 to step F413. 在步骤F413,系统控制器10确定已经出现了老花眼等应对显示触发。 In step F413, the system controller 10 determines that there have been such as to deal with presbyopia display trigger. 当在步骤F413的确定结果表示已经出现了触发时,流程从图10 所示的步骤F104前进到F106。 When the determined result at step F413 indicates trigger has occurred, the step of the flow shown in FIG. 10 F104 proceeds to F106. 在这种情况下,系统控制器10命令显示驱动部分13提高图像获取灵敏度,并且命令获取图像信号处理部分15或者显示图像处理部分12执行增加亮度和对比度以及增强边缘(锐度)的处理。 In this case, the system controller 10 commands the display driving section 13 to improve the image capturing sensitivity and commands the captured image signal processing section 15 or the display image processing section 12 performs increased brightness and contrast and edge enhancement processing (sharpness) of. 因此,在这个处理过程中,显示部分2清楚地显示如图6B所示的图像。 Thus, in this process, the display portion in FIG. 2 clearly shows that the image shown in FIG. 6B. 因此,这个处理在有老花眼或者处于暗处的用户阅读例如报纸时可在视觉上协助用户。 Thus, this process users have presbyopia or reading in the dark, for example, can help users visually when newspapers. 在这种情况下,如图4B所示,系统控制器10可以导致显示部分2执行图像放大操作。 In this case, as shown in FIG. 4B, the system controller 10 may cause the display section 2 performs an image zoom operation. 当系统控制器IO确定用户处于与他或者她眼睛的瞳孔扩张相对应的暗处时,系统控制器10可以控制照明部分4进行照明。 When the system controller determines that the user is in IO pupil dilation with his or her eyes corresponding to a dark place, the system controller 10 may control the lighting section 4 to light up.

图14示出了取决于用户他或者她是舒服还是不舒服来应对用户视觉的示范性处理。 Figure 14 shows an exemplary depends on the user that he or she is comfortable handling or uncomfortable to deal with the user's vision. 在图14所示的步骤F420,系统控制器10分析由视觉传感器19 检测的信息,并且检测与分析结果相对应的、用户眼睛的瞳孔扩张和他或者她眼睛的眨眼(每单位时间的次数)。 In the step shown in FIG. 14 F420, the system controller 10 analyzes the information detected by the visual sensor 19, and detects the analysis result corresponding to the user's eye pupil dilation and blinks his or her eyes (number of times per unit time) . 在步骤F421,系统控制器10检查由生物学传感器22检测的脑电波、心率、出汗量、血压等的信息。 In step F421, the system controller 10 checks the information detected by the biological sensor 22 brain waves, heart rate, amount of perspiration, blood pressure and the like. 系统控制器10与由视觉传感器19和生物学传感器22检测到的信息相对应地确定用户对于观看显示部分2上显示的图像是感到舒服还是感到不舒服。 The system controller 10 and the information detected by the visual sensor 19 and biological sensor 22 determines that the user corresponding to the image viewed on the display section 2 display is comfortable or uncomfortable. 当确定结果表示用户对于观看图像没有感到舒服时,流程从步骤F422前进到步骤F423。 When the result of the determination indicates that the user to view images did not feel comfortable with the flow advances from step F422 to step F423. 在步骤F423,系统控制器10确定已经出现了图像调整控制触发。 In step F423, the system controller 10 determines an image has occurred adjustment control trigger. 在这种情况下,流程前进到步骤F424。 In this case, the flow proceeds to step F424. 在步骤F424,系统控制器10计算与用户情况(例如,亮度、对比度、锐度、 图像获取灵敏度、照明亮度等的情况)相对应地被认为是舒服的调整值。 In F424, the system controller 10 calculates the step where the user (e.g., brightness, contrast, sharpness, image capturing sensitivity of the case, the illumination brightness etc.) should be considered to be relatively comfortable adjustment value. 当已经执行了步骤F423和步骤F424的处理时,流程从图10所示的步骤F104前进到步骤F106。 When the process of step F423 has been performed and the step F424, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在这种情况下,在步骤F106,系统控制器10命令图像获取部分13调整图像获取灵敏度,并且命令获取图像信号处理部分15或者显示图像处理部分12执行调整亮度、对比度、锐度等的处理。 In this case, in step F106, the system controller 10 commands the image capturing section 13 to adjust the image capturing sensitivity and commands the captured image signal processing section 15 or the display processing is performed to adjust the brightness, contrast, sharpness and other image processing section 12. 在这个处理过程中,调整在显示部分2上显示的图像质量,以便使用户对于观看在显示部分2上显示的图像感到舒服。 In this process, the display image quality adjustment on the display section 2 so as to enable the user to view the image displayed on the display section 2 comfortable. 当确定结果表示用户处于暗处时,系统控制器10可以控制照明部分4 进行照明。 When the determination result indicates that the user is in a dark place, the system controller 10 may control the lighting section 4 to light up. 当因为例如用户视野、周围亮度、和他或者她眼睛的疲劳的情况而导致用户对观看显示部分2上显示的图像感觉不舒适时,这个处理过程向他或者她提供了舒适的可见情况。 When the user's field because, for example, ambient brightness, and where his or her eyes to fatigue caused by the user viewing the image on the display section 2 feels uncomfortable display, this process provides a comfortable visible situation to him or her. 例如,当用户处于暗处并且他或者她不能清楚地看到图像时,这个处理过程向他或者她提供了清晰的图像。 For example, when the user is in a dark place and he or she can not clearly see the image, this process he or she is to provide a clear image. 当用户的眼睛疲劳时,这个处理过程向他或者她提供了柔 When the user's eye fatigue, this process to provide him or her flexibility

和的图像。 And images. 用这样的方式执行图12A和图12B、图13A和图13B、以及图14所示的处理而不用用户进行有意的操作,以便使系统控制器10确定他或者她的情况并且与他或者她的情况相对应地控制显示图像模式。 12A and 12B performed in such a manner, and FIGS. 13A, FIG. 14 and the processing shown in FIG. 13B without user's intentional operation, so that the system controller 10 determines his or her situation and his or her case of a display image corresponding to the control mode. 相反,用这样的方式执行图15、图16、以及图17A和图17B所示的处理,以便将用户的有意动作当作图像控制触发(或者一种触发条件)。 In contrast, the implementation of FIG. 15 in such a manner, and the processing shown in FIG. 16 and FIG. 17A 17B, the user's intentional operation so as to image control trigger (or one trigger condition). 接下来,将参考图15、图16、以及图17A和图17B描述这些处理。 Next, with reference to FIG 15, FIG 16, FIGS. 17A and 17B and the processes described. 图15示出了将用户颈部(头部)的运动当作一个操作的处理。 FIG 15 shows the movement of the user's neck (head) as an operation of the process. 在步骤F500,系统控制器IO监控由加速度传感器20以及陀螺仪21检测的信息(加速度信号以及角速度信号)。 In step F500, the system controller IO information monitored by the acceleration sensor 20 and gyro 21 detects (acceleration signal and angular velocity signal). 在步骤F501,系统控制器10确定与所检测的信息相对应的用户头部运动。 In step F501, the system controller 10 determines the detected information corresponding to the user's head motion. 例如,系统控制器10确定用户是否已经向后倾斜他或者她的头部两次,他或者她是否已经向前倾斜他或者她的头部两次,或者他或者她是否已经向左晃动他或者她的颈部两次。 For example, the system controller 10 determines whether the user has tilted his or her head backward twice, if he or she has tilted his or her head forward twice, or he or she is already shaking his left or her neck twice. 当系统控制器IO检测到用户已经向后倾斜他或者她的头部两次时,流程从步骤F502前进到步骤F505。 When the system controller detects that the user has IO tilt his or her head backward twice, the flow advances from step F502 to step F505. 在步骤F505,系统控制器IO确定已经出现了2倍远景放大率的图像切换触发。 In step F505, the system controller determines has occurred IO 2x telescopic magnification image switching trigger. 在这种情况下,流程从图10所示的步骤F104前进到步骤F106。 In this case, the step of the flow shown in FIG. 10 F104 proceeds to step F106. 在步骤F106,系统控制器10命令图像获取控制部分11执行具有2 倍远景放大率的变焦操作。 In step F106, the system controller 10 commands the image capturing control section 11 to perform a zoom operation with a 2x telescopic magnification. 因此,如图3C所示,显示部分2显示具有2倍远景放大率的图像。 Thus, as shown in FIG. 3C, the display section 2 displays a 2x telescopic magnification image. 当系统控制器10检测到用户已经向前倾斜他或者她的头部两次时,流程从步骤F503前进步骤F506。 When the system controller 10 detects that the user has tilted his or her head forward twice, the flow advances from step F506 step F503. 在步骤F506,系统控制器10 确定已经出现了1/2倍远景放大率的图像切换触发。 In step F506, the system controller 10 determines a 1/2 has occurred telescopic magnification image switching trigger. 在这种情况下, 流程从图10所示的步骤F104前进到步骤F106。 In this case, the step of the flow shown in FIG. 10 F104 proceeds to step F106. 在步骤F104,系统控制器10命令图像获取控制部分11执行具有1/2倍远景放大率的变焦操作。 In step F104, the system controller 10 commands the image capturing control section 11 to perform a zoom operation with a 2x telescopic magnification 1/2. 因此,显示部分2显示具有1/2倍远景放大率的图像。 Thus, the display portion 2 exhibits a 1/2 2x telescopic magnification image. 当系统控制器10检测到用户已经向左晃动他或者她的颈部两次 When the system controller 10 detects that the user has shaking his or her neck to the left twice

时,流程从步骤F504前进到步骤F507。 , The flow advances from step F504 to step F507. 在步骤F507,系统控制器10确定已经出现了导致重置远景放大率的图像切换触发。 In step F507, the system controller 10 determines the reset has occurred that causes a telescopic magnification image switching trigger. 在这种情况下,流程从图10所示的步骤F104前进到步骤F106。 In this case, the step of the flow shown in FIG. 10 F104 proceeds to step F106. 在步骤F104, 系统控制器10命令图像获取控制部分11执行具有标准放大率的变焦操作。 In step F104, the system controller 10 commands the image capturing control section 11 to perform a zoom operation with a standard magnification. 因此,显示部分2显示具有标准放大率的图像。 Thus, the display sections 2 display an image with a standard magnification. 因为将用户的有意运动确定为触发,并且与此对应地切换显示图像模式,所以向他或者她提供了他或者她所期望的视野。 Because the user's intentional motion is determined as a trigger and a display image mode is switched to this correspondence, so he or she is provided to him or her desired view. 除了用户颈部的运动之外,还可以将诸如跳跃和他或者她的手、 手臂、以及腿的运动之类的他或者她整个身体的运动确定为预定操作。 In addition to the movement of the user's neck, such as jumping and also his or her entire body motion his or her hands, arms, and legs like the movement is determined to be a predetermined operation. 除了变焦操作之外,还可以与用户的动作或者运动相对应地执行图5B所示的图像放大操作、图像缩小操作、图像获取灵敏度操作、 获取图像帧频选择操作、图7B所示的增加红外图像获取灵敏度显示操作、图8B所示的增加紫外图像获取灵敏度显示操作、图9B所示的分离显示操作、图9C所示的闪烁(strobe)显示操作等。 In addition to zooming operation may also be performed corresponding to user's operation or a moving image as shown in FIG. 5B enlargement operation, the image reduction operation, an image capturing sensitivity operation, acquires the image frame rate selection operation, an increase in the infrared shown in Figure 7B image capturing sensitivity display operation, increased ultraviolet image capturing sensitivity shown in FIG. 8B show the separating operation, the display operation shown in FIG. 9B, 9C shown in FIG flashing (STROBE) display operation. 图16示出了将用户的动作当作与他或者她的情况和周围环境相对应的预定控制触发的处理。 FIG 16 illustrates the user's action as a predetermined controlling process with his or her condition and the surrounding environment corresponding to the trigger. 在图16所示的步骤F600,系统控制器IO分析由视觉传感器19 检测的信息,并且检测与分析结果相对应的、他或者她的眼睛的瞳孔扩张和眨眼。 In the step shown in FIG. 16 F600, the system controller IO analyzes information detected by the visual sensor 19, and detects the analysis result corresponding to his or her eye pupil dilation and blinks. 在步骤F601,系统控制器10监控由加速度传感器20 和陀螺仪21检测的信息(加速度信号和角速度信号),并且确定用户是否正在运动(停止)他或者她的颈部或者整个身体(未行走状态)。 In step F601, the system controller 10 monitors the information 20 and the gyro sensor 21 detects an acceleration (acceleration signal and angular velocity signal), and determines whether the user is moving (stops) his or her neck or whole body (non-walking state ). 在步骤F602,系统控制器10确定用户是否处于休息状态并且让他或者她的颈部向下倾斜,周围环境是否是黑的,以及他或者她是否已经执行了诸如他或者她已经眨眼三次之类的特定动作。 In step F602, the system controller 10 determines whether the user is at rest and let him or her neck tilted, if the surrounding environment is black, and whether he or she has performed such that he or she has blinked three times and the like the specific action. 换句话说,系统控制器10与由加速度传感器20和陀螺仪21所检测的信息相对应地确定用户是否处于休息状态并且让他或者她的颈部向下倾斜。 In other words, the system controller 10 and the information should be determined by the acceleration sensor 20 and gyro 21 detects whether the user is at rest relative and let his or her neck tilted. 另外,系统控制器10与用户眼睛的瞳孔扩张相对应地确定他或者她是否处于黑暗环境中。 Further, the system controller 10 and the user's eye pupil dilation is determined corresponding to whether he or she is in a dark environment. 当已经满足了这些条件时,系 When these conditions have been met, the Department of

统控制器10确定用户是否已经连续眨眼三次。 The system controller 10 determines whether the user has blinked successively three times. 当用户处于休息状态并让他或者她的颈部向下倾斜并且他或者她处于黑暗环境中时,他或者她正在黑暗房间中阅读某物。 When the user is at rest and let him or her neck tilted and he or she is in a dark environment, he or she is reading something in a dark room. 当在这种情况下用户已经有意地连续眨眼三次时,系统控制器10确定他或者她希望一个明亮且清晰的图像。 In this case, when the user has intentionally blink three times in a row, the system controller 10 determines that he or she wishes to a bright and clear image. 因此,当在这样的情况下系统控制器10检测到用户已经连续眨眼三次时,流程前进到步骤F603。 Thus, when in this case the system controller 10 detects that the user has blinked successively three times, the flow proceeds to step F603. 在步骤F603,系统控制器10确定已经出现了图像调整控制触发。 In step F603, the system controller 10 determines an image has occurred adjustment control trigger. 当已经执行了步骤F603的处理时,流程从图10所示的步骤F104 前进到步骤F106。 When the process of step F603 has been performed, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在这种情况下,在步骤F106,系统控制器10命令显示驱动部分13提高图像获取灵敏度,并且命令获取图像信号处理部分15或者显示图像处理部分12执行增加亮度、增强对比度和锐度等的处理。 In this case, in step F106, the system controller 10 commands the display driving section 13 to improve the image capturing sensitivity and commands the captured image signal processing section 15 or the display image processing section 12 performs to increase the brightness, contrast and sharpness enhancement processing such as . 作为替代,系统控制器10可以命令照明部分4进行照明。 Alternatively, the system controller 10 may command the lighting section 4 to light up. 因此,用户可以在舒服的情况下看见图像。 Thus, the user can see an image in a comfortable situation. 在这个示例中,只要已经满足了用户的情况和周围环境条件,就允许用户眼睛眨眼的操作。 In this example, as long as the user has met the conditions and ambient conditions, it allows the user's eye blinking operation. 这个处理过程是有效的,这是因为,甚至在用户已经无意地执行了相关动作之后,也不会改变图像。 This process is effective, it is because, even after the user has inadvertently execute the relevant action, it will not change the image. 图17A示出了获取参考图7B所述的具有增加红外灵敏度的图像的示范性处理。 FIG 17A shows an exemplary process with increased infrared sensitivity image acquired with reference to FIG. 7B. 与用户的身体情况相对应地允许或者禁止与用户动作相对应的操作。 Physical condition of the user corresponding to the user to enable or disable operation of the corresponding operation. 在图17A所示的步骤F700,系统控制器10监控由加速度传感器20和陀螺仪21检测的信息(加速度信号和角速度信号),并且确定与所检测的结果相对应的、用户颈部的运动和他或者她整个身体的运动。 At step F700 shown in FIG. 17A, the system controller 10 monitors the information 20 and the gyro sensor 21 detects an acceleration (acceleration signal and angular velocity signal), and determines the detected result corresponding to motion of the user's neck and his or her whole body movement. 在步骤F701,系统控制器10检查由生物学传感器22检测的脑电波、心率、出汗量、血压等。 In step F701, the system controller 10 checks the like by the biological sensor 22 detects the brain waves, heart rate, perspiration amount, blood pressure. 系统控制器10与由生物学传感器22 所检测的信息相对应地确定用户是否紧张或者兴奋。 The system controller 10 is determined corresponding to the information detected by the biological sensor 22 whether the user is nervous or excited. 当系统控制器10检测到导致图像获取和显示设备1执行红外图像获取搡作的预定动作(例如,他或者她已经晃动了其颈部)时,流程从步骤F702前进到步骤F703。 When the system controller 10 detects that causes the image capturing and displaying apparatus 1 performs a predetermined operation of the infrared image acquisition shoving made (e.g., he or she has rocked the neck), the flow advances from step F702 to step F703. 在步骤F703,系统控制器10确定 In step F703, the system controller 10 determines

用户是否紧张或者兴奋。 Whether users nervous or excited. 当系统控制器10确定用户既不紧张又不兴奋时,系统控制器IO 确定用户动作是有效操作。 When the system controller 10 determines that the user is neither nervous nor excited, the system controller determines that the user action is a valid IO operations. 此后,流程前进到步骤F704。 Thereafter, the flow advances to step F704. 在步骤F704, 系统控制器10确定已经出现了增加红外灵敏度的图像获取操作触发。 In step F704, the system controller 10 determines an increase has occurred infrared sensitivity image capturing operation trigger. 当已经执行了步骤F704的处理时,流程从图10所示的步骤F104 前进到步骤F106。 When the process of step F704 has been performed, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在这种情况下,在步骤F106,系统控制器10命令图像获取部分3增加红外图像获取灵敏度。 In this case, in step F106, the system controller 10 commands the image capturing section 3 to increase the infrared image capturing sensitivity. 因此,显示部分2显示如图7B所示的图像。 Thus, the display sections 2 display an image as shown in FIG. Fig. 7B. 相反,当步骤F703的确定结果表示用户紧张或者兴奋时,系统控制器10确定还没有出现增加红外灵敏度的图像获取操作触发。 In contrast, when the determined result at step F703 indicates that the user or the tension, the system controller 10 determines increased infrared sensitivity image capturing operation trigger has not appear excited. 换句话说,系统控制器10禁止与用户动作相对应的操作。 In other words, the system controller 10 prohibits an operation corresponding to a user operation. 因此,可以连同用户的身体情况的条件一起确定与他或者她的动作相对应的操作的有效性。 Therefore, it is possible to determine the validity of his or her actions corresponding to the operating conditions together with the physical condition of the user. 在这种情况下,可以有效地防止诸如增加红外灵敏度的图像获取操作之类的特殊图像获取功能被不恰当地使用。 In this case, it is possible to effectively prevent such as increased infrared sensitivity image capturing operation of such a special image acquisition function is used inappropriately. 图17B示出了获取参考图8B所述的具有增加紫外灵敏度的图像的示范性处理。 FIG 17B shows an exemplary process with increased ultraviolet sensitivity image acquired with reference to FIG. 8B. 在图17B所示的步骤F710,系统控制器10监控由加速度传感器20和陀螺仪21检测的信息(加速度信号和角速度信号),并且确定与所检测的结果相对应的、用户颈部的运动或他或者她整个身体的运动等。 In the step shown in FIG. 17B F710, the system controller 10 monitors the information (acceleration signal and angular velocity signal), and the gyro 20 and determines the acceleration sensor 21 detects the detected result corresponding to motion of the user's neck or his or her whole body exercise. 当系统控制器10检测到用户已经执行了导致图像获取和显示设备1执行紫外图像获取操作的预定动作时,流程从步骤F711前进到步骤F712。 When the system controller 10 detects that the user has performed a predetermined operation executing an ultraviolet image capturing operation of the image capturing and displaying apparatus cause, the flow advances from step F711 to step F712. 在步骤F712,系统控制器10确定已经出现了增加紫外灵敏度的图像获取操作触发。 In step F712, the system controller 10 determines an image has occurred to increase the UV sensitivity of the capturing operation trigger. 在已经执行了步骤F712的处理之后,流程从图10所示的步骤F104前进到步骤F106。 After the process of step F712 has been performed, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在这种情况下,在步骤F106,系统控制器IO 命令图像获取部分3增加紫外图像获取灵敏度。 In this case, in step F106, the system controller IO commands the image capturing section 3 to increase the ultraviolet image capturing sensitivity. 因此,显示部分2显示如图8B所示的图像。 Thus, the display sections 2 display an image as shown in FIG 8B.

在上文中已经示范性地说明了用于获取图像的显示模式切换触发和显示模式。 In the foregoing it has been described exemplarily for acquiring an image display mode and a display mode switching trigger. 应当注意到,可以有其它示例。 It should be noted that there may be other examples. 当与图像控制触发相对应地切换显示部分2的显示模式时,如图9B所示,显示部分2的屏幕中的区域AR1可以是通过状态或者显示正常获取的图像,而作为屏幕一部分的区域AR2可以以另一种显示模式显示图像。 When corresponding to the display mode switching section 2 and an image control trigger, as shown in FIG. 9B, area AR1 of the screen display section 2 may be an image acquired by the state or normal display, AR2 while the area of ​​the screen as part of the The image may be displayed in another display mode. 作为替代,作为宽阔区域的AR1可以显示与图像控制触发相对应的图像。 Alternatively, as a wide area AR1 may display an image corresponding to an image control trigger. 作为替代,可以相等地划分屏幕,并且可以在其中显示正常获取的图像和与图像控制触发相对应的图像。 Alternatively, the screen may be equally divided, and which can display a normally captured image and an image corresponding to an image control trigger. 接下来,将参考图18A、图18B、图19A、和图19B描述在图10所示的步骤F105中检测到的触发,即,导致监视显示状态被切换到获取图像的通过状态的触发。 Next, with reference to Figs. 18A, 18B, the FIG. 19A, and 19B described trigger detected in step F105 shown in FIG. 10, i.e., cause the monitor display state is switched to the image acquired by the triggered state. 图18A示出了与用户的有意动作相对应地完成监视显示状态的示范性处理。 FIG 18A shows a user's intentional operation is completed corresponding to an exemplary process of the monitor display state. 在图18A所示的步骤F800,系统控制器IO监控由加速度传感器20和陀螺仪21检测的信息,并且确定与所检测的信息相对应的、用户颈部的运动或他或者她整个身体的运动等。 F800, the system controller 20 and IO monitored by gyro information detected by the acceleration sensor 21, and determines in the step shown in FIG. 18A to the detected information corresponding to motion of the user his or her neck or whole body movement Wait. 当系统控制器10检测到用户已经执行了导致图像获取和显示设备1完成监视显示状态的预定动作时,流程从步骤F801前进到步骤F802。 When the system controller 10 detects that the user has performed resulting in the image capturing and displaying apparatus 1 to complete the monitor display a predetermined operation state, the flow advances from step F801 to step F802. 在步骤F802,系统控制器10确定已经出现了获取图像监视显示完成触发o当已经执行了步骤F802的处理时,流程从图10所示的步骤F105 前进到步骤FIOI。 In step F802, the system controller 10 determines has occurred while acquiring the image monitor display completion trigger o When the process of step F802 has been performed, the flow of steps shown in FIG. 10 proceeds to step F105 FIOI. 在这种情况下,在步骤FIOI,系统控制器10命令显示控制部分14将显示状态切换为通过状态。 In this case, at step FIOI, the system controller 10 commands the display control section 14 to switch to the status display. 因此,如图3A所示, 显示部分2将显示状态恢复为通过状态。 Thus, as shown in FIG. 3A, the display sections 2 restore the display state to the through state. 图18B示出了与用户的有意动作相对应地完成监视显示状态的示范性处理。 FIG. 18B shows a user's intentional operation is completed corresponding to an exemplary process of the monitor display state. 在图18B所示的步猓F810,系统控制器10分析由视觉传感器19检测的信息。 Guo step F810 shown in 18B, the information detected by the visual sensor 10 analyzes the system controller 19. 当用户连续眨眼三次的预定动作已经被定义为导致图像获取和显示设备l完成监视显示状态的用户操作时,系统控制器10 When a predetermined user operation blinked successively three times has been defined as causing the image capturing and displaying apparatus l complete user operates the monitor display state, the system controller 10

通过分析图像来监控动作。 To monitor actions by analyzing the image. 当系统控制器10检测到用户已经连续眨眼三次时,流程从步骤F811前进到步骤F812。 When the system controller 10 detects that the user has blinked successively three times, the flow proceeds from step F811 to step F812. 在步骤F812,系统控制器10确定已经出现了用于所获取图像信号的监视显示状态完成触发。 In step F812, the system controller 10 determines that a monitor has occurred for the image signal acquired display state completion trigger. 当已经执行了步骤F812的处理时,流程从图10所示的步骤F105 前进到步骤FlOl。 When the process of step F812 has been performed, the flow of steps shown in FIG. 10 F105 proceeds to step FlOl. 在步骤F101,系统控制器10命令显示控制部分14将显示状态切换为通过状态。 In step F101, the system controller 10 commands the display state through the state control portion 14 will display. 因此,如图3A所示,显示部分2将显示状态恢复为通过状态。 Thus, as shown in FIG. 3A, the display sections 2 restore the display state to the through state. 在图18A和图18B所示的处理中,当用户导致图像获取和显示设备l以通过状态进行操作时,显示部分2与他或者她的希望相对应地变为通过状态。 In the processing shown in FIG. 18A and 18B, when the user causes the image capturing and displaying apparatus l through state operation, the display section 2 with his or her wish to become the through state corresponding to. 当然,可以有导致显示部分2将显示状态恢复为通过状态的其它类型的用户动作。 Of course, there may cause the display sections 2 restore the display state via a state other type of user action. 图19A示出了与用户运动(他或者她的不被认为是操作的运动) 相对应地将显示状态自动恢复为通过状态的示范性处理。 FIG 19A shows a display state corresponding to motion of the user automatically restored (he or she is not considered to be moving operation) state through exemplary process. 在图19A所示的步骤F900,系统控制器IO监控由加速度传感器20和陀螺仪21检测的信息,并且确定是否有用户整个身体的运动。 In the step shown in FIG. 19A F900, the system controller 20 and IO monitored by gyro information detected by the acceleration sensor 21, and determines whether there is movement of the entire body of the user. 特别地,系统控制器IO检测用户是正在休息、行走、还是正在跑步。 In particular, the system controller detects IO user is resting, walking, or is running. 当系统控制器10确定用户已经开始行走或者跑步时,流程从步骤F卯1前进到步骤F902。 When the system controller 10 determines that the user has started walking or running, the flow advances from step 1 to step d F F902. 在步骤F902,系统控制器10确定已经出现了用于所获取图像信号的监视显示状态完成触发。 In step F902, the system controller 10 determines that a monitor has occurred for the image signal acquired display state completion trigger. 当已经执行了步骤F902的处理时,流程从图10所示的步骤F105 返回到步骤FIOI。 When the process of step F902 has been performed, the flow returns from the step shown in FIG. 10 F105 to step FIOI. 在这种情况下,在步骤FIOI,系统控制器10命令显示控制部分14将显示状态切换为通过状态。 In this case, at step FIOI, the system controller 10 commands the display control section 14 to switch to the status display. 因此,如图3A所示, 显示部分2将显示状态恢复为通过状态。 Thus, as shown in FIG. 3A, the display sections 2 restore the display state to the through state. 在用户正在行走或者跑步时,从安全的角度看,优选为将显示状态恢复为通过状态。 When the user is walking or running, from a security point of view, preferable to restore the display state to the through state. 并不是将显示状态恢复为通过状态,而是当用户正在行走或者跑步时,系统控制器10可以命令显示控制部分14将显示状态切换为正 Does not restore the display state to the through state, but when the user is walking or running, the system controller 10 may command the display control section 14 switches the display state is positive

常获取图像的监视显示状态,其中该正常获取图像类似于如图3B所示的用户在通过状态下看到的那个图像。 Often acquired image monitor display state, wherein the normally captured image of the user that shown in FIG. 3B seen in the image by a state similar to FIG.

图19B示出了与用户的身体情况相对应地将显示状态自动恢复为通过状态以便防止不恰当地使用红外图像获取操作的示范性处理。 FIG 19B shows the correspondence with the user's body automatically restore the display state to the through state where in order to prevent improper use of the infrared image acquisition exemplary processing operation.

在图19B所示步骤F910,系统控制器IO检查有关由生物学传感器22检测的例如脑电波、心率、出汗量、血压等的信息。 F910, the system controller checks IO information about a biological sensor 22 detects for example brain waves, heart rate, amount of perspiration, blood pressure, etc. in the step shown in FIG. 19B. 系统控制器10与由生物学传感器22所检测的信息相对应地确定用户是否紧张或者兴奋。 The system controller 10 is determined corresponding to the information detected by the biological sensor 22 whether the user is nervous or excited.

当正在执行增加红外灵敏度的图像获取操作时,流程从步骤F911前进到步骤F912。 When being executed increased infrared sensitivity image capturing operation, the flow advances from step F911 to step F912. 在步骤F912,系统控制器10确定用户是否紧张或者兴奋。 In step F912, the system controller 10 determines whether the user is nervous or excited.

当确定结果表示用户既不紧张又不兴奋时,系统控制器10允许图像获取和显示设备1继续该增加红外灵敏度的图像获取操作。 When the determination result indicates that the user is neither nervous nor excited, the system controller 10 allows the image capturing and displaying a continued increase the infrared sensitivity image capturing operation apparatus. 相反, 当确定结果表示用户紧张或者兴奋时,流程前进到步骤F913。 In contrast, when the result of the determination indicates that the user nervous or excited, the flow advances to step F913. 在步骤F913,系统控制器10确定已经出现了用于所获取图像的监视显示状态完成触发。 In step F913, the system controller 10 determines that a monitor has occurred for the acquired image display state completion trigger.

当已经执行了步骤F913的处理时,流程从图10所示的步骤F105 返回到步骤FIOI。 When the process of step F913 has been performed, the flow returns from the step shown in FIG. 10 F105 to step FIOI. 在这种情况下,在步骤FIOI,系统控制器10命令显示控制部分14将显示状态切换为通过状态。 In this case, at step FIOI, the system controller 10 commands the display control section 14 to switch to the status display. 换句话说,系统控制器10命令显示控制部分14完成增加红外灵敏度的图像获取操作的监视显示状态。 In other words, the system controller 10 commands the display control section 14 to complete the increased infrared sensitivity image acquisition operation monitor display state. 因此,显示部分2将显示状态恢复为通过状态。 Thus, the display sections 2 restore the display state to the through state.

优选为与用户的身体情况相对应地完成增加红外灵敏度的图像获取操作,并且将显示状态恢复为通过状态,以防止他或者她不正确地使用增加了红外灵敏度的图像获取操作。 Preferably operable to obtain user's physical situation to be completed relatively increased infrared sensitivity image, and restore the display state to the through state, to prevent him or her from the incorrect use of the increased infrared sensitivity image capturing operation.

并不是将显示状态恢复为通过状态,而是可以完成增加红外灵敏度的图像获取操作,并且可以显示正常获取的图像。 It does not restore the display state to the through state, but may increase the complete infrared sensitivity image capturing operation, and may display a normally captured image.

【6.第一实施例的效果、修改、和扩展J Example 6. Effect of the first embodiment, modifications, and extensions J

根据这个实施例,由布置在眼镜型安装单元或者头盔型安装单元中的图像获取部分3获取的图像,即,在作为被摄对象方向的用户眼 According to this embodiment, the image capturing section 3 is disposed in the image acquired by the glasses type mounting unit or a helmet type mounting unit, i.e., in a direction of the subject eye of the user

睛方向中的获取图像,被显示在他或者她的眼睛前面的显示部分2上。 Acquiring an image of the eye direction is displayed on the display section in front of his or her two eyes. 在这种情况下,与有关他或者她的运动或者身体情况相对应地控制图像获取操作或者显示操作。 In this case, relating to his or her sport or physical situation corresponding to control image acquisition operation or display operation. 因此,可以创建实质上协助或者扩展用户视觉能力的情况。 Therefore, you can create or expand without substantially assist the user's visual capabilities. 因为图像获取部分3的图像获取操作以及与获取图像信号处理部分15和显示图像处理部分12的信号处理相对应的显示模式改变是与和用户的运动或者身体情况有关的信息相对应地确定的用户希望或者情况相对应地执行的。 Because the image acquisition section 3 acquires the operation as well as section 15 and the display image and the captured image signal processing display mode of the signal processing section 12 corresponding to change the user with information and the user's movement or physical condition relating to corresponding to the determined corresponding to the case where desired or executed. 因此,没有向用户施加操作负担。 Thus, no operational burden is imposed to the user. 另外, 因为恰当地控制了图像获取和显示设备1,所以用户可以容易地使用它。 Further, since the proper control of the image capturing and displaying apparatus 1, the user can easily use it. 另外,因为通过控制显示部分2的透射率使其变为透明或者半透明的通过状态,所以当用户戴上安装单元时,它不会扰乱他或者她的正常生活。 Further, since the display by controlling the transmittance of the portion 2 so that it becomes transparent or translucent through state, when the user puts on the mounting unit, it does not disturb his or her normal life. 因此,在用户的正常生活中,可以有效地使用根据这个实施例的图像获取和显示设备1的益处。 Thus, the user's normal life, the benefits of acquisition can be effectively used in accordance with this embodiment of the image display apparatus 1 and. 在这个实施例中,已经主要描述了图像获取部分3的图像获取操作和通过获取图像信号处理部分15和显示图像处理部分12的信号处理实现的显示模式。 In this embodiment, it has been mainly described the image acquisition section 3 acquires the operation, and by acquiring the image signal processing section 15 and the display mode of the display image processing section 12 of the signal processing implementation. 例如,可以与用户的动作和/或身体情况相对应地控制通电、断电和待机的切换,以及从声音输出部分5输出的声音的音量和音质。 For example, the user's action and / or physical situation corresponding to the energization control switch, power off, and standby, as well as volume and quality of sound outputted from the sound output section 5. 例如,可以与例如生物学传感器22所检测的信息相对应地考虑到用户的舒适度来调整音量。 For example, the volume may be adjusted, for example, information detected by the biological sensor 22 corresponding to the user's comfort into consideration. 图像获取和显示设备1的外观和结构不局限于图1和图2所示的那些。 The image capturing and displaying apparatus 1 of the appearance and structure are not limited to those shown in FIG. 2 and FIG. 作为替代,可以进行各种修改。 Alternatively, various modifications can be made. 例如,可以在图像获取和显示设备l中布置存储由图像获取部分3获取的图像信号的存储部分,以及将图像信号发送到其它设备的传输部分。 For example, it may be arranged in the image capturing and displaying apparatus l signal stored in the storage portion of the image acquired by the image acquisition section 3, and the transmission section transmits the image signal to other devices. 除了作为显示部分2上显示的图像的来源的图像获取部分3之外,可以在图像获取和显示设备l中布置从外部设备输入图像的输入部分和接收部分。 In addition to the source image as a display image on the display section 2 outside the acquisition portion 3 can acquire and display portion disposed external device input from the input section and the image in the image receiving apparatus l. 另外,可以在图像获取和显示设备1中布置识别图像中包含的字 Further, the display device can be acquired and a word contained in an image in the image recognition arrangement

符的字符识别部分,和执行声音合成处理的声音合成部分。 Sound synthesizing portion of the character recognition section breaks, and performs the voice synthesizing process. 当获取的图像包含字符时,声音合成部分可以生成阅读语音信号,而且声音输 When the acquired image contains characters, the sound synthesizing section may generate a reading voice signal and the voice input

出部分5可以输出与该信号相对应的语音。 Out section 5 may output a voice corresponding to the signal.

在这个实施例中,描述了其中图像获取和显示设备1是眼镜型安装单元或者头盔型安装单元的示例。 In this embodiment, an example of an image capturing and displaying apparatus 1 is an eyeglass-type or helmet-type mounting unit, wherein the mounting unit. 然而,只要图像获取和显示设备沿用户眼睛的方向获取图像并且在他或者她的眼睛前面显示图像,该设备可以是用户可戴上的任何类型,诸如头戴耳机型、领口型、耳桂型等。 However, as long as the image capturing and displaying apparatus along the direction of user's eyes and displays an image acquired in front of his or her eye an image, the device may be any type of user you can be put on, such as a headphone type, neck type, ear type Gui Wait. 作为替代,图像获取和显示设备l可以是使用诸如回形针之类的安装部件附着于眼镜、帽舌、头戴耳机等的单元。 Alternatively, the image capturing and displaying apparatus l can be used, such as paper-clips and the mounting member attached to eyeglasses, visor, headphones or the like head unit.

(第二实施例) (Second Embodiment)

接下来,将以下列次序描述根据本发明第二实施例的图像获取和显示设备以及图像获取和显示方法。 Next, description will be in the following order and the image capturing and displaying apparatus according to the image capturing and displaying method of a second embodiment of the present invention.

[l.图像获取和显示设备的示范性外观】 [2.图像获取和显示设备的示范性结构】 [3.示范性显示图像] 【4.用户情况的确定】 【5.示范性操作】 [L. Exemplary appearance of image capturing and displaying apparatus] [2. The image capturing and displaying apparatus] An exemplary structure [3. exemplary display images] [4 determines the user's situation] [5] Exemplary Operation

【6.第二实施例的效果、修改、和扩展】 【l.图像获取和显示设备的示范外观】 Example 6. Effect of the second embodiment, modifications, and extensions] [l. Exemplary appearance of image capturing and displaying apparatus]

根据第二实施例的图像获取和显示设备的示范性外观与根据第一实施例的示范性外观相同。 Capturing and displaying apparatus and an exemplary appearance of the same according to an exemplary embodiment of the appearance of a first embodiment according to a second embodiment of an image.

[2.图像获取和显示设备的示范示范性外观结构J Exemplary exemplary [2. The image capturing and displaying apparatus external structure J

图20示出了根据本发明第二实施例的图像获取和显示设备101 的示范性内部结构。 FIG 20 illustrates the image acquisition and display according to a second embodiment of the present invention, an exemplary embodiment of an internal configuration of the device 101.

系统控制器110包含微计算机,其包括例如CPU (中央处理单元)、ROM (只读存储器)、RAM (随机存取存储器)、非易失性存储器部分、和接口部分。 The system controller 110 comprises a microcomputer, which includes, for example, a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a nonvolatile memory section, and the interface section. 系统控制器110是控制图像获取和显示设备101中的全部部分的控制部分。 The system controller 110 is a control section to control the image capturing and displaying all parts of the apparatus 101.

系统控制器110与外部情况相对应地控制图像获取和显示设备101中的每个部分。 The system controller 110 controls the external case corresponding to the image capturing and displaying apparatus 101 in each section. 换句话说,系统控制器110与用于检测和确定外 In other words, the system controller 110 for detecting and determining the outside

部情况的操作程序相对应地进行操作,并且与所检测和确定的情况相 Procedure portions corresponding to the case of operation, and in the case of the phase detection and determination

对应地控制每个部分。 Corresponding to control each section. 因此,如图20所示,系统控制器110在功能上包括确定外部情况的外部情况确定功能110a和与外部情况确定功能110a的确定结果相对应地控制和命令每个部分的操作控制功能110b。 Thus, as illustrated, the external case of the system controller 110 functionally includes an external situation determination function 20 determines the determination result determination function 110a and 110a of the external case corresponding to the control command and operation control function 110b of each portion.

在图像获取和显示设备IOI中布置了图像获取部分103、图像获取控制部分111、和获取图像信号处理部分115,作为用于获取在用户前面的图像的结构。 In the image capturing and displaying apparatus arranged IOI image capturing section 103, the image capturing control section 111, and the captured image signal processing section 115, as a structure for acquiring an image in front of the user.

图像获取部分103包括透镜系统(其具有图像获取透镜103a(如图l所示)、光围、变焦透镜、聚焦透镜等),使透镜系统执行聚焦操作和变焦操作的驱动系统,以及固态图像传感器阵列,其中固态图像传感器阵列检测由透镜系统获得的获取图像的光、将光转换为电、 并且生成与电相对应的获取图像信号。 The image capturing section 103 includes a lens system (having the image capturing lens 103a (shown in FIG. L), the light around, a zoom lens, a focus lens), the lens system to perform a focusing operation and a zoom driving system operation, and a solid-state image sensor array, wherein the optical image acquiring solid state image sensor array detection obtained by the lens system, converts light into electricity, and generates an electrical signal corresponding to the acquired image. 固态图像传感器阵列包含例如CCD (电荷耦合器件)传感器阵列或者CMOS (互补金属氧化物半导体)传感器阵列。 E.g. solid state image sensor array comprises CCD (charge coupled device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.

获取图像信号处理部分115包括采样保持/AGC(自动增益控制) 电路和视频A/D转换器,其中该采样保持/AGC电路调整由图像获取部分103中的固态图像传感器阵列所获得的信号的增益并且修整该信号的波形。 Acquiring an image signal processing section 115 includes a sample holding AGC (Automatic Gain Control) circuit and a video A / D converter, wherein the sample hold / AGC circuit adjusts the signal of the solid-state image sensor array section 103 obtained by the image acquisition gain / and shaping of the waveform of the signal. 获取图像信号处理部分115获得获取图像信号作为数字数据。 Acquiring an image signal processing section 115 obtains a captured image signal as digital data. 获取图像信号处理部分115为所获取的图像信号执行白平衡处理、 亮度处理、彩色信号处理、振动校正处理等。 Acquiring an image signal processing section 115 performs image signal processing of the acquired white balance, luminance processing, color signal processing, the vibration correction processing.

图像获取控制部分111与从系统控制器110接收的命令相对应地控制图像获取部分103和获取图像信号处理部分115的操作。 The image capturing control section 111 and the command received from the system controller 110 controls the image corresponding to the operation acquisition section 103 and the captured image signal processing section 115. 图像获 The image won

理部分115的操作。 Operation processing portion 115. 另夕;,图像获取控制部分lll控制图像获取部分103以(通过马达)执行自动聚焦操作、自动曝光调整操作、光围调整操作、变焦操作等。 Another Xi;, lll image capturing control section 103 controls the image capturing section to perform (by motor) autofocus operation, automatic exposure adjustment operation, the light confining adjustment operation, a zoom operation.

另外,图像获取控制部分lll包括定时发生器。 Further, the image capturing control section includes a timing generator lll. 图像获取控制部分111利用由定时发生器生成的定时信号控制固态图像传感器阵列和图像获取控制部分111中的采样保持/AGC电路和视频A/D转换器。 The image capturing control section 111 controls the solid state image sensor array and the image capturing control section 111 of the sample holding / AGC circuit and the video A / D converter with a timing signal generated by the timing generator. 另外,图像获取控制部分111可以利用定时信号改变获取图像的帧频。 Further, the image capturing control section 111 may use the timing signal change the frame rate of the image acquired. 另外,图像获取控制部分111控制固态图l象传感器阵列和获取图像信号处理部分115的图像获取灵敏度和信号处理。 Further, the image acquisition section 111 controls the solid-state image sensor array of FIG controls l and captured image signal processing section 115 the image capturing sensitivity and signal processing. 为了控制图像获取灵敏度,图像获取控制部分111控制例如已经从固态图像传感器阵列读取的信号的增益、黑电平设置、获取图像信号处理中的数字数据的各种类型的系数、振动校正处理的校正量等。 In order to control the image capturing sensitivity, the image capturing control section 111 controls the gain, for example, black level signal that has been read from the solid state image sensor array, acquires various types of coefficients of digital signal processing image data, the vibration correction processing correction amount. 对于图像获取灵敏度调整,图像获取控制部分lll可以执行总灵敏度调整,而不考虑波段和用于诸如红外线区和紫外线区之类的特定波段的特定灵敏度调整(例如,可以这样获取图像以便截取预定波段)。 For image capturing sensitivity adjustments, the image capturing control section may perform lll overall sensitivity adjustment regardless of a wavelength band and specific sensitivity adjustments such as a specific band of infrared and ultraviolet regions of the region (e.g., such an image may be acquired in order to intercept a predetermined wavelength band ). 可以通过在图像获取透镜系统中插入波长滤波器,以及通过为所获取的图像信号执行波长滤波计算处理,来执行波长特定的灵敏度调整。 In the image acquisition by inserting a wavelength filter lens system, and the image signal obtained by performing a wavelength filter calculation process is performed to adjust the sensitivity of a particular wavelength. 在这些情况下,图像获取控制部分111可以通过插入波长滤波器和/或指定滤波计算系数来控制灵敏度。 In these cases, the image capturing control section 111 of the wavelength filter and / or specifying a filter calculation coefficient sensitivity can be controlled by insertion. 作为向用户显示数据的结构,图像获取和显示设备101包括显示部分102、显示图〗象处理部分112、显示驱动部分113、和显示控制部分114。 As the structure of the data displayed to the user, the image capturing and displaying apparatus 101 includes a display portion 102, a display image processing section 112 in FIG〗, a display driving section 113, and a display control section 114. 将其图像已经由图像获取部分103获取并然后由获取图像信号处理部分115处理的获取图像信号提供给显示图像处理部分112。 The image which has been acquired by the image acquiring section 103 and then processed by the acquisition section 115 acquires the image signal processing the image signal to the display image processing section 112. 显示图像处理部分112例如是所谓的视频处理器。 Display image processing section 112, for example, a so-called video processor. 显示图像处理部分112 为所提供的获取图像信号执行各种类型的显示处理。 Display image processing section 112 performs various types of display process to acquire an image signal supplied. 显示图像处理部分112可以为所获取的图像信号执行例如亮度级调整、彩色校正、对比度调整、锐度(边缘增强)调整等。 Display image processing section 112 may be acquired as the image signal is performed, for example, brightness level adjustment, color correction, contrast adjustment, sharpness (edge ​​enhancement) adjustment. 另外,显示图像处理部分112 可以生成其中放大获取图像信号的一部分的放大图像和缩小图像,突出显示一部分图像,分离图像以便进行分离显示,组合图像,生成字符图像和图形图像,以及将所生成的图像和获取图像相叠加。 Further, the display image processing section 112 can generate an enlarged image of a portion of the amplified acquired image signal, wherein and the reduced image, highlight a part of an image, the separate image for separate display the combined image to generate a character image and a graphic image, and the generated image acquisition and image superimposed. 换句话说,显示图像处理部分112可以为作为获取图像信号的数字图像信号 In other words, the display image processing section 112 may be acquired as a digital image signal of an image signal

执行各种类型的处理。 Performs various types of processing.

显示驱动部分113包含像素驱动电路,其在例如为液晶显示器的显示部分102上显示从显示图像处理部分112提供的图像信号。 The display driving section 113 includes a pixel drive circuit, for example, on the display section in the liquid crystal display 102 displays an image signal supplied from the display image processing section 112. 换句话说,显示驱动部分113以预定的水平/垂直驱动定时将基于图像信号的驱动信号施加到显示部分102中以矩阵形状形成的每个像素中,以导致显示部分102显示图像。 In other words, the display driving section 113 in a predetermined horizontal / vertical driving timing for each pixel applied to the display portion 102 in a matrix shape in an image signal based on the drive signal to cause the display sections 102 display an image. 另外,显示驱动部分113控制每个像素的透射率以导致显示部分102变为通过状态。 Further, the display driving section 113 controls the transmittance of each pixel to cause the display sections 102 become the through state.

显示控制部分114与从系统控制器110接收的命令相对应地控制显示图像处理部分112的处理和操作以及显示驱动部分113的操作。 The display control portion 114 receives a command from the system controller 110 controls the display corresponding to the image processing section 112 and the operating section 113 and a display driving operation. 换句话说,显示控制部分114使显示图像处理部分112执行上述各种类型的处理。 In other words, the display control section 114 causes the display image processing section 112 performs various types of processes described above. 另外,显示控制部分114控制显示驱动部分113,以导致显示部分102在通过状态和图像显示状态之间切换显示状态。 Further, the display control section 114 controls the display driving section 113 to cause the display section 102 to switch the display state between the through state and the image display state.

在以下的描述中,其中显示部分102变为透明或者半透明的状态被称为"通过状态",而其中显示部分102显示图像的操作(及其状态) 被称为"监视显示状态"。 In the following description, the display sections 102 becomes transparent or translucent state is called "through state", wherein the display operation of the image display portion 102 (and its state) is referred to as a "monitor display state."

另外,图像获取和显示设备IOI包括声音输入部分106、声音信号处理部分106、和声音输出部分105。 Further, the image capturing and displaying apparatus includes a sound input portion IOI 106, a sound signal processing section 106, and a sound output section 105.

声音输入部分106包括图1所示的麦克风106a和106b,以及麦克风放大部分,其处理由麦克风106a和106b获得的声音信号。 A sound input portion 106 includes a microphone 106a shown in FIG. 1 and 106b, and a microphone amplifying section that processes sound signals obtained by the microphones 106a and 106b.

声音信号处理部分116包含例如A/D转换器、数字信号处理器、 D/A转换器等。 A sound signal processing section 116 comprises, for example, A / D converter, a digital signal processor, D / A converter or the like. 声音信号处理部分116将从声音输入部分106提供的声音信号转换为数字数据,并且在系统控制器110的控制下执行音量调整、音质调整、音响效果等处理。 A sound signal processing section 116 from the voice input portion 106 provided for the sound signal into digital data, and perform volume adjustment under control of the system controller 110, the sound quality adjustment, sound and other treatment. 声音信号处理部分116将产生的声音信号转换为模拟信号,并且将模拟信号提供给声音输出部分105。 Sound signal into a sound signal processing section 116 generates an analog signal, and the analog signal to the sound output section 105.

声音信号处理部分116不局限于执行数字信号处理的结构。 A sound signal processing section 116 is not limited to the structure performing the digital signal processing. 相反,声音信号处理部分116可以利用模拟放大器和模拟滤波器执行信号处理。 Instead, the sound signal processing section 116 can use an analog amplifier and analog filter performs signal processing.

声音输出部分105包括图1所示的一对耳机扬声器105a,以及用于耳机扬声器105a的放大器电路。 The sound output section 105 shown in FIG. 1 includes a pair of earphone speakers 105a, 105a of a speaker and a headphone amplifier circuit. 声音输入部分106、声音信号处理部分116、和声音输出部分105 允许用户通过图像获取和显示设备101听到外部声音。 An audio input portion 106, a sound signal processing section 116, and a sound output portion 105 allows a user through the image capturing and displaying apparatus 101 to hear the external sound. 声音输出部分105可以被构造为所谓的骨质(osseous)传导扬声器。 The sound output section 105 may be configured as a so-called bone (osseous) conduction speaker. 另外,图像获取和显示设备101包括声音合成部分127。 Further, the image capturing and displaying apparatus 101 includes a sound synthesizing section 127. 声音合成部分127合成与从系统控制器110发布的命令相对应的声音,并且输出所合成的声音信号。 Synthesis sound synthesizing section 127 and sound corresponding to the command issued by the system controller 110, and outputs the synthesized sound signal. 声音合成部分127将合成的声音信号输出到声音信号处理部分116。 The sound synthesizing section 127 outputs the synthesized sound signal to the sound signal processing section 116. 声音信号处理部分116处理合成的声音信号,并且将产生的信号提供给声音输出部分105。 A sound signal processing section 116 processes the synthesized sound signal and supplies the generated signal to the sound output section 105. 声音输出部分105将声音输出给用户。 The sound output section 105 outputs sound to the user. 声音合成部分127生成将在稍后描述的阅读语音的声音信号。 Sound synthesizing section 127 generates a sound signal will be read speech described later. 另外,图像获取和显示设备1包括照明部分104和照明控制部分118。 Further, the image capturing and displaying apparatus 1 includes an illumination portion 104 and the illumination control section 118. 照明部分104包含图1所示的发光部分104a (例如,发光二极管)以及导致发光部分104a发光的发光电路。 The illumination portion 104 includes a light emitting portion 104a (e.g., light-emitting diode) shown in Figure 1, and cause the lighting circuit to emit light emitting portion 104a. 照明控制部分118使照明部分104与从系统控制器110提供的命令相对应地执行发光操作。 Lighting control section 118 commands the illumination portion 104 and supplied from the system controller 110 performs light emission corresponding to the operation. 因为照明部分104中的发光部分104a被布置为使发光部分104a 向前方照明,所以照明部分104在用户的视觉方向上执行照明操作。 Since the light emitting portion 104a of the lighting section 104 is arranged such that the light emitting portion 104a to the front lighting, so that the lighting section 104 performs a lighting operation in the user's visual direction. 作为获得外部信息的结构,图像获取和显示设备101包括周围环境传感器119、获取目标传感器120、 GPS接收部分121、日期与时间计数部分122、图像分析部分128、和通信部分126。 As the structure of the obtained external information, the image capturing and displaying apparatus 101 includes a surrounding environment sensor 119, the capturing target sensor 120, GPS reception section 121, the date and time counting section 122, the image analyzing section 128, and the communication section 126. 周围环境传感器119具体而言是亮度传感器、温度传感器、湿度传感器、大气压力传感器等,用于检测有关周围亮度、温度、湿度、 天气等的信息作为图像获取和显示设备101的周围环境。 Surrounding environment sensor 119 is specifically a brightness sensor, a temperature sensor, a humidity sensor, an atmospheric pressure sensor for detecting information on ambient brightness, temperature, humidity, weather or the like as the image capturing and displaying apparatus 101 to the surrounding environment. 作的获取目标的:息的传感器。 Sensor rate: access target made. 获取目标传感器120可以是测距传感器,其检测有关例如从图像获取和显示设备101到获取目标的距离的信息。 Capturing target sensor 120 may be a distance sensor that detects, for example, information about the distance from the image capturing device 101 to obtain the target display. 获取目标传感器120可以是诸如红外传感器之类的传感器,其是 Capturing target sensor 120 may be a sensor such as an infrared sensor or the like, which is

在这种情况下,获取目标传感器120可以检测获取目标是否为诸如人或者动物之类的活体。 In this case, the capturing target sensor 120 can detect whether the capturing target such as a human or animal living body or the like.

作为替代,获取目标传感器120可以是诸如各种类型的UV (紫外线)传感器之一这样的传感器,其检测获取目标的紫外线发射的预定波长和能量的信息。 Alternatively, the capturing target sensor 120 may be of various types such as UV (ultraviolet) sensor is one such sensor, which detects information acquired certain UV emission of a predetermined wavelength and energy. 在这种情况下,获取目标传感器120可以检测获取目标是否是荧光材料或者磷光体,并且检测对抗太阳晒黑所必需的外部紫外线发射量。 In this case, the capturing target sensor 120 can detect whether the capturing target is a fluorescent material or a phosphor, and detects the amount of external sun against UV emitting tanning necessary.

GPS接收部分121从GPS (全球定位系统)卫星接收无线电波, 获得图像获取和显示设备IOI的当前位置,并且输出当前位置的经绵度信息。 GPS receiving section 121 receives radio waves from a GPS (Global Positioning System) satellite, cotton obtain information of the current position of the image capturing and displaying apparatus IOI, and outputs the current position.

日期与时间计数部分122是所谓的时钟部分,其对日期与时间(年、月、日、小时、分钟和秒)进行计数,并且输出当前日期与时间的信息。 The date and time counting section 122 is a so-called clock section that counts the date and time (year, month, day, hour, minutes, and seconds) and outputs information of the current date and time.

图像分析部分128分析由图像获取部分103和获取图像信号处理部分115获取和处理的图像。 The image analyzing section 128 analyzes the image capturing section 103 and the captured image signal processing section 115 acquires and processes. 换句话说,图像分析部分128分析作为被摄对象的图像,并且获得包含在获取图像中的被摄对象的信息。 In other words, the image analyzing part 128 analyzes an image as a subject and obtains information contained in the subject image is acquired.

通信部分126与外部设备进行数据通信。 The communication section 126 performs data communication with an external device. 外部设备的示例包括具有信息处理功能和通信功能的任何类型的设备,诸如计算机设备、 PDA (个人数字助理)、移动电话、视频设备、音频设备、和调谐器设备。 Examples of external devices include any type of device having an information processing function and a communication function, such as a computer device, PDA (personal digital assistant), a mobile phone, video equipment, audio equipment, and a tuner device.

另外,外部设备的示例可以包括连接到诸如国际互联网之类的网络的终端设备和服务器设备。 Further, examples of the external device may include a connection to a network such as the Internet or the like of the terminal device and a server device.

另外,外部设备的示例可以包括非接触型通信IC卡,其具有内置IC芯片、诸如QR码之类的二维条型码、以及通信部分126从中获得信息的全息图存储器, Further, examples of the external device may include a non-contact type communication IC card having a built-in IC chip, such as a QR code or the like two-dimensional barcode, and a communication section 126 to obtain hologram information memory,

另外,外部设备的示例可以包括另一个图像获取和显示设备 Further, examples of the external device may include another image capturing and displaying apparatus

101' 101 '

通信部分126可以与例如与无线LAN系统、蓝牙系统等相对应 The communication section 126 may be for example a wireless LAN system, Bluetooth system or the like corresponding to the

的附近接入点进行通信。 Nearby access points to communicate. 作为替代,通信部分126可以直接与具有相应通信功能的外部设备进行通信。 Portion 126 may communicate with an external device having a corresponding communication function as an alternative, direct communication. 这些周围环境传感器119、获取目标传感器120、 GPS接收部分121、 日期与时间计数部分122、图像分析部分128、和通信部分126 获得图像获取和显示设备IOI的外部信息,并且将所获得的信息提供给系统控制器110。 These surrounding environment sensor 119, the capturing target sensor 120, GPS reception section 121, the date and time counting section 122, the image analyzing section 128, and the communication section 126 obtains an image capturing and displaying external information apparatus IOI, and the obtained information is provided a system controller 110. 系统控制器IIO执行操作控制功能110b的处理,以便与由外部情况确定功能110a获得的外部信息相对应地控制图^^获取操作和显示操作。 The system controller performs operation control function 110b IIO processing to the external information by the external situation determination function 110a corresponding to the obtained control of FIG ^^ capturing operation and the display operation. 换句话说,系统控制器110命令图像获取控制部分111控制图像获取部分103和获取图像信号处理部分115的操作。 In other words, the system controller 110 commands the image capturing control section 111 controls the image capturing section 103 and the captured image signal processing section 115 operation. 另外,系统控制器110命令显示控制部分114控制显示图像处理部分112和显示驱动部分113的操作。 Further, the system controller 110 commands the display control section 114 controls the display image processing section 112 and the display operation portion 113 of the drive. 在这个实施例中,获得外部信息的结构包括周围环境传感器119、获取目标传感器120、 GPS接收部分121、日期与时间计数部分122、 图1象分析部分128、以及通信部分126。 In this embodiment, the structure of the obtained external information includes the surrounding environment sensor 119, the capturing target sensor 120, GPS reception section 121, the date and time counting section 122, image analysis section 128 in FIG. 1, and a communication section 126. 然而,在该结构中,可以省略它们中的一些。 However, in this structure, some of them may be omitted. 另外,可以在图像获取和显示设备IOI中布置其它传感器,诸如检测和分析周围语音的语音分析部分。 Further, other sensors may be disposed in the image capturing and displaying apparatus IOI, such as detecting and analyzing the voice analysis portion around speech. [3.示范性显示图像】系统控制器110与所获得的外部信息相对应地控制图像获取操作和显示操作。 [Image] 3. The exemplary display system controller 110 and the external information corresponding to the obtained control the image capturing operation and the display operation. 因此,用户识别显示部分102的各种显示模式.图3A 到图3C至图9A到图9C、图21A和图21B、以及图22A到图22B 示范性地说明了各种显示模式。 Thus, the user identification section 102 displays various display modes of Figures 3A to 3C to FIGS. 9A to 9C, the 21A and 21B, the FIG. 22B and FIGS. 22A to exemplarily illustrate various display modes. 图3A示出了其中显示部分102处于通过状态的状态。 3A shows a state in which the display portion 102 by state. 换句话说, 在这个状态下,显示部分102是简单的透明平面部件,而且用户可通过透明的显示部分102看到视野中的场景。 In other words, in this state, the display portion 102 are simple transparent planar member 102 and the user can see a scene in the field of view through the transparent display portion. 图3B示出了其中由图像获取部分103获取的图像被显示在处于监视显示状态下进行操作的显示部分102上的状态。 FIG 3B shows a case where the image acquired by the image acquisition section 103 is displayed in the monitor display state on the display section 102 operating state. 图像获取部分103、获取图像信号处理部分115、显示图像处理部分112、和显示驱动部分113以图3A所示的状态进行操作,以便使它们正常地在显示 The image acquisition section 103 acquires the image signal processing section 115, the display image processing section 112, and the display driving section 113 operate in the state shown in FIGS. 3A, so that they normally display

部分102上显示获取的图像。 A display portion 102 of image acquisition. 在这种情况下,显示部分102上显示的获取图像(正常获取的图像)几乎与在通过状态下进行操作的显示部分102上显现的图像相同。 In this case, the display portion 102 to display the same on the acquired image (normally captured image) almost visualized on the display section 102 and operating in a state in the image. 换句话说,在这个状态下,用户看到正常的视野作为获取的图像。 In other words, in this state, the user sees a normal visual field as a captured image.

图3C示出了其中系统控制器110使图像获取部分103通过图像获取控制部分111获取远景图像的状态。 FIG 3C shows a case where the system controller 110 causes the image capturing control section 103 acquires images acquired vision status portion 111 through the image.

相比之下,当系统控制器110导致图像荻取部分103通过图像获取控制部分111获取广角图像时,在显示部分102上显示近距离广角图像(未示出)。 In contrast, when the system controller 110 resulting in the image acquisition control section 103 Di taken by the image acquisition section when the wide-angle image 111, short-range wide-angle image displayed on the display (not shown) on the portion 102. 虽然图像获取部分103通过驱动图像获取部分103 的变焦透镜来执行远景和广角控制,但是获取图像处理部分115可以通过处理信号来执行这些控制。 Although the image acquisition section 103 acquires the zoom lens section 103 is performed by driving the vision and wide-angle image control, but acquires the image processing section 115 may perform these controls by processing signals.

图4A示出了其中显示部分102处于通过状态下、例如用户正阅读报纸的状态。 4A shows that the display sections 102 are in the through state, for example, the state of the user is reading the newspaper.

图4B示出了所谓的广角变焦状态。 4B shows a so-called wide angle zoom state. 换句话说,图4B示出了这样的状态,在该状态下,获取近焦距变焦图像,并且将其显示在显示部分102,以便例如放大报纸中的字符。 In other words, FIG. 4B shows a state, in this state, the focal length of the zoom obtain near image, and displayed on the display section 102, such as a newspaper for the enlarged character.

图5A示出了这样的状态,其中显示部分102显示正常获取的图像或者显示部分102处于通过状态下。 5A shows a state in which the display sections 102 display a normally captured image or the display sections 102 are in the through state.

此时,当系统控制器110命令显示图像处理部分112通过显示控制114执行图像放大处理时,在显示部分102上显示如图5B所示的放大图4象。 At this time, when the system controller 110 commands the display image processing section 112 by the display control processing 114 performs the image is enlarged, the display on the display section 102 shown in the enlarged image shown in FIG. 5B 4.

图6A示出了这样的状态,其中显示部分102显示正常获取的图#»或者显示部分102处于通过状态下。 6A shows a state in which the display sections 102 display a normally captured # »or the display portion 102 in the through state. 特别地,图6A示出了其中用户正在阅读报纸或者书本的状态。 In particular, FIG. 6A shows a user is reading a newspaper or a state in which the book. 在这种情况下,假定因为周围是昏暗的,所以用户不能用正常获取的图像或者在显示部分102的通过状态下看见报纸等中的字符。 In this case, it is assumed that since the surroundings are dim, the user can not use a normally captured image or the like to see in newspaper characters in the status display portion 102.

在这种情况下,系统控制器IIO命令图像获取控制部分111 (图像获取部分103和获取图像信号处理部分115 )增加图像获取灵敏度, 和/或使显示控制部分114 (显示图像处理部分112和显示驱动部分 In this case, the system controller IIO commands the image capturing control section 111 (the image capturing section 103 and the captured image signal processing section 115) to increase the image capturing sensitivity and / or causes the display control section 114 (display image processing section 112 and the display driving part

113)增加亮度和调整对比度和锐度,以便在显示部分102上显示比图6A所示的图像更锐化的、如图6B所示的图像。 113) increase the brightness and adjust the contrast and sharpness so as to display an image shown in FIG. 6A is sharper than that on the display portion 102, the image shown in FIG. 6B. 相反,当系统控制器110使照明部分104执行照明操作时,可以在显示部分102上锐利地显示图像。 Conversely, when the system controller 110 causes the lighting section 104 performs a lighting operation, a sharp display can display an image on the portion 102. 图7A示出了这样的状态,其中显示部分102显示正常获取的图像或者显示部分102处于通过状态下。 7A shows a state in which the display sections 102 display a normally captured image or the display sections 102 are in the through state. 在这种情况下,用户处于其中孩子正在睡觉的黑暗卧室中。 In this case, the user is in the dark where the children were sleeping in the bedroom. 因为用户处于黑暗房间中,所以他或者她不能利用正常获取的图像或者在显示部分102的通过状态下清楚地看见孩子。 Because the user is in a dark room, he or she can not use a normally captured image or the child clearly visible in the display portion 102 via a state. 此时,当系统控制器110命令图像获取控制部分111 (图像获取在显示部分102上显示如图7B所示的红外获取图像,以便使用户能够看见孩子的睡着面部等。图8A示出了这样的状态,其中显示部分102显示正常获取的图像或者显示部分102处于通过状态下。当系统控制器110命令图像获取控制部分111(图像获取部分103 和获取图像信号处理部分115)增加紫外图像获取灵敏度时,在显示部分102上显示如图8B所示的、具有紫外线分量的获取图像。图9A示出了其中显示部分102处于通过状态下的状态。当系统控制器110命令显示控制部分114(显示图像处理部分112 和显示驱动部分113)分别显示图像或者分别显示图像和部分地放大图像时,可以在显示部分102上显示图9B所示的图像。换句话说, 显示部分102的屏幕被分离为区域AR1和AR102,其中区域AR1处于通过状态或者处于正常图像显示状态 At this time, when the system controller 110 commands the image capturing control section 111 (the image capturing shown in FIG. 7B shows an infrared image is acquired, so that the user can see the child's sleeping face 102 and the like on the display portion. FIG. 8A shows the a state in which the display sections 102 display a normally captured image or the display portion 102 in the through state. when the system controller 110 commands the image capturing control section 111 (the image capturing section 103 and the captured image signal processing section 115) to increase the ultraviolet image capturing when the sensitivity is displayed on the display section 102 as shown in FIG. 8B, the component having an ultraviolet image is acquired. 9A shows a state in which the display portion 102 by the state. when the system controller 110 commands the display control section 114 ( display image processing section 112 and the display driving section 113), respectively, are displayed when the display image or the enlarged image and the partial image, the image shown in FIG. 9B may be displayed on the display portion 102. in other words, the display screen section 102 is separated for the region AR1 and AR102, where area AR1 is in the through state or a normal image display state ,而区域AR102处于放大图像显示状态下。图9C示出了另一个示范性分离显示。在这种情况下,显示部分102的屏幕被分离为区域AR1、 AR102、 AR3、和AR4,这些区域显示以预定时间段间隔获取的图像的帧。系统控制器110使显示图像处理部分112以0.5秒的间隔从所获取的图像信号中提取一帧,并且以 And the area AR102 is an enlarged image display state. FIG. 9C shows another exemplary separation display. In this case, the display screen section 102 is separated into areas AR1, AR102, AR3, and AR4, the region display frames acquired at a predetermined time interval of the image. the system controller 110 causes the display image processing section 112 at intervals of 0.5 seconds to extract a signal obtained from the image, and to

区域AR1、 AR2、 AR3、 AR4、 AR1、 AR2等的次序显示所提取的帧。 Sequence regions AR1, AR2, AR3, AR4, AR1, AR2 and the like of the extracted display frame. 在这种情况下,分离地在显示部分102上显示所谓的闪烁显示模式的图像。 In this case, separately on the display section 102 displays an image called flicker display mode.

图21A示出了这样的状态,其中显示部分102显示正常获取的图像或者显示部分102处于通过状态下。 21A shows a state in which the display sections 102 display a normally captured image or the display sections 102 are in the through state. 因为图21A所示的图像是其中在屋顶上有阳光和阴影边界的英式足球体育场的场景,所以很难看见图像。 Because the image shown in FIG. 21A is a scene in which there is a soccer stadium sunlight and shadow boundaries on the roof, it is difficult to see the image.

系统控制器110为CCD传感器或者CMOS传感器上与阴影部分相对应的像素增加图像获取灵敏度或者显示亮度。 The system controller 110 on a CCD sensor or a CMOS image sensor increases the shaded pixels corresponding capturing sensitivity or the display brightness. 相反,系统控制器110为与阳光相对应的像素降低图像获取灵敏度或者显示亮度。 Instead, the system controller 110 and the sun pixels corresponding reduced image capturing sensitivity or the display brightness. 因此, 如图21B所示,显示其中降低了阳光和阴影影响的图像。 Thus, as shown in FIG. 21B, it displays the reduced image in which the influence of sunshine and shadow.

图22A和图22B示出了其中显示包含例如小鸟的图像以便突出显示小鸟的状态。 22A and 22B show an example in which the display comprises an image of a bird to highlight the state of the birds.

当在图像中检测到小鸟时,如果突出显示小鸟,则可防止用户遗漏作为被摄对象的小鸟。 When a bird is detected in the image, if the bird is highlighted, the user can be prevented from missing the bird as a subject.

作为突出显示图像的处理,可以降低感兴趣的部分的亮度。 As highlighted in the image processing can be reduced luminance portion of interest. 作为替代,可以降低不同于感兴趣部分的部分的亮度。 Alternatively, it is possible to reduce luminance portion different from the portion of interest. 可以用彩色显示感兴趣的部分。 Portion of interest may be displayed in color. 可以单色显示不同于感兴趣部分的部分.作为替代,可以利用诸如框架、光标、指针标记等之类的任意字符图像来突出显示感兴趣的部分。 Monochrome display portion may be different from the portion of interest. Alternatively, you can use any character image such as a frame, a cursor, a pointer mark, or the like to display the projecting portion of interest.

上述显示图像仅仅是示范性的。 The display image is merely exemplary. 换句话说,当控制图像获取部分103、获取图像信号处理部分115、显示图像处理部分112、和显示驱动部分113的处理和操作时,可以实现各种显示模式。 In other words, when the image acquisition control section 103, the captured image signal processing section 115, the display image processing section 112, and display processing and the operation of the drive portion 113, various display modes can be realized.

例如,预计有许多类型的显示模式,诸如,远景显示模式、广角显示模式、在从远景显示模式到广角显示模式的范围中变化的缩小显示模式和放大显示模式、图像放大显示模式、图像缩小显示模式、可变帧频显示模式(以高帧频获取图像或者以低帧频获取图像)、高亮度显示模式、低亮度显示模式、可变对比度显示模式、可变锐度显示模式、增加了灵敏度的获取图像显示模式、增加了红外灵敏度的获取 For example, we expected there are many types of display modes, such as a telescopic display mode, a wide angle display mode, from a telescopic display mode to a wide angle display narrow mode change display mode and the enlarged display mode, an image enlargement display mode, an image reduction display mode, a variable frame rate display mode (image captured at a high frame rate or the image captured at a low frame rate), high brightness display mode, a low brightness display mode, a variable contrast display mode, a variable sharpness display mode, an increased sensitivity acquiring an image display mode, an increased infrared sensitivity captured

图像显示模式、增加了紫外灵敏度的获取图像显示模式、其中截取了预定波段的图像显示模式、图像效果显示模式(诸如马赛克图像、亮度反转图像、柔焦图像、部分屏幕突出显示图像、具有可变颜色氛围的图像等)、緩慢显示模式、逐帧显示模式、与这些显示模式相结合的分离显示模式、与通过状态和获取图像相结合的分离显示模式、闪烁显示模式、具有所获取图像中的一帧的静止图像显示模式等。 Image display mode, an increased ultraviolet sensitivity captured image display mode, the image display mode wherein intercepting a predetermined wavelength band, image effect display modes (such as a mosaic image, a brightness inverted image, a soft focus image, a partial screen highlight image, having variable color atmosphere of the image or the like), a slow display mode, the display mode from frame to frame, in combination with the separation of these display modes the display mode, the state and the captured image by combining the split display mode, flashing mode, with the acquired image a still image display mode. 【4.对外部信息的检测】如上所述,作为获得外部信息的结构,图像获取和显示设备101 包括周围环境传感器119、获取目标传感器120、 GPS接收部分121、 日期与时间计数部分122、图像分析部分128、以及通信部分126。 [4. Detection of external information] As described above, the structure of the obtained external information, the image capturing and displaying apparatus 101 includes a surrounding environment sensor 119, the capturing target sensor 120, GPS reception section 121, the date and time counting section 122, the image analysis section 128, and a communication section 126. 周围环境传感器119的示例可以包括亮度传感器、温度传感器、 湿度传感器、大气压力传感器等。 Example surrounding environment sensor 119 may include a brightness sensor, a temperature sensor, a humidity sensor, an atmospheric pressure sensor. 亮度传感器检测图像获取和显示设备IOI的周围亮度信息。 Brightness sensor detects the brightness around the image capturing and displaying information of the device the IOI. 温度传感器、湿度传感器、和大气压力传感器获得可以利用其确定温度、湿度、大气压力、和天气的信息。 A temperature sensor, a humidity sensor, and atmospheric pressure sensor obtain information which may be utilized to determine the temperature, humidity, atmospheric pressure, and weather. 因为周围环境传感器119可以确定周围亮度、户外天气情况等, 所以系统控制器110可以与被确定为外部信息的周围亮度和天气情况相对应地控制图像获取操作和显示操作。 Since the surrounding environment sensor 119 can determine the surrounding brightness, outdoor weather conditions, the system controller 110 may control the image corresponding to the external information is determined as the ambient brightness and weather acquisition operation and display operation. 获取目标传感器120检测有关获取目标的信息。 Capturing target sensor 120 detects information about the capturing target. 获取目标传感器120可以是测距传感器或者热电传感器。 Capturing target sensor 120 may be a distance measuring sensor or a pyroelectric sensor. 获取目标传感器120可以获得到获取目标的距离以及利用其确定获取目标的信息。 Capturing target sensor 120 to obtain the distance to the target can be obtained and the use of which determines the acquired object information. 当获取目标传感器120已经检测了到获取目标的距离时,系统控制器110可以与所检测的距离相对应地控制图像获取操作和显示操作。 When the capturing target sensor 120 has detected the distance to the target is acquired, the system controller 110 may control the image corresponding to the detected distance capturing operation and the display operation. 当获取目标传感器120已经检测到获取目标是诸如人之类的活体时,系统控制器IIO可以与获取目标相对应地控制图像获取操作和显示操作。 When the capturing target sensor 120 has detected the target is to obtain a living body such as a human, the system controller IIO may control the image corresponding to the acquisition target acquisition operation and display operation. GPS接收部分121获得当前位置的经炜度信息。 Wei receives GPS information obtained current position of the portion 121. 当GPS接收部分121已经参考地图数据库等检测到当前位置的经綷度时,可以获得有关当前位置的信息(有关当前位置邻近的信息)。 When the GPS receiving section 121 has detected the reference map database or the like via a current position of 綷, it is possible to obtain information about the current position (information about the current location adjacent). 当图像获取和显 When the image capturing and significant

示设备101包括系统控制器110可以访问并且具有相对大的记录容量的记录介质(诸如HDD (硬盘驱动器)或者闪速存储器)(未在图20示出),而且记录介质已经记录了地图数据库时,可以获得有关当前位置的信息。 When the apparatus 101 shown includes a system controller 110 may access and has a relatively large recording capacity of a recording medium (such as a HDD (hard disk drive) or flash memory) (not shown in FIG. 20), and the recording medium has recorded a map database , you can get information about the current location. 即使图像获取和显示设备101不具有内置的地图数据库,图像获取和显示设备101也可以导致通信部分126访问例如具有内置地图数据库的网络服务器或者设备,将当前位置的经綷度信息发送到该网络服务器或者设备,请求该网络服务器或者设备将有关当前位置的信息发送到通信部分126,并且接收该信息。 Even if the image capturing and displaying apparatus 101 does not have a built-in map database, the image capturing and displaying apparatus 101 may cause the communication section 126 to access for example, a built-in map database of the network server or the device, will be transmitted via 綷 of information of the current location to the network server or the device, request the network server or the device to send information about the current position to the communication section 126, and receive the information. 有关当前位置的信息示例包括地名、建筑物名称、机构名称、商店名称、站名等。 Examples include information about the current location of the place name, building name, organization name, store name, station name and so on. 另外,有关当前位置的信息示例包括诸如停车场、主题游乐园、 音乐厅、剧场、电影院、和运动场之类的、代表建筑物类型的信息。 In addition, information about the current location includes examples such as a car park, theme parks, concert halls, theaters, cinemas, and sports grounds, the building represents the type of information. 另外,有关当前位置的信息示例包括诸如海滨、河流、山脉、山顶、森林、湖、和草原之类的、自然事物的类型和名称。 In addition, information about the current location, including examples such as the seaside, rivers, mountains, hill, forest, lake, grassland, and the like, the type and name of the natural things. 有关更详细位置的信息示例包括主题游乐园中的区域、棒球场和英式足球体育场中的区域、以及音乐厅中的区域。 Example For more detailed information including the location of the theme park in the region, regional baseball field and soccer stadiums, and concert halls in the area. 当已经获得了有关当前位置的信息时,系统控制器110可以与当前位置、当前位置附近的地理条件、机构等相对应地控制图像获取操作和显示操作。 When having received information on the current position, the system controller 110 may be associated with the current position, the current position near the geographical conditions, the control mechanism or the like corresponding to the image capturing operation and the display operation. 日期与时间计数部分122对例如年、月、日、小时、分钟、和秒进行计数。 The date and time counting section 122, for example, year, month, day, hour, minute, and second counts. 系统控制器110可以识别出与由日期与时间计数部分122 所计数的值相对应的当前时间、白天或者晚上、月、季节等。 The system controller 110 may identify the portion of the value counted by the count 122 the date and time corresponding to the current time, day or night, month, season and the like. 因此, 系统控制器110可以与白天或者晚上(时间)相对应地控制图像获取操作和显示操作,并且与当前季节相对应地控制这些操作。 Thus, system controller 110 may (time) corresponding to day or night control the image capturing operation and display operation corresponding to the current season and the control of these operations. 图像分析部分128可以从获取的图像中检测出有关获取目标的各种类型的信息。 The image analyzing section 128 can detect various types of information about the capturing target from the acquired image. 首先,图像分析部分128可以从获取的图像中识别出人、动物、 自然事物、建筑物、机器等作为获取目标的类型。 First, the image analysis section 128 can be identified from the captured images of people, animals, natural objects, buildings, machinery, etc. as the type of acquisition targets. 对于动物而言,图像分析部分128可以识别其中已经获取小鸟作为被摄对象的情况,其中已经获取小猫作为被摄对象的情况等。 For the animal, the image analyzing section 128 can identify where the bird has been acquired as the subject, wherein the kitten has been acquired as the subject, and the like. 对于自然事物而言,图像分析部分128可以从获取的图像中识别出海、山脉、树、河流、湖、天空、太阳、月亮等。 For natural things, the image analysis section 128 can identify the sea, mountains, trees, rivers, lakes, sky, sun, moon, etc. from the acquired image. 对于建筑物而言,图像分析部分128可以从获取的图像中识别出房子、建筑物、体育场等。 For a building, the image analyzing section 128 can recognize the image acquired from the houses, buildings, stadiums and the like. 对于设备而言,图像分析部分128可以从获取的图像中识别出个人计算机、AV (视听)设备、移动电话、PDA、 IC卡、二维条形码等作为获取目标。 For the device, the image analyzing section 128 can recognize the image acquired from the personal computer, the AV (Audio Visual) device, a mobile phone, PDA, IC card, a two-dimensional bar code as the acquisition targets. 当将各种类型的获取目标的形状特征预先登记到图像分析部分128中时,可以与所登记的特征相对应地确定获取图像中所包含的被摄对象。 When the various types of acquired target shape feature registered in advance in the image analysis portion 128, the registered feature may be determined corresponding to the acquired image of the subject included. 另夕卜,图像分析部分128可以例如通过检测图像的相邻帧的差别来从获取的图像中检测出被摄对象的运动,例如被摄对象的快速运动。 Another Bu Xi, for example, the image analyzing section 128 can be detected by detecting the difference of adjacent frames of the image from an acquired image of the subject motion, for example fast moving objects subject. 例如,图像分析部分128可以检测其中正在获取被摄对象(例如, 在体育比赛或者正在运行的汽车中的选手)的情况。 For example, the image analyzing section 128 can detect where the subject is acquired (e.g., the players in the sports car is running or in the) case. 另外,图像分析部分128可以通过分析图像来确定周围情况。 Further, the image analyzing section 128 surroundings can be determined by analyzing an image. 例如,图像分析部分128可以确定由于白天、晚上或者天气导致的亮度。 For example, the image analyzing section 128 may determine that since the day, night, or weather-luminance. 另外,图像分析部分128可以识别出下雨的强度等。 Further, the image analyzing section 128 can recognize the strength of rain. 另外,图像分析部分128可以通过分析图像来确定其中例如正在获取书本或者报纸的情况。 Further, the image analyzing section 128 may determine the case wherein for example a book or a newspaper is being acquired by analyzing an image. 例如,图像分析部分128可以通过从图像中识别出字符或者识别出书本或者报纸的形状来确定这样的情况。 For example, the image analyzing section 128 can determine such a situation by recognizing characters from an image or identify the shape of a book or a newspaper. 当图像分析部分128已经识别出字符时,系统控制器110可以将所识别出的字符作为文本数据提供给声音合成部分127。 When the image analyzing section 128 has recognized characters, the system controller 110 may provide the identified character to the sound synthesizing section 127 as text data. 另外,当人作为被摄对象时,图像分析部分128可以通过分析图像来根据面部识别人。 Further, when a person as a subject, the image analyzing section 128 can identify the person from the face by analyzing the image. 众所周知的是,可以将人的面部登记为个人特征数据,其是面部的结构单元的相对位置信息。 It is well known, a person's face can be registered as personal characteristic data that are relative position information of structural units of the face. 例如,在眼睛的中心和鼻子之间的距离EN和眼睛的距离Ed的比值(Ed/EN),以及在眼睛的中心和嘴之间的距离EM和眼睛的距离Ed的比值(Ed/EM), 对于每个人来说是唯一的。 For example, the ratio between the eyes and nose of the center distance and the distance Ed EN eye (Ed / EN), and the ratio between the center of the eye and the mouth and the distance Ed of the distance EM eye (Ed / EM) , it is unique to each person. 另外,人的面部不会受诸如发型、眼镜等之类的穿戴物的影响。 In addition, the wearer's face was not affected, such as hairstyle, glasses, and the like. 另外,众所周知的是,人的面部不会随着他或者她的年龄而改变。 In addition, it is known that a person's face will not end with his or her age and change. 因此,当获取的图像包含人的面部时,图像分析部分128可以通过分析图像来检测上述个人特征数据。 Thus, when a captured image contains a person's face, the image analyzing section 128 may detect the above-described individual characteristic data by analyzing the image. 当图像分析部分128已经从所获取的图像中检测到个人特征数据时,如果系统控制器110具有例如HDD (硬盘驱动器)、闪速存储器等作为系统控制器110可以访问并且其中已经记录了个人数据库的记录介质,则图像分析部分128可以从个人数据库中获得被摄对象的个人信息。 When the image analyzing section 128 has been detected from the acquired image to a personal characteristic data, if the system controller 110 has a HDD (hard disk drive), flash memory, etc. The controller 110 may access a system and which has been recorded, for example, a personal database recording medium, the image analyzing section 128 can obtain personal information of the subject from the personal database. 即使图像获取和显示设备101不具有内置的个人数据库, 系统控制器110也可以使通信部分126访问例如具有内置个人数据库的网络服务器或者设备,请求该服务器或者设备将信息发送到通信部分126,并且接收来自其的特定个人信息。 Even if the image capturing and displaying apparatus 101 does not have a built-in personal database, the system controller 110 may cause the communication section 126 having a built-in personal database, for example, access the network server or the device, request the server or device to transmit information to the communication section 126, and receive specific personal information from its in. 当用户已经连同个人特征数据一起向个人数据库登记了用户已经遇到的、诸如每个人的姓名、单位等之类的个人信息时,如果用户遇到了特定人员(已经获取了他或者她的图像)的话,则图像获取和显示设备101可以从个人数据库中检索有关该个人的信息。 When the user has registered along with the personal characteristic data with the personal information users have encountered, such as each person's name, organization, and the like to a personal database, if a user encounters a specific person (he or she has acquired the image) , then the image acquisition and display device 101 can retrieve information about the individual's personal information from the database. 当已经准备了其中已经登记了有关名人的信息和个人特征数据的个人数据库时,如果用户遇到了某一名人,则图像获取和显示设备101可以从个人数据库中检索有关该个人的信息。 When the registration has been prepared which has a database of personal information about celebrities and the personal characteristic data, if the user encounters a certain celebrity, the image capturing and displaying apparatus 101 can retrieve information about the person from the personal database. 通信部分126可以获得各种类型的外部信息。 External information communication section 126 can obtain various types. 例如,如上所述,通信部分126可以获得与从图像获取和显示设备101传送过来的经蟀度信息、个人特征数据等相对应的、由外部设备检索的信息。 For example, as described above, the communication section 126 may be obtained corresponding to the information retrieved by the external device from the image capturing and displaying apparatus 101 via cricket degree information transmitted from the personal characteristic data. 另外,通信部分126可以从外部设备获得诸如天气信息、温度信息、和湿度信息之类的气象信息。 Further, the communication section 126 can be obtained, such as weather information, temperature information, humidity information, and weather information from the external apparatus or the like. 另外,通信部分126可以从外部设备获得机构使用信息、禁止/ 许可摄影信息、机构引导信息等。 Further, the communication section 126 can obtain information from the external apparatus using means to prohibit / permit photographing information, guidance information means. 另外,通信部分126可以获得外部设备的标识信息。 Further, the communication section 126 can obtain identification information of the external device. 标识信息的示例包括在预定通信协议中被标识为网络设备的设备类型和设备ID。 Example of identification information comprises a device type and device ID in a predetermined communication protocol is identified as a network device. 另外,通信部分126可以获得存储在外部设备中的图像数据,由 Further, the communication section 126 the image data may be stored in an external device obtained by the

外部设备再现或者显示的图像数据,以及由外部设备收到的图像数据。 An external device or the display image data is reproduced, and the image data received by the external device. 在上文中,已经示范性地说明了周围环境传感器119、获取目标传感器120、 GPS接收部分121、日期与时间计数部分122、图像分析部分128、以及通信部分126可以单独获得的信息。 In the foregoing, description has been exemplarily surrounding environment sensor 119, the capturing target sensor 120, GPS reception section 121, the date and time counting section 122, the image information analysis section 128, and a communication section 126 can be obtained separately. 作为替代,这些部分中的多个可以检测和确定预定外部信息。 Alternatively, a plurality of these sections may detect and determine predetermined external information. 结合由周围环境传感器119获得的湿度信息等以及由通信部分126接收的天气信息,可以更准确地确定当前时间的天气。 Binding humidity information obtained by the surrounding environment sensor 119 and weather information received by the communication section 126 can more accurately determine the current time weather. 另外,与上述结构相比,可以与有关由GPS接收部分121和通息相对应地、更准确地确定获取目标的当前位置和情况。 Further, as compared with the above-described structure, the reception section 121 and related information through the GPS corresponding to more accurately determine the current location and circumstances of the acquisition target. 【5.示范性操作】在这个实施例的图像获取和显示设备101中,系统控制器110 与由周围环境传感器119、获取目标传感器120、 GPS接收部分121、 日期与时间计数部分122、图像分析部分128、以及通信部分126所获得的外部信息相对应地确定周围环境、获取目标等的情况,并且与确定结果相对应地控制图像获取操作和显示操作,以便协助和扩展用户的视觉。 [Image] 5. Exemplary operation of an embodiment of the acquisition and display device 101 in this, the system controller 110 by the surrounding environment sensor 119, the capturing target sensor 120, GPS reception section 121, the date and time counting section 122, the image analysis section 128, and the external information obtained by the communication section 126 is determined corresponding to the ambient environment, the target acquires the like, and controls the image corresponding to the determination result acquisition operation and display operation so as to assist and extend the user's visual. 接下来,将描述在系统控制器110的控制下执行的各种示范性操作。 Next, various exemplary operations performed under the control of system controller 110 will be described. 图10示出了作为系统控制器110的操作控制功能110b的控制处理。 FIG. 10 shows a control process as the operation control function 110b of the system controller 110. 在步骤FlOl,系统控制器110控制显示控制部分114使显示部分102变为通过状态。 In step FlOl, the system controller 110 controls the display control section 114 causes the display section 102 become the through state. 当最初导通图像获取和显示设备l时,流程前进到步骤FIOI。 When initially turned on the image capturing and displaying apparatus l, the flow proceeds to step FIOI. 在步骤FIOI,系统控制器110控制显示部分102以变为通过状态。 In step FIOI, the system controller 110 controls the display section 102 to become the through state. 在显示部分2处于通过状态时,在步骤F102,系统控制器110 确定是否已经出现监视显示状态启动触发。 In the display section 2 is in the through state, at step F102, the system controller 110 determines whether a monitor display state start trigger occurs. 可以在图像获取和显示设备IOI中布置监视显示启动开关(未示出)。 Can be disposed in the image capturing and displaying apparatus IOI the monitor display start switch (not shown). 当用户已经操作了这个 When the user has operated the

开关时,系统控制器110可以确定已经出现了监视显示状态启动触发。 Switch, the system controller 110 may determine that a monitor display state has occurred start trigger. 作为替代,如将在稍后描述的那样,系统控制器110可以与外部信息 Alternatively, as will be described later, system controller 110 may be information with external

相对应地确定已经出现了监视显示状态启动触发。 There have been determined corresponding to a monitor display state start trigger.

当确定结果表示已经出现了监视显示状态起动触发时,流程前进 When the determined result denotes that has occurred when a monitor display state start trigger, the flow advances

到步骤F103。 To step F103. 在步骤F103,系统控制器110执行监视显示启动控制。 In step F103, the system controller 110 executes the monitor display start control. 换句话说,系统控制器110命令图像获取控制部分111使图像获取部分103和获取图像信号处理部分115执行正常的图像获取操作。 In other words, the system controller 110 commands the image capturing control section 111 causes the image capturing section 103 and the captured image signal processing section 115 performs a normal image capturing operation. 另外, 系统控制器110命令显示控制部分114促使显示图像处理部分112和显示驱动部分113使显示部分102显示所获取的图像信号作为正常获取的图像。 Further, the system controller 110 commands the display control section 114 causes the display image processing section 112 and the display driving section 113 of the image signal display section 102 displays the acquired as the normally captured image.

在这个处理过程中,将如图3A所示的通过状态切换为如图3B 所示的正常获取图像的监视显示状态。 In this process, the state shown in FIG. FIG. 3A is switched to the normal monitoring image acquired display state shown in Figure 3B.

当显示部分102显示正常获取的图像(其与用户在通过状态下所看到的场景相同)时,流程前进到步驟F104。 When the display sections 102 display a normally captured image (which is the same as the user sees in the through state of the scene), the flow proceeds to step F104. 在步骤F104,系统控制器110监控是否已经出现了图像控制触发。 In step F104, the system controller 110 monitors whether or not an image control trigger has occurred. 在步骤F105,系统控制器IIO监控是否已经出现了监视显示状态完成触发。 In step F105, the system controller monitors whether there have been IIO monitor display state completion trigger.

当系统控制器IIO确定必须与由外部情况确定功能110a确定的外部情况(周围环境、被摄对象、当前日期和时间、当前位置等)相对应地改变监视显示模式时,系统控制器110在步骤F104确定已经出现了图像控制触发。 When the system controller must determine IIO (surroundings, subject, current date and time, current position, etc.) is determined by the external case of an external case 110a corresponding to the determined function of changing the monitor display mode, the system controller 110 at step F104 determines an image control trigger has occurred.

当用户已经利用预定开关执行了监视显示模式完成操作时,系统控制器110在步骤F105确定已经出现了监视显示状态完成触发。 When the user has performed the monitor display mode completion operation with the predetermined switch, the system controller 110 determines that a monitor display state has occurred completion trigger at step F105. 类似于步骤F102中的触发,系统控制器110可以确定与所检测的外部信息相对应地已经出现了监视显示状态完成触发。 Trigger similar in step F102, the system controller 110 may determine the external information detected has occurred corresponding to a monitor display state completion trigger.

当确定结果表示已经出现了图像控制触发时,流程从步骤F104 前进到步骤F106。 When the determined result denotes that has occurred when the image control trigger, the flow advances from step F104 to step F106. 在步骤F106,系统控制器IIO控制获取图像的显示操作。 In step F106, the system controller controls IIO acquires an image display operation. 换句话说,系统控制器110命令图像获取控制部分111和显示控制部分114使显示部分102以与在这个时间点上的外部情况相对应的显示模式显示图像。 In other words, the system controller 110 commands the image capturing control section 111 and the display control section 114 causes the display section 102 displays an image with an external case where this point in time corresponding to a display mode.

在系统控制器110已经在步骤F106控制了显示模式之后,流程前进到步猓F104或者F105。 After the system controller 110 has controlled the display mode step F106, the flow advances to step F104 or Guo F105. 在步骤F104或者步骤F105,系统控制器IIO监控是否已经出现了触发。 In step F104 or step F105, the system controller IIO monitor whether there have been triggered. 当确定结果表示已经出现了监视显示状态完成触发时,流程从步骤F105返回到步骤F101。 When the determined result denotes that has occurred when a monitor display state completion trigger, the flow returns from step F105 to step F101. 在步骤FIOI,系统控制器IIO命令图像获取控制部分111完成图像获取操作,并且命令显示控制部分114使显示部分102变为通过状态。 In step FIOI, IIO system controller commands the image capturing control section 111 to complete the image capturing operation and commands the display control section 114 causes the display section 102 become the through state. 在用户戴上图像获取和显示设备101并且已经导通了其电源时, 系统控制器110中的操作控制功能110b执行图IO所示的控制处理。 When the user puts on the image capturing and displaying apparatus 101 and its power has been turned on, the control process shown in FIG perform operation control function 110b of the system controller 110 IO. 在这个处理过程中,与在步骤F104中显示控制触发是否已经出现的确定结果相对应地执行显示模式控制。 In this process, in step F104 the display control trigger has occurred if the determination result corresponding to the display mode control is performed. 稍后将参考图23到图30A 和图30B描述触发确定和控制的具体示例。 With reference to FIGS. 23 to 30A and 30B to determine the specific examples described later and a control trigger. 图23到图30A和图30B示出了系统控制器110的外部情况确定功能110a的示范性处理。 23 to FIG. 30A and FIG. 30B shows an external case where the system controller 110 determines an exemplary processing functions 110a. 假定这些处理与图IO所示的操作控制功能110b的处理并行地执行。 Assumed that the operation control function processing shown in FIG IO 110b of the processing performed in parallel. 执行这些并行处理,以便例如当系统控制器IIO正在执行图IO所示的处理时,作为中断处理定期地执行图23到图30A和图30B所示的检测处理。 These perform parallel processing, so that when the IIO system controller executes the processing shown in the IO is, as an interrupt detection process 23 performs the processing shown in FIG. 30B to FIG. 30A and FIG e.g. periodically. 图23到图30A和图30B所示的这些处理的程序可以内置于执行图IO所示的处理的程序中。 23 to 30A and 30B the program processing shown may be built in the program executes IO processing shown in FIG. 作为替代, 这些程序可以是定期调用的其它程序。 Instead, these programs may be other programs regularly call. 换句话说,这些程序的结构不局限于特定的结构。 In other words, the structure of these programs is not limited to a particular structure. 图23到图30A和图30B示出了在图10所示的步骤F104中确定是否已经出现图像控制触发的示范性处理。 23 to FIG. 30A and FIG. 30B show is determined in step F104 shown in FIG. 10 is an exemplary processed image control trigger has occurred. 图23示出了确定是否已经与从周围环境传感器119或者图像分析部分128提供的信息相对应地出现了图像控制触发的示范性处理。 FIG 23 shows a correspondence has been determined whether or not there has been an exemplary processed image control trigger information from the surrounding environment sensor 119 or the image analyzing section 128 provided. 在图23所示的步骤F1201,系统控制器IIO监控由周围环境传感器119检测的信息以及由图像分析部分117获得的信息中的一个或者这二者。 F1201, the system controller or both IIO information monitored by sensor 119 detects the ambient environment information and a portion 117 obtained by the image analysis of step 23 shown in FIG. 在这个示例中,周围环境传感器119是亮度传感器。 In this example, the surrounding environment sensor 119 is a brightness sensor. 图像分析部分128分析与获取的图像相对应的周围亮度。 The image analyzing section 128 analyzes the captured image corresponding to the ambient brightness. 系统控制器110确定与从周围环境传感器119和图像分析部分 The system controller 110 determines from the surrounding environment sensor 119 and the image analysis section

128之一或者这二者获得的信息相对应地周围是黑暗的还是太亮了。 Around one or both the information 128 corresponding to the obtained dark or too bright. 例如,量化所检测到的亮度。 For example, the quantization of the detected brightness. 当检测的亮度是x勒克斯或者更少时, 系统控制器110确定周围是黑暗的。 When the detected brightness is x lux or less, the system controller 110 determines that the surroundings are dark. 当检测的亮度是y勒克斯或更多时,系统控制器110确定周围太亮了。 When the detected brightness is y lux or more, the system controller 110 determines that the surroundings are too bright.

当确定结果表示周围是黑暗的时,流程从步骤F1202前进到步骤F1204。 When the determined result denotes that the surroundings are dark, the flow advances from step F1202 to step F1204. 在步骤F1204,系统控制器110确定已经出现了图像控制触发。 At step F1204, the system controller 110 determines that an image control trigger has occurred.

在步骤F1205,系统控制器110计算与周围的当前亮度(暗度) 相对应的调整值。 Corresponding to the relative adjustment value at step F1205, the current brightness (darkness) of the system controller 110 calculates the surrounding. 例如,系统控制器110获得例如显示亮度、对比度、 锐度、图像获取灵敏度等的调整值,以便使用户可以用获取的图像舒服地看到周围。 For example, the system controller 110 obtains adjustment values ​​of for example display brightness, contrast, sharpness, image capturing sensitivity of the image so that the user can comfortably see around acquired.

当已经执行了步骤F1204和步骤F1205的处理时,流程从图10 所示的步骤F104前进到步骤F106。 When the process of step F1204 has been performed and step F1205, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在步骤F106,系统控制器110 命令图像获取部分103调整图像获取灵敏度,并且命令获取图像信号处理部分115或者显示图像处理部分12调整亮度、对比度、锐度等。 In step F106, the system controller 110 commands the image capturing section 103 to adjust the image capturing sensitivity and commands the captured image signal processing section 115 or the display image processing section 12 to adjust the brightness, contrast, sharpness and the like. 当这些部分已经执行了这些处理时,调整显示部分102上显示的图像的质量。 When these sections have performed these processes, the image quality adjustment on the display section 102 display. 因此,即^_周围是黑暗的,用户也可以用显示部分102上显示的图像来清楚地看到周围。 Accordingly, i.e. ^ _ surroundings are dark, the user can use images displayed on the display section 102 to clearly see the surroundings. 例如,其中周围是黑暗的而且在显示部分102上显示如图6A所示的图像的情况被改变为其中用户可以清楚地看到该图像的情况。 For example, where the surroundings are dark and an image display shown in FIG. 6A is changed in which case the user can clearly see the image on the display section 102.

当确定结果表示周围是黑暗的时,系统控制器IIO可以控制照明部分104进行照明。 When the determined result denotes that the surroundings are dark, the system controller may control the lighting section 104 IIO illumination.

当确定结果表示周围太亮时,流程从步骤F1203前进到步骤F1206。 When the determined result denotes that the surroundings are too bright, the flow advances from step F1203 to step F1206. 在步骤F1206,系统控制器110确定已经出现了图像控制触发。 At step F1206, the system controller 110 determines that an image control trigger has occurred.

在步骤F1207,系统控制器110计算与周围的当前亮度相对应的调整值。 In F1207, the current brightness around 110 calculates the system controller adjustment value corresponding to the step. 系统控制器110获得例如显示亮度、对比度、锐度、图像获取灵敏度等的调整值,以便使用户可以舒服地看到周围。 The system controller 110 obtains adjustment values ​​of for example display brightness, contrast, sharpness, image capturing sensitivity or the like, so that the user can comfortably see the surroundings. 在这种情况下,因为周围太亮了,所以用户感觉眩目。 In this case, because the surroundings are too bright, so users feel dazzling. 因此,系统控制器110获 Thus, system controller 110 is eligible

得这样的调整值,利用该调整值降低了图像获取灵敏度和显示亮度。 Such adjustment value is obtained, utilizing the adjustment value is reduced by the image capturing sensitivity and the display brightness.

当已经执行了步骤F1206和步骤F1207的处理时,流程从图10 所示的步骤F104前进到步猓F106。 When the process of step F1206 has been performed and step F1207, the flow of steps shown in FIG. 10 F104 Guo proceeds to step F106. 在这种情况下,在步骤F106,系统控制器110命令图像获取部分103调整图像获取灵敏度,并且命令获取图像信号处理部分115或者显示图像处理部分12调整亮度、对比度、锐度等。 In this case, in step F106, the system controller 110 commands the image capturing section 103 to adjust the image capturing sensitivity and commands the captured image signal processing section 115 or the display image processing section 12 to adjust the brightness, contrast, sharpness and the like. 在这些处理中,调整显示部分102上显示的图像的质量。 In these processes, the image quality adjustment on the display section 102 display. 因此,即使周围太亮,用户也可以用显示部分102上显示的图像来看到周围而没有感觉眩目。 Thus, even if the surroundings are too bright, the user can use the image displayed on the display portion 102 to see around without feeling glare.

图24A示出了确定是否已经与从周围环境传感器119所检测的 FIG 24A shows whether the detected has been determined from the ambient environment of sensor 119

性处理。 Treatment.

在图24A所示的步骤F1301 ,系统控制器110监控由周围环境传感器119检测的信息以及由通信部分126接收的信息中的一个或者这二者。 F1301, or both a step shown in FIG. 24A by the system controller 110 monitors information detected by the surrounding environment sensor 119 and information received by the communication section 126. 周围环境传感器119的示例包括温度传感器、湿度传感器、和大气压力传感器。 Example surrounding environment sensor 119 include a temperature sensor, a humidity sensor, and atmospheric pressure sensor. 通信部分126从例如网络服务器等连续地接收气象 The communication section 126 receives from the weather such as a network server or the like is continuously

系统控制器110可以确定与由例如周围环境传感器119检测的大气压力、湿度、和温度相对应的周围天气情况。 The system controller 110 may determine, for example, the case of the weather around the atmospheric pressure sensor 119 detects the ambient humidity, and temperature corresponding. 另外,系统控制器110 可以确定与由通信部分126接收的气象信息相对应的天气情况。 Further, the system controller 110 may determine the weather information received by the communication section 126 corresponding to the weather conditions. 为了从网络服务器接收天气情况,系统控制器110将由GPS接收部分121 获得的当前位置信息连续地发送到网络服务器,并且从网络服务器接收与当前位置相对应的区域的气象信息。 To receive weather conditions from the network server, the system controller 110 receives the current position information by the GPS section 121 is obtained continuously transmitted to the network server and receives meteorological information of the current position from a region corresponding to the network server.

虽然系统控制器110可以确定与由周围环境传感器119检测到的信息或者由通信部分126接收的信息相对应的周围天气情况,但是系 Although the system controller 110 may determine that the information detected by the surrounding environment sensor 119 or information received by the communication section 126 corresponding to the surrounding weather conditions, but the system

的天气情况。 Weather conditions. . 、 、 — 各、,' ,, - ,, each '

系统控制器110确定是否必须与诸如晴空、多云天、雨天、闪电、 台风、下雪等之类的天气情况或者诸如开始下雨、停止下雨、乌云密布等天气情况改变相对应地调整图像。 The system controller 110 determines whether or have started to rain and weather conditions such as clear sky, cloudy sky, rain, lightening, typhoon, snow and the like, to stop the rain, overcast weather conditions and the like corresponding to the changed image is adjusted. 当确定结果表示必须调整图像 When the determined result represents the image to be adjusted

时,流程从步骤F1302前进到步骤F1303。 , The flow advances from step F1302 to step F1303. 在步骤F1303,系统控制器110确定已经出现了图像控制触发。 At step F1303, the system controller 110 determines that an image control trigger has occurred. 在步骤F1304,系统控制器110 计算与当前天气相对应的调整值。 In F1304, 110 and the system controller calculates current weather adjustment value corresponding to the step. 系统控制器IIO获得例如显示亮度、 对比度、锐度、图像获取灵敏度等的调整值,以便使用户可以用获取的图像清楚地看到周围。 The system controller IIO display adjustment value is obtained, for example, brightness, contrast, sharpness, image capturing sensitivity or the like, so that the user can clearly see the image acquisition around.

当已经执行了步骤F1303和F1304的处理时,流程从图10所示的步骤F104前进到步骤F106。 When the process of step F1303 has been performed and the F1304, the step of the flow shown in FIG. 10 F104 proceeds to step F106. 在步骤F106,系统控制器110命令图像获取部分103调整图像获取灵敏度,并且命令获取图像信号处理部分115或者显示图像处理部分12调整亮度、对比度、锐度等。 In step F106, the system controller 110 commands the image capturing section 103 to adjust the image capturing sensitivity and commands the captured image signal processing section 115 or the display image processing section 12 to adjust the brightness, contrast, sharpness and the like. 在这些处理中,与天气情况相对应地调整显示部分102上显示的图像的质量。 In these processes, the weather conditions corresponding to adjust the quality of the image displayed on the display section 102. 用户可以用显示部分102上显示的图像清楚地看见周围。 The user can display an image on the display portion 102 is clearly visible surrounding.

作为替代,系统控制器IIO可以与天气情况相对应地控制照明部分104进行照明。 Alternatively, the system controller IIO may be controlled to illuminate the illumination portion 104 opposite the weather conditions.

在这个示例中,系统控制器110确定与由周围环境传感器119 检测的信息或者由通信部分126接收的信息相对应的天气情况。 In this example, the system controller 110 determines the weather conditions and the information detected by the surrounding environment sensor 119 or received by the communication section 126 corresponding to the information. 当图像分析部分128识别出雨天的图像时,系统控制器IIO可以准确地检测开始下雨、结束下雨、闪电出现等。 When the image analyzing section 128 recognizes an image of rain, the system controller IIO possible to accurately detect the start of rain, rain end, appear like lightning.

图24B示出了确定是否已经与由周围环境传感器119检测的信处理。 24B shows processing of determining whether the letter is detected by the surrounding environment sensor 119.

在图24B所示的步骤F1310,系统控制器IIO监控由周围环境传感器119检测的信息。 Information F1310, the system controller IIO monitored by the surrounding environment sensor 119 detected in the step shown in FIG. 24B. 在这个示例中,周围环境传感器119是亮度传感器。 In this example, the surrounding environment sensor 119 is a brightness sensor.

系统控制器110与由周围环境传感器119检测的信息相对应地确定周围是否是黑暗的。 The system controller 110 corresponding to information determined by the sensor 119 detects whether the ambient surroundings are dark. 系统控制器110数字化所检测到的亮度。 The system controller 110 digitizes the detected brightness. 当检测的亮度是x勒克斯或者更少时,系统控制器110确定周围是黑暗的。 When the detected brightness is x lux or less, the system controller 110 determines that the surroundings are dark.

当确定结果表示周围是黑暗的时,流程从步骤F1311前进到步骤F1313。 When the determined result denotes that the surroundings are dark, the flow advances from step F1311 to step F1313. 在步骤F1313,系统控制器IIO确定已经出现了导致夜视功能开启的图像控制触发。 In step F1313, the system controller determines IIO has led to the emergence of image control night vision function open trigger.

当已经执行了步骤F1313的处理时,流程从图10所示的步骤F104前进到步骤F106。 When the process of step F1313 has been performed, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在这种情况下,在步骤F106,系统控制器110 控制图像获取和显示设备101开启夜视功能。 In this case, in step F106, the system controller 110 controls the image capturing and displaying apparatus 101 turn on night vision function. 换句话说,系统控制器110命令图像获取控制部分111增加图像获取部分103的红外图像获取灵敏度。 In other words, the system controller 110 commands the image capturing control section 111 increase the image capturing section 103 of the infrared image capturing sensitivity. 在这个处理过程中,执行夜视功能。 In this process, the implementation of night vision. 在其中如图7A所示因为周围是黑暗的而使用户不能看见周围的情况下,在显示部分102上显示如图7B所示的增加了红外灵敏度的获取图像。 7A, in which case because the surrounding is dark around the user can not see, showed increased infrared sensitivity captured image as shown in FIG. 7B on the display section 102. 因此,用户可以看见暗处中的周围情况。 Thus, the user can see the surroundings in a dark place. 当确定结果表示周围不暗时,流程从步骤F1311前进到步骤F1312。 When the determined result denotes that the surroundings are not dark, the flow advances from step F1311 to step F1312. 在这种情况下,在步骤F1312,当已经开启了夜视功能(增加红外灵敏度的图像获取操作)时,流程前进到步骤F1314。 In this case, at step F1312, when it has been turned on (increased infrared sensitivity image capturing operation) night vision, the flow advances to step F1314. 在这种情况下,在步骤F1314,系统控制器110确定已经出现了导致夜视功能关闭的图像控制触发。 In this case, at step F1314, the system controller 110 determines that has occurred that causes a night vision image control trigger function is turned off. 当已经执行了步骤F1314的处理时,流程从图10所示的步骤F104前进到步骤F106。 When the process of step F1314 has been performed, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在这种情况下,在步骤F106, 系统控制器IIO控制图像获取和显示设备IOI关闭夜视功能。 In this case, in step F106, the system controller controls the image capturing and displaying IIO IOI off night vision device. 换句话说,系统控制器IIO命令图像获取控制部分111将红外图像获取灵敏度恢复为正常的图像获取灵敏度并执行正常的图像获取操作。 In other words, the system controller IIO commands the image capturing control section 111 to the infrared image capturing sensitivity is restored to a normal image capturing sensitivity and perform the normal image capturing operation. 在图24B所示的处理中,当用户处于暗室等中时,自动地开启夜视功能,以使得他或者她在暗室中能够清楚地看见周围。 In the process shown in FIG. 24B, when the user is in a dark room or the like, the night vision function is automatically turned on, so that he or she can clearly see the surroundings in a dark room. 相反,当用户已经离开了暗室等时,自动地关闭夜视功能。 In contrast, when the user has left the darkroom, to automatically turn off the night vision function. 换句话说,实现了与周围情况相对应地增加用户视觉能力的处理。 In other words, to realize the processing corresponding to the case surrounding the user's visual capability increases. 作为替代,图像分析部分128可以通过分析获取的图像来检测周围是否是黑暗的。 Alternatively, the image analyzing section 128 may detect whether the surroundings are dark by analyzing a captured image. 当已经大大地降低了整个获取图像的亮度时,确定周围是黑暗的,系统控制器110可以确定已经出现了导致夜视功能开启的图像控制触发,图25示出了确定是否已经与由获取目标传感器120检测的信息或者由图像分析部分128获得的信息相对应地出现了图像控制触发的示范性处理。 As has been greatly reduced when the brightness of the image acquired, determining the entire periphery dark, the controller 110 may determine that the system has occurred resulting in night vision image control trigger opening, FIG. 25 illustrates the determination of whether the target has been acquired by the information detected by the sensor 120 or the information obtained by the image analysis portion 128 corresponding to exemplary process appeared an image control trigger.

在图25所示的步骤F1401,系统控制器IIO监控由获取目标传感器120检测的信息以及由图像分析部分128获得的信息中的一个或者这二者。 Information, and one or both of the information obtained by the image analyzing section 128 in the step shown in FIG. 25 F1401, the system controller IIO monitored by the capturing target sensor 120 detected. 获取目标传感器120例如为测距传感器。 Obtaining the distance measuring sensor 120 is, for example target sensor. 图像分析部分128 通过分析所获取的图像来计算到被摄对象的距离。 The image analyzing section 128 calculates the distance to the subject obtained by image analysis.

换句话说,系统控制器110与由获取目标传感器120检测的信息和/或图像分析部分128获得的信息相对应地确定用户正在观看的目标(获取目标)是远离例如他或者她的手还是与之接近。 In other words, the system controller 110 with information provided by the information and / or the image analysis section 120 detected by the capturing target sensor 128 is determined corresponding to the obtained user is viewing the target (capturing target), for example, it is far from his or her hand or with it close.

当用户在远离体育场场区的座位处观看远处场景或者比赛,而且系统控制器IIO已经确定获取目标在远处时,流程从步骤F1402前进到步骤F1404。 When a user views a scene or a game at a seat far away from the field area of ​​the stadium, and the system controller has determined IIO acquisition target in the distance, the flow advances from step F1402 to step F1404. 在步骤F1404,系统控制器110确定已经出现了导致显示模式被切换到远景变焦显示模式的图像控制触发。 At step F1404, the system controller 110 determines that has occurred that causes the display mode is switched to the telescopic zoom display image control trigger mode. 此后,流程前进到步骤F1405。 Thereafter, the flow advances to step F1405. 在步骤F1405,系统控制器110计算与到获取目标的距离相对应的恰当变焦放大率。 At step F1405, 110 and the system controller calculates the distance to the target corresponding to obtain proper zoom magnification.

当用户正在观看近处场景或者在他或者她手上的报纸,而且系统控制器IIO已经确定了获取目标在近处时,流程从步骤F1403前进到步骤F1406。 When the user is viewing a scene near or in his or her hand in the newspaper, and the system controller IIO has determined that the acquisition targets in the vicinity, the flow advances from step F1403 to step F1406. 在步骤F1406,系统控制器110确定已经出现了导致显示模式被切换到放大(张开变焦)显示模式的图像控制触发。 At step F1406, the system controller 110 determines the cause has occurred is switched to the enlarged display mode (open zoom) mode display image control trigger. 此后, 流程前进到步骤F1407。 Thereafter, the flow advances to step F1407. 在步骤F1407,系统控制器110计算与到获取目标的距离相对应的恰当变焦放大率。 At step F1407, 110 and the system controller calculates the distance to the target corresponding to obtain proper zoom magnification.

当已经执行了步骤F1404和步骤F1405的处理或者步骤F1406 和步骤F1407的处理时,流程从图10所示的步骤F104前进到步骤F106。 When the process of step F1404 has been performed and step F1405 or the processes of step F1406 and step F1407, the step of the flow shown in FIG. 10 F104 proceeds to step F106. 在步骤F106,系统控制器110命令图像获取控制部分111执行具有所计算的放大率的变焦操作。 In step F106, the system controller 110 commands the image capturing control section 111 to perform a zoom operation with the calculated magnification.

因此,显示部分102显示与用户正看到的场景相对应的、如图3C所示的远景图像或者如图4B所示的广角变焦图像。 Thus, the display portion 102 displays the user is seeing a scene corresponding to the image shown in perspective in FIG. 3C or a wide zoom image shown in FIG. 4B.

在这个示例中,系统控制器110控制远景/广角变焦操作。 In this example, the system controller 110 controls the vision / wide angle zoom operation. 作为替代,系统控制器110可以控制图像获取和显示设备101与到获取目标的距离相对应地改变聚焦位置以及放大/缩小图像。 Alternatively, system controller 110 may control the image capturing and displaying apparatus 101 to obtain the distance to the target is changed corresponding to the focus position and enlarge / reduce the image.

图26示出了确定是否已经与由获取目标传感器120检测的信息 FIG 26 shows information for determining whether the detected by the capturing target sensor 120

和由图像分析部分128获得的信息相对应地出现了图4象控制触发的示范性处理。 And information obtained by the image analysis portion 128 corresponding to the exemplary process appear image control trigger of FIG. 4. 特別地,在该示范性处理中,确定获取目标是否包含^L纸、 书本等中的字符。 In particular, in this exemplary process, it is determined whether the acquired target comprising ^ L paper, books and other characters.

在图26所示的步骤F1501,系统控制器IIO监控由获取目标传感器120检测的信息以及由图像分析部分128获得的信息。 In the step shown in FIG. 26 F1501, the system controller IIO monitored by the capturing target sensor 120, and information detected by the image analyzing section 128 is obtained. 在这个示例中,获取目标传感器120是测距传感器。 In this example, the capturing target sensor 120 is a distance measuring sensor. 图像分析部分128通过分析获取的图像来检测被摄对象是否包含字符。 The image analyzing section 128 detects whether or not the subject contains characters by analyzing the acquired image.

系统控制器110与由获取目标传感器120检测的信息和/或由图像分析部分128获得的信息相对应地确定用户正在观看的目标(获取目标)是否在近处并且包含报纸、书本等中的字符。 The system controller 120 detects information 110 and / or the information obtained by the image analysis portion 128 corresponding to the capturing target sensor is determined by the user is viewing a target (capturing target) and are in the vicinity with newspaper, books and other characters . 换句话说,系统控制器110确定用户是否正在读取在他或者她手中的报纸。 In other words, the system controller 110 determines whether the user is in his or her reading his newspaper.

当确定结果表示获取目标在附近并包含字符时,流程从步骤F1502前进到步骤F1503。 When the determined result denotes that the capturing target is near and contains characters, the flow advances from step F1502 to step F1503. 在步骤F1503,系统控制器110确定已经出现了图像控制触发。 At step F1503, the system controller 110 determines that an image control trigger has occurred.

在步骤F1504,系统控制器IIO计算用户可以利用其来舒服地阅读报纸或者书本的调整值。 At step F1504, the system controller calculates IIO to which the user can use comfortably read the newspaper or book adjustment value. 例如,系统控制器IIO获得例如显示亮度、 对比度、锐度、图像获取灵敏度等的调整值,以便使用户可以舒服地阅读报纸等。 For example, the system controller IIO display adjustment value obtained e.g. brightness, contrast, sharpness, image capturing sensitivity or the like, so that the user can comfortably read the newspaper.

当已经执行了步骤F1503和步骤F1504的处理时,流程从图10 所示的步骤F104前进到步骤F106。 When the process of step F1503 has been performed and step F1504, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在这种情况下,在步骤F106,系统控制器110命令图像获取部分103调整图像获取灵敏度,并且命令获取图像信号处理部分115或者显示图像处理部分12调整亮度、对比度、锐度等。 In this case, in step F106, the system controller 110 commands the image capturing section 103 to adjust the image capturing sensitivity and commands the captured image signal processing section 115 or the display image processing section 12 to adjust the brightness, contrast, sharpness and the like. 在这个处理过程中,调整显示部分102上显示的图像的质量。 In this process, the image quality adjustment on the display section 102 display. 因此,如图6B所示,显示部分102显示用户可以清楚阅读的图像。 Thus, as shown in FIG. 6B, the image display portion 102 displays the user can clearly read.

除了字符检测之外,还可以检测周围亮度,而且检测结果可能对调整值的计算有影响。 In addition to the detection of characters, the surrounding brightness may be detected, and the detection result may affect the calculation of the adjustment value.

另外,当图像分析部分128分析图像时,图像分析部分128还可以识别出报纸或者书本的形状,作为流程前进到步骤F1503的条件。 Further, when the image analyzing section 128 analyzes the image, the image analyzing section 128 may also identify the shape of a newspaper or a book as a condition to the flow proceeds to step F1503.

当系统控制器110确定所获取的目标是报纸等时,系统控制器110可以控制照明部分104进行照明。 When the target system controller 110 determines whether the acquired newspapers, etc., the system controller 110 may control the lighting section 104 to light up. 并不是调整图像质量,而是显示图像处理部分112可以执行放大处理,并且使显示部分102显示如图4B所示的放大图像,以便使用户可以清楚地读取字符。 It does not adjust the image quality, but the display image processing section 112 may perform amplification process, and causes the display section 102 to display an enlarged image as shown in FIG 4B, so that the user can clearly read characters. 当图像包含字符时,图像分析部分128可以确定这些字符,并且将它们作为文本数据提供给系统控制器110。 When an image contains characters, the image analyzing section 128 may determine the characters and supply them to the system controller 110 as text data. 在这种情况下,系统控制器110使声音合成部分127执行与从图像中检测的文本数据相对应的声音合成处理。 In this case, the system controller 110 causes the sound synthesizing section 127 performs speech synthesis processing the text data detected from the image corresponding to. 因此,声音合成部分127生成作为获取图像中所包含的字符的阅读语音的声音信号。 Therefore, the sound synthesizing section 127 generates a sound signal as a reading voice acquiring character image included in the. 系统控制器110使声音输出部分105输出该阅读语音。 The system controller 110 causes the sound output section 105 to output the reading voice. 因此,当用户观看报纸等时,他或者她可以听到其阅读语音。 Thus, when the user views the newspaper, he or she can read their voice heard. 图27示出了确定是否已经与由日期与时间计数部分122所计数的当前日期与时间信息相对应地出现了图4象控制触发的示范性处理。 27 shows a section 122 determines whether the current date and time counted occurred corresponding to information of the exemplary process of FIG. 4 as control trigger and counted by the date and time. 在图27所示的步骤F1601,系统控制器IIO检查由日期与时间计数部分122所计数的当前日期与时间。 F1601, the system controller checks IIO time and current date and time counting section 122 counts the date 27 in the step shown in FIG. 系统控制器110确定与当前时间(例如早晨)相对应的时区,例如清晨、早晨、白天、傍晚、和晚上的时区。 The system controller 110 determines a current time (e.g., in the morning) corresponding to the time zone, for example in the morning, morning, daytime, evening, and night time zone. 例如,从4点钟到7点钟的时区是清晨,从7点钟到9 点钟的时区是早晨,从9点钟到17点钟的时区是白天,从17点钟到19点钟的时区是傍晚,以及从19点钟到4点钟的时区是晚上。 For example, from 4 o'clock to 7 o'clock is early morning time zone from 7 o'clock to 9 o'clock in the morning time zone from 9 o'clock to 17 o'clock is daytime time zone from 17 o'clock to 19 o'clock time zone is in the evening, and from 19 o'clock to 4 o'clock time zone at night. 优选为与所确定的月份和日期相对应地改变时区。 Preferably with the month and day are changed corresponding to the determined time zone. 例如,因为日出时间和日落时间与月份和日期相对应地改变,所以与月份和日期相对应地改变时区。 For example, since the time of sunrise and sunset time should be changed with the month and day relative, so the month and date corresponding to the time zone change. 例如,在夏季,清晨的时区从4点钟到7点钟。 For example, in the summer, early in the morning time zone from 4 o'clock to 7 o'clock. 例如,在冬季,清晨的时区从6点钟到8点钟。 For example, in the winter, the morning time zone from 6 o'clock to 8 o'clock. 当步骤F1601的确定结果表示时区已经改变了时,流程从步骤F1602前进到步骤F1603。 When the time zone has changed the determined result at step F1601, the flow advances from step F1602 to step F1603. 当时区已经改为清晨时,流程从步骤F1603前进到步骤F1607。 When the time zone has changed in the early morning, the flow advances from step F1603 to step F1607. 在步骤F1607,系统控制器IIO确定已经出现了导致为清晨执行图像 In step F1607, the system controller determines IIO has emerged as the lead early in the morning to perform image

获取操作/显示操作的图像控制触发。 Capturing operation / display image control trigger.

当时区已经改为早晨时,流程从步骤F1604前进到步骤F1608。 When the time zone has changed in the morning, the flow advances from step F1604 to step F1608. 在步骤F1608,系统控制器IIO确定已经出现了导致为早晨执行图像获取操作/显示操作的图像控制触发。 At step F1608, the system controller determines IIO cause has occurred to perform the image capturing operation morning / display image control trigger.

当时区已经改为白天时,流程从步骤F1605前进到步骤F1609。 When the time zone has changed during the day, the flow advances from step F1605 to step F1609. 在步骤F1609,系统控制器IIO确定已经出现了导致为白天执行图像获取操作/显示操作的图像控制触发。 At step F1609, the system controller determines IIO for the daytime has occurred leading to perform image capturing operation / display image control trigger.

当时区已经改为傍晚时,流程从步骤F1606前进步骤F1610。 When the time zone has changed in the evening, the flow advances from step F1610 to step F1606. 在步骤F1610,系统控制器IIO确定已经出现了导致为傍晚执行图像获取操作/显示操作的图像控制触发。 At step F1610, the system controller determines IIO for the evening has occurred leading to perform image capturing operation / display image control trigger.

当时区已经改为晚上时,流程前进到步骤F1611。 When the time zone has changed in the evening, the flow advances to step F1611. 在步骤F1611, 系统控制器110确定已经出现了导致为晚上执行图像获取操作/显示操作的图像控制触发。 At step F1611, the system controller 110 determines execution has occurred that causes the image capturing operation for the evening / display image control trigger.

当在步骤F1607、 F1608、 F1609、 F1610、或者F1611的确定结果表示已经出现了图像控制触发时,流程从图10所示的步骤F104前进到步骤F106。 When the determined result at step F1607, F1608, F1609, F1610, F1611 or representation has occurred when an image control trigger, the process step shown in FIG. 10 F104 proceeds to step F106. 在步骤F106,系统控制器IIO命令图像获取控制部 In step F106, the system controller commands the image capturing control section IIO

作。 Make. 例如:系统控制器110命令一图像获取控制部分111和显示控制部分114调整例如图像获取灵敏度、亮度、对比度、锐度等。 For example: a system controller 110 commands the image capturing control section 111 and the display control section 114 to adjust for example the image capturing sensitivity, brightness, contrast, sharpness and the like. 作为替代, 系统控制器110可以命令图像获取控制部分111和显示控制部分114 执行诸如柔焦显示操作之类的图像效果操作。 Alternatively, system controller 110 may command the image capturing control section 111 and the display control section 114 performs an image effect operation such as a soft focus display operation or the like.

在这个处理过程中,将与时区相对应的图像提供给用户。 In this process, it will be provided to the user with an image corresponding to the time zone. 例如, 在清晨,将柔化图像提供给用户。 For example, in the morning, it will soften the image provided to the user. 在早晨,向用户提供具有强对比度的清晰图像。 In the morning, a clear image having high contrast provided to the user. 在傍晚,向用户提供棕褐色的图像。 In the evening, a tan provides an image to the user. 在晚上,向用户提供阴暗的图像。 In the evening, providing a dark image to the user. 因此,可以向用户提供与他或者她的心情和时区相对应的图像。 Therefore, it is possible to provide him or her mood and time zone corresponding to the image to the user.

当然,可以与在每个时区中发生改变的亮度相对应地调整图像质量,以便提高可见性。 Of course, the image quality adjustment corresponding to the luminance change in each time zone, in order to improve visibility.

除了时区之外,还可以与天气情况以及用户是否在房间中的用户 In addition to the time zone, the user can also be in the room if the weather conditions and user

情况相对应地调整图像的质量。 Corresponding to the case to adjust image quality. 作为替代,可以与利用日期与时间信息所确定的季节相对应地而不是与时区相对应地调整图像的质量。 As an alternative, the date and time information corresponding to the season determined not to be the time zone and adjust the relative quality of the image. 在夏季,例如加重图像的蓝色分量。 In the summer, for example, increase the blue component of the image. 在秋天,例如加重图像的红色分量。 In the fall, for example, increase the red component of the image. 在冬季,例如加重图像的白色分量。 In winter, for example, increase the white component of the image. 在春天,例如加重绿色/粉红色分量。 In the spring, for example, increase the green / pink component. 因此,可以向用户提供具有季节感觉的图像。 Therefore, it is possible to provide an image with a seasonal feel to the user. 图28A示出了确定是否已经与由GPS接收部分121和通信部分126接收的信息相对应地出现了图像控制触发的示范性处理。 28A shows whether determined to have occurred corresponding to an exemplary processed image control trigger information received by the receiving portion 126, and a communication portion 121 by the GPS. 在图28A所示的步骤F1701,系统控制器110使通信部分126 将从GPS接收部分121获得的当前位置的经綷度信息发送到具有内置地图数据库的网络服务器或者设备,使该服务器或者设备从数据库检索有关当前位置的信息,并且使通信部分126从中接收有关当前位置的信息。 Transmitting F1701, the system controller 110 causes the communication section 126 from the GPS in the step shown in FIG. 28A receiving portion 121 of the current position obtained by the degree information to 綷 having a built-in map database server or network equipment, from the server or device database to retrieve information about the current position, and causes the communication section 126 receives information about the current location. 当图像获取和显示设备101具有内置地图数据库时,系统控制器110可以与从GPS接收部分121接收的经绰度信息相对应地从内置地图数据库检索有关当前位置的信息。 When the image capturing and displaying apparatus 101 has a built-in map database, the system controller 110 may receive information via Chuo degrees corresponding to the information from the GPS receiving portion 121 from the built-in map database to retrieve information about the current position. 系统控制器110与所获得的当前位置信息相对应地确定用户是否处于其中必须执行预定图像控制的地点。 The system controller 110 with current position information corresponding to the obtained determining whether the user is a predetermined image which must perform the location control. 当确定结果表示当前位置是其中必须执行预定图像控制的地点时,流程从步骤F1702前进到步骤F1703。 When the determined result denotes that the current position is a predetermined location must be performed in which the control image, the flow advances from step F1702 to step F1703. 在步骤F1703,系统控制器110确定已经出现了导致执行预定图像控制的图像控制触发。 At step F1703, the system controller 110 determines that an image control lead has occurred performs predetermined image control trigger. 当确定结果表示已经出现了图像控制触发时,流程从图IO所示的步骤F104前进到F106。 When the determined result denotes that has occurred when the image control trigger, the process steps F104 to F106 shown in FIG. IO. 在步骤F106,系统控制器110命令图像获取控制部分111和显示控制部分114执行预定的图像控制。 In step F106, the system controller 110 commands the image capturing control section 111 and the display control section 114 performs a predetermined image control. 在这种情况下,图像控制的示例如下。 In this case, examples of the image control are as follows. 当检测结果表示当前位置是运动场、环道等时,因为用户看见的目标(获取对象)是快速移动的人、汽车等,所以系统控制器110命令图像获取控制部分111增加图像获取帧频,以便可以恰当地显示快速移动的被摄对象。 When the detection result indicates that the current position is a sports field, when the ring road, etc., because the user sees the target (acquired object) is fast moving people, cars, etc., the system controller 110 commands the image capturing control section 111 increase the image capturing frame rate, so that It can properly display fast-moving subject. 在当前位置是演奏厅、音乐厅、娱乐会堂、运动场等时,系统控 The current position is a concert hall, concert hall, entertainment halls, sports grounds or the like, the system controller

制器110可以命令图像获取控制部分111执行与到舞台上的获取目标 System 110 may command the image capturing target on the acquisition control section 111 to perform the Stage

的距离相对应的远景图像获取操作。 Corresponding to the distance vision image capturing operation. 当可以确定到诸如舞台之类的获取目标的距离作为当前位置信息时,可以与所检测的距离相对应地设 When the distance to the capturing target may be determined, such as a stage or the like as the current position information can be provided in correspondence with the detected distance

置远景放大率。 Set telescopic magnification. 可以由获取目标传感器120 (测距传感器)检测到获取目标的距离。 It can be detected by the capturing target sensor 120 (distance measurement sensor) to the distance acquisition target. 可以与所检测的距离相对应地设置远景放大率。 Vision may be provided corresponding to the detected distance and magnification. 并不是执行远景操作,而是系统控制器110可以命令获取图像处理部分115 或者显示图像处理部分112执行图像放大处理。 Vision is not performed operations, but the system controller 110 may command the image acquisition processing section 115 or the display image processing section 112 performs the image enlargement processing.

在当前位置是海滨或者山脉时,系统控制器110命令图像获取控制部分111执行增加紫外线灵敏度的图像获取操作,使显示部分2显示如图8B所示的图像,并且使用户识别出紫外线辐射量。 The current position is a beach or mountain, the system controller 110 commands the image acquisition section 111 performs the control to increase the UV sensitivity acquisition operation, the display section 2 display the image shown in FIG. 8B, and causes the user to recognize the amount of ultraviolet radiation.

另外,可以用与所获得的当前位置信息相对应的字符图像或者文本叠加在获取目标的机构、商店等的地名或者名称上。 Further, using the current position information corresponding to a character image or text superimposed on the obtained target acquisition mechanism, the name or names of shops. 可以在显示部分102上显示周围区域的广告信息、机构引导信息、和警报信号。 The advertisement information may be displayed on the peripheral region of the display portion 102, guide information means, and alarm signals.

图28B示出了确定是否已经与由GPS接收部分121接收的信息以及由通信部分126接收的信息相对应地出现了图像控制触发的示范性处理。 FIG 28B illustrates the determination of whether the received information received by the GPS portion 121 and received by the information communication section 126 corresponding to the emergence of an exemplary process an image control trigger. 特别地,在正在执行增加红外灵敏度的图像获取操作的同时执行这个示范性处理。 In particular, this exemplary process performed while being executed increased infrared sensitivity image capturing operation.

在图像获取部分103正在执行增加红外灵敏度的图像获取操作时,流程从图28B所示的步骤F1710前进到步骤F1711。 When the acquisition section 103 is performing the increased infrared sensitivity image capturing operation in the image, the flow advances from step shown in FIG. 28B F1710 proceeds to step F1711.

在步骤F1711,系统控制器110使通信部分126将由GPS接收部分121获得的当前位置的经绰度信息发送到具有内置地图数据库的网络服务器或者设备,使该服务器或者设备从地图数据库检索有关当前位置的信息,并且使通信部分126从中接收有关当前位置的信息。 At step F1711, the system controller 110 causes the communication section 126 by the current position of the GPS receiving section 121 sends the obtained information to Chuo having a built-in map of database server or network device, so that the server or device to retrieve information about the current position from the map database information, and causes the communication section 126 receives information about the current location. 当图像获取和显示设备IOI具有内置地图数据库时,系统控制器110 与由GPS接收部分121接收的经绵度信息相对应地从内置地图数据库检索有关当前位置的信息。 When the image capturing and displaying apparatus IOI has a built-in map database, the system controller 110 by receiving information of the Cotton received by the GPS section 121 corresponding to the information from the built-in map database to retrieve information about the current position.

当系统控制器IIO已经获得了有关当前位置的信息时,系统控制器110确定在当前位置上是否必须禁止增加红外灵敏度的图像获取操作。 When the system controller IIO has obtained information about the current position, the system controller 110 determines whether the current position must prohibit the increased infrared sensitivity image capturing operation.

当确定结果表示在当前位置上必须禁止增加红外灵敏度的图像获取操作时,流程从步骤F1712前进到步骤F1713。 When the determination result indicates it must be disabled increased infrared sensitivity image capturing operation at the current position, the flow advances from step F1712 to step F1713. 在步骤F1713, 系统控制器110确定已经出现了导致增加红外灵敏度的图像获取操作完成的图像控制触发。 At step F1713, the system controller 110 determines an image has occurred results in increased infrared sensitivity image capturing operation is completed control trigger. 当在步骤F1713的确定结果表示已经出现了图像控制触发时, 流程从图10所示的步骤F104前进到F106。 When the determined result at step F1713 denotes an image control trigger has occurred, the flow of steps shown in FIG. 10 F104 proceeds to F106. 在步骤F106,系统控制器IIO命令图像获取控制部分111完成增加红外灵敏度的图像获取操作。 In step F106, the system controller IIO commands the image capturing control section 111 to complete the increased infrared sensitivity image capturing operation. 因为与该位置相对应地禁止了增加红外灵敏度的图像获取操作, 所以可以防止不正确地使用诸如增加红外灵敏度的图像获取操作之类的特殊图像获取功能。 Since the position corresponding to the increased infrared sensitivity image prohibit capturing operation, it is possible to prevent the improper use such increased infrared sensitivity image capturing operation of such a special image acquisition function. 图29A示出了确定是否已经与由图像分析部分128获得的信息相对应地出现了图像控制触发的示范性处理。 FIG 29A illustrates the determination of whether there has been corresponding to an exemplary image processing control information triggered by the image analysis section 128 is obtained. 在图29A所示的步骤F1801 ,系统控制器110监控由图像分析部分128获得的信息。 In the step shown in FIG. 29A F1801, information portion 128 obtained by the system controller 110 to monitor and analyze the image. 图像分析部分128通过分析获取的图像来检测被摄对象是否包含目标。 The image analyzing section 128 detects whether the subject contains a target by analyzing the acquired image. 当分析结果表示获取的图像包含目标时,流程从步骤F1802前进到步骤F1803。 When the analysis result indicates the acquired image containing the target, the flow advances from step F1802 to step F1803. 在步骤F1803,系统控制器110确定已经出现了图像控制触发。 At step F1803, the system controller 110 determines that an image control trigger has occurred. 当在步骤F1803的确定结果表示已经出现了图像控制触发时, 流程从图10所示的步骤F104前进到步骤F106.在步猓F106,系统控制器110命令图像获取控制部分111和显示控制部分114执行预定的图像控制。 When the determined result at step F1803 denotes an image control trigger has occurred, the flow advances from step F104 shown in FIG. 10 to step F106. Guo step F106, the system controller 110 commands the image capturing control section 111 and the display control section 114 perform a predetermined image control. 图4象控制的示例如下所述。 Control example of Figure 4 as follows. 如果目标是小鸟,则当在获取图像中已经检测到小鸟时,系统控制器110可以命令显示图像处理部分112如图22A和图22B所示为图像中的小鸟部分执行突出显示操作。 If the target is a bird, when it has been detected in the image acquired birds, system controller 110 may command the display image processing section 112 shown in FIGS. 22A and 22B show the operation performed as a bird projecting part of the image. 在这种情况下,当用户观看野鸟时,他或者她可以容易地找到并跟随它们。 In this case, when the user is viewing wild birds, he or she can easily find and follow them. 如果目标是小猫而且用户喜欢猫的话,则当小猫已经进入他或者 If the goal is kitten and users love cats, then when the kitten has entered his or

她的视野时,因为在显示图像中突出显示了小猫,所以他或者她可以容易地认出它。 When her vision, because the display image is highlighted kitten, so he or she can easily recognize it.

如果目标是人,则当已经在所获取的图像中检测到他或者她时, If the target is a person, it has been detected when he or she is in the image acquired,

系统控制器110可以命令显示图像处理部分112、获取图像信号处理部分115、或者图像获取部分103突出显示、扩大、或者放大图像中的人部分。 The system controller 110 may command the display image processing section 112, the captured image signal processing section 115 or the image capturing section 103 to highlight, enlarge, or zoom a partial image of the person.

如果目标是人、动物、建筑物等,则可以仅仅显示目标并不绘制背景。 If the target is people, animals, buildings, etc., it can display only goal is not to draw the background.

作为替代,当已经检测到作为目标的人时,可以执行仅仅从图像中擦除人的图像处理。 Alternatively, when a person has been detected as a target, only an erase can be performed from the image of the person in the image processing. 例如,可以显示其中从自然场景中掩盖人和诸如汽车之类的人造物的图像。 For example, you can display an image such as a car in which the masked man like artifacts from the natural scene. 在这种情况下,可以通过用要被掩盖的目标的周围像素进行插值处理来执行填充目标的像素部分的处理。 In this case, the processing may be performed to fill the target pixel portion interpolation process by the target to be masked with the surrounding pixels.

另外,可以为诸如人之类的目标执行诸如马赛克显示操作之类的图像效果操作。 Further, the target may be performed such as a human such as a mosaic image displaying the operation results or the like operation.

与由图像分析部分128获得的信息相对应地执行图29A所示的处理。 The information obtained by the image analyzing section 128 performs the processing corresponding to FIG 29A. 作为替代,如果目标是诸如人或者动物之类的活体,则当作为获取目标传感器120的热电传感器已经检测到目标时,系统控制器110 可以确定已经出现了图像控制触发。 Trigger Alternatively, if the target is a living body such as a human or an animal or the like, when the pyroelectric sensor as the capturing target sensor 120 has detected the target, the system controller 110 may determine that an image control has occurred.

图29B示出了确定是否已经与由图像分析部分12获得的信息相对应地出现了图像控制触发的示范性处理。 FIG 29B illustrates the determination of whether the information corresponding to the obtained portion 12 appears exemplary image processing by the image analysis control trigger.

在图29B所示的步骤F1810,系统控制器110监控由图像分析部分128获得的信息。 In the step shown in FIG. 29B F1810, information portion 128 obtained by the system controller 110 to monitor and analyze the image. 图像分析部分128通过例如利用在获取图像的帧之间的差别来分析获取图像,来检测被摄对象是否正在快速移动。 The image analyzing section 128 analyzes the acquired images to detect whether the subject is moving fast, for example, by using a difference between the acquired image frames.

当检测结果表示被摄对象正快速移动时,流程从步骤F1811前进到步骤F1812。 When the detection result indicates that when the subject is moving fast, the flow advances from step F1811 to step F1812. 在步寐F1812,系统控制器110确定已经出现了导致要执行闪烁显示操作的图像控制触发。 Sleep soundly at step F1812, the system controller 110 determines execution has occurred to cause the image display operation control trigger flicker.

当在步骤F1812的确定结果表示已经出现了图像控制触发时, 流程从图10所示的步骤F104前进到F106。 When the determined result at step F1812 denotes an image control trigger has occurred, the flow of steps shown in FIG. 10 F104 proceeds to F106. 在步骤F106,系统控制器110命令显示控制部分114执行图^f象处理,以便显示如图9C所示 In step F106, the system controller 110 commands the display control section 114 executes image processing ^ f, so that the display shown in Figure 9C

的图像。 Image.

在这个处理过程中,执行闪烁显示操作,以便当用户正在观看运动比赛时,如果选手正快速移动,则他或者她可以看见选手的运动。 In this process, the execution of a blinking display operation, so that when the user is watching a sports game, if the player is moving fast, he or she can see the movement of players.

在这个示例中,当已经检测到快速运动时,出现导致执行闪烁显示操作的触发。 In this example, when a fast motion has been detected, leading to occurrence of triggering operation performed flashes. 作为替代,可以出现导致显示模式被切换到高帧频显示操作的触发.作为替代,当获取目标包含快速运动时,可以出现导致显示模式被切换到变焦显示模式或者突出显示模式的触发。 As an alternative, it may occur resulting in the display mode is switched to the high frame rate display operation of the trigger. Alternatively, when acquiring a target comprising fast motion may occur resulting in the display mode is switched to a zoom display mode or a trigger mode is highlighted.

图30A示出了确定是否已经与由图像分析部分128获得的信息相对应地出现了图4象控制触发的示范处理。 FIG 30A illustrates the determination of whether there has been corresponding to the exemplary process of FIG. 4 the image control trigger information from the image analyzing section 128 is obtained. 在这个示例中,当已经获取了一个人时,识别他或者她。 In this example, when a person has acquired, to identify him or her.

在图30A所示的步骤F1901 ,系统控制器110监控由图像分析部分128获得的信息。 In the step shown in FIG. 30A F1901, information portion 128 obtained by the system controller 110 to monitor and analyze the image. 图像分析部分128通过分析获取的图像来确定被摄对象是否包含人的面部。 The image analysis section 128 determines whether the face is a subject comprising human acquired by image analysis. 当被摄对象包含人的面部时,图像分析部分128根据面部图像生成个人特征数据。 When the subject contains the face of a person, the image analyzing section 128 generates personal characteristic data from the face image. 如上所述,个人特征数据例如为在眼睛中心和鼻子之间的距离EN和眼睛的距离Ed的比值(Ed/EN),以及在眼睛中心和嘴之间的距离EM和眼睛的距离Ed 的比值(Ed/EM)。 As described above, the personal characteristic data, such as the ratio between the center of the eye and the nose and the distance Ed of the eyes from EN (Ed / EN), and the ratio of the distance Ed of the eyes and the distance EM between the center of the eye and mouth (Ed / EM).

当已经提取了个人特征数据时,流程从步骤F1902前进到步骤F1903。 When personal characteristic data have been extracted, the flow advances from step F1902 to step F1903. 在步骤F1903,系统控制器110从个人数据库中检索与个人特征数据相对应的个人信息。 At step F1903, the system controller 110 retrieves personal characteristic data from the personal database corresponding to the personal information.

例如,系统控制器110使通信部分126将个人特征数据发送到具有内置个人数据库的网络服务器或者设备,使该服务器和设备从个人数据库中检索个人信息,并且使通信部分126从中接收所检索的结果。 For example, the system controller 110 causes the communication section 126 to transmit personal characteristic data to a network server or a device having a built-in personal database, and that the server device to retrieve personal information from the personal database, and the retrieved result received from the communication section 126 . 当图像获取和显示设备101具有内置个人数据库时,系统控制器110 可以从个人数据库中检索与个人特征数据相对应的个人信息。 When the image capturing and displaying apparatus 101 has a built-in personal database personal information, the system controller 110 from the personal database corresponding to the personal characteristic data retrieval.

当外部设备或者系统控制器110已经从个人数据库检索了预定人员的个人信息时,流程从步骤F1904前进到步骤F1905。 When an external device or system controller 110 has retrieved personal information of a predetermined person from the personal database, the flow advances from step F1904 to step F1905. 在步骤F1905,系统控制器110确定已经出现了导致显示个人信息的图像控制触发。 At step F1905, the system controller 110 determines that has occurred that causes personal information display image control trigger. 当确定结果表示已经出现了图像控制触发时,流程从图10所示的步骤F104前进到F106。 When the determined result denotes that has occurred when the image control trigger, the steps from the flow shown in FIG. 10 F104 proceeds to F106. 在步骤F106,系统控制器110命令显示控制部分114例如将所检索的个人信息叠加到获取的图像上。 In step F106, the system controller 110 commands the display control section 114, for example, to superimpose the retrieved personal information to the captured image. 当用户在正在行走的人群中看见用户已经遇见过的一个人或者某一名人,且该人或者名人已经被登记到个人数据库中时,显示部分102连同该人的图像一起显示在个人数据库中登记的信息(姓名、单位、用户曾经相遇的地点等)。 When the user sees the user has met or a famous person in a crowd is walking, and the person or celebrity that has been registered to the personal database, the display portion 102 along with the person's image is displayed together with registered in the personal database information (name, organization, did meet the user's location, etc.). 因此,用户可以准确地认出这个人。 Therefore, the user can accurately recognize this person. 图30B示出了确定是否已经与由图像分析部分128获得的信息相对应地出现了图像控制触发的示范性处理。 FIG 30B illustrates the determination of whether there has been corresponding to an exemplary image processing control information triggered by the image analysis section 128 is obtained. 当如图21A所示、由于阳光和阴影而使得图像不易看见时,执行这个处理过程。 When 21A, since the sun and shade so that an image easily visible, performs this processing. 在图30B所示的步骤F1910,系统控制器110监控由图像分析部分128获得的信息。 In the step shown in FIG. 30B F1910, information portion 128 obtained by the system controller 110 to monitor and analyze the image. 图像分析部分128通过分析获取的图像来检测在所获取的图像中是否由于日照情况而出现了明亮区域和黑暗区域。 The image analyzing section 128 detects whether or not the acquired image occurs due to direct sunlight where bright and dark areas acquired by image analysis. 当分析结果表示在该图像中存在阳光和阴影差别时,流程从步骤F1911前进到步骤F1912。 When the analysis result indicates the presence of sunlight and shade difference of the image, the flow advances from step F1911 to step F1912. 在步骤F1912,系统控制器110确定已经出现了图像控制触发。 At step F1912, the system controller 110 determines that an image control trigger has occurred. 当在步骤F1912的确定结果表示已经出现了图像控制触发时, 流程从图10所示的步骤F104前进到步骤F106。 When the determined result at step F1912 denotes an image control trigger has occurred, the flow of steps shown in FIG. 10 F104 proceeds to step F106. 在步骤F106,系统控制器110命令图像获取控制部分111和显示控制部分114执行图像处理或者部分地改变图像获取灵敏度,以便使阳光和阴影的差别消失。 In step F106, the system controller 110 commands the image capturing control section 111 and the display control section 114 performs image processing or partially change the image capturing sensitivity, so that the difference between sun and shade disappears. 因此,如图21B所示,向用户提供不太受阳光和阴影影响并且易于看见的图像。 Thus, as shown in FIG. 21B, the image providing less influence by the sun and shade, and easily visible to the user. 当图像包含由于房间或者机构中的照明等的影响而不是由于日照情况的影响而导致亮和暗的部分差别时,或者当图像部分不清楚时,系统控制器110可以命令图像获取控制部分111和显示控制部分114部分调整亮度、图像获取灵敏度、对比度等。 When the image containing the influence of the room or the like instead of the illumination means due to the influence of sunshine conditions caused by partial difference in light and dark, or when the image portion is not clear, the system controller 110 may command the image capturing control section 111 and a display section control section 114 to adjust the brightness, image capturing sensitivity, contrast and the like. 在图23到图30A和图30B中,已经描述了在图10的步骤F104 中确定是否已经出现图像控制触发的示范性处理。 In FIGS. 23 to 30A and 30B, it has been described in FIG. 10 is determined in step F104 whether the exemplary process of an image control trigger has occurred. 这个示范性处理可以应用于图10所示的步骤F102中确定是否已经出现了监视显示状态 It is determined in step F102 that the exemplary process illustrated in FIG. 10 may be applied whether or not a monitor display state has occurred

启动触发的处理,以及图10所示的步骤F105中确定是否已经出现了监视显示状态完成触发的处理。 F105 process start trigger is determined, and step shown in FIG. 10 has occurred if the monitor display state completion trigger process. 当在图10所示的步骤F101中显示状态为通过状态时,类似于图23所示的示范性处理,如果已经检测到了周围黑暗或者太亮的情况,则可以确定出现了监视显示状态启动触发,而且通过状态可以被切换为监视显示状态。 When the display state shown in step F101 in FIG. 10 to the through state, the exemplary process shown in FIG. 23 is similar, has been detected if the surroundings are dark or too bright, it can be determined that a monitor display state start trigger, and the monitor display may be switched to the through state. 当像图24A所示的示例性处理那样确定结果表示由于天气情况而必须调整获取图像时,可以确定已经出现了监视显示状态启动触发。 When the image determined as the exemplary process shown in FIG. 24A represents the result must be adjusted due to the weather conditions while acquiring the image, has occurred may be determined that a monitor display state start trigger. 在这种情况下,在预定的天气情况下,可以执行监视显示功能。 In this case, in a predetermined weather, monitor display function can be executed. 当像图24B所示的示例性处理那样确定结果表示周围黑暗时, 可以确定已经出现了监视显示状态启动触发。 When the determination result as an exemplary image processing shown in FIG. 24B indicates when the surroundings are dark, has occurred may be determined that a monitor display state start trigger. 在这种情况下,当周围黑暗时,可以自动地执行监视显示功能。 In this case, when the surroundings are dark, the monitor display may be automatically performed functions. 当像图25所示的示范性处理那样获取目标在远处或者近处时, 可以确定已经出现了监视显示状态启动触发。 When the exemplary image processing shown in FIG. 25 as acquired in the distance or near the target, has occurred may be determined that a monitor display state start trigger. 当像图26所示的示范性处理那样已经检测到了在用户附近的包含字符的图像时,可以确定已经出现了监视显示状态启动触发。 When the exemplary image processing as shown in FIG. 26 has been detected in the image containing the character in the vicinity of the user, has occurred may be determined that a monitor display state start trigger. 类似与图27所示的示范性处理,可以确定已经出现了与时区相对应的监视显示状态启动触发。 Similar to the exemplary process shown in FIG. 27 may be determined to have occurred when the area corresponding to the monitor display state start trigger. 当像图28A所示的示范性处理那样当前位置是预定地点时,可以确定已经出现了监视显示状态启动触发。 When the exemplary image processing shown in FIG. 28A as the current location is a predetermined location when it may be determined that a monitor display state has occurred start trigger. 在这种情况下,可以与预定地点或者机构类型相对应地执行监视显示功能。 In this case, the monitor display is performed corresponding to the predetermined location or the type of function mechanism. 当像图29A所示的示范性处理那样存在有预定目标时,可以确定已经出现了监视显示状态启动触发。 When the exemplary image processing shown in FIG. 29A as there is a predetermined target, has occurred may be determined that a monitor display state start trigger. 当像图29B所示的示范性处理那样已经在获取目标中检测到快速运动时,可以确定已经出现了监视显示状态启动触发。 When the exemplary process shown in the acquisition target has been detected in the fast-moving image in FIG. 29B, has occurred may be determined that a monitor display state start trigger. 当像图30A所示的示范性处理那样已经检测到预定人员时,可以确定已经出现了监视显示状态启动触发。 When the exemplary image processing shown in FIG. 30A as a predetermined person has been detected, has occurred may be determined that a monitor display state start trigger. 当像图30B所示的示范性处理那样在图像中存在明亮和黑暗分布时,可以确定已经出现了监视显示状态启动触发。 When as the exemplary process shown in the presence of bright and dark distribution in the image of FIG. 30B, has occurred may be determined that a monitor display state start trigger.

在这些示范性处理中,当确定已经出现了监视显示状态启动触发时,流程前进到图10所示的步驟F103。 In these exemplary processes, when it is determined has occurred when a monitor display state start trigger, the flow proceeds to the step shown in FIG. 10 F103. 因此,当用户已经戴上处于通过状态下的图像获取和显示设备IOI而没有执行特殊操作时,图像获取和显示设备IOI以与情况相对应的监视显示状态进行操作,而且用户可以在与该情况相对应的监视显示状态下看见图像。 Thus, when the user has put in a special operation is not performed by the image capturing and displaying apparatus in a state IOI, IOI image capturing and displaying apparatus in the case where a monitor display state corresponding to the operation, and the user may the case see the image in the monitor display state corresponding. 同样地,可以确定是否已经出现了监视显示状态完成触发。 Similarly, you can determine whether or not there have been a monitor display state completion trigger. 在图23所示的示范性处理中,当检测到周围黑暗或者太亮时, 在其中周围既不黑暗又不太亮的情况下,确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 In the exemplary process shown in FIG. 23, when detecting the surroundings are dark or too bright in the dark and which is neither too bright ambient conditions, has occurred is determined that a monitor display state completion trigger, and the display state may be restored to the through status. 在图24A所示的示范性处理中,确定是否必须由于天气情况而调整获取的图像。 In the exemplary process shown in FIG. 24A, it is determined whether the acquired images have to be adjusted due to the weather conditions. 当确定结果表示不必调整获取图像时,可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 When the determined result denotes that does not have to adjust while acquiring the image, has occurred can be determined that a monitor display state completion trigger, and the display state can be restored to the through state. 类似于图24B所示的示范性处理,可以确定周围是否是黑暗的。 Exemplary processing shown in FIG 24B is similar, it can determine whether the surrounding is dark. 当周围不黑暗时,可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 When darkness is not around, you can determine there have been a monitor display state completion trigger the display state can be restored to the through state. 类似于图25所示的示范性处理,可以确定获取目标是在远处还是在近处。 Exemplary processing shown in FIG. 25 is similar, the target is acquired may be determined in the near or distant. 当确定结果表示获取目标既不远又不近时,可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 When the determination result indicates acquisition target both the near and not close, you can determine there have been a monitor display state completion trigger, and the display state can be restored to the through state. 像图26所示的示范性处理那样,当在用户附近检测到包含字符的图像时,在其中还没有检测到图像的情况下,可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 Like the exemplary process of FIG. 26, as shown, when the user is detected near the image contains characters, in the case where the image has not been detected, has occurred may be determined that a monitor display state completion trigger, and the display state may be restored through the state. 像图27所示的示范性处理那样,可以确定已经与时区、月份和/ 或日期、季节等相对应地出现了监视显示状态完成触发。 FIG 27 Like the exemplary process shown may be determined to have occurred corresponding to a monitor display state with time zone, month and / or day, season, etc. completion trigger. #>图28A所示的示范性处理那样,在当前位置是预定位置时, 可以确定已经出现了监视显示状态完成触发。 #> FIG. 28A as shown in the exemplary process, the current position is a predetermined position, has occurred may be determined that a monitor display state completion trigger. 在这种情况下,可以与像图28B所示的示范性处理那样,当停止增加红外灵敏度的图像获取操作时,可以在步骤F1713确定已经出现了监视显示状态完成 In this case, the image may be the exemplary process shown in FIG. 28B, it stops increasing when the infrared sensitivity image capturing operation can be determined at step F1713 that a monitor display state has occurred completed

触发,而且显示状态可以恢复到通过状态。 Trigger, and the display state can be restored to the through state. 像图29A所示的示范性处理那样,当存在有预定被摄对象时, 可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 FIG. 29A as the exemplary process shown, when there is a predetermined subject, has occurred may be determined that a monitor display state completion trigger, and the display state may be restored to the through state. 例如,在这种情况下,禁止在监枧显示状态下获取和/ 或显示预定的被摄对象。 For example, in this case, under the supervision soap display prohibition state acquisition and / or display a predetermined subject. 作为替代,当确定结果表示没有预定被摄对象时,可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 Alternatively, when the determination result indicates that the subject is not predetermined, has occurred may be determined that a monitor display state completion trigger, and the display state may be restored to the through state. 像图29B所示的示范性处理那样,当检测到获取目标的快速运动时,在其中还没有检测到快速运动的情况下,可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 FIG. 29B as the exemplary process shown, upon detection of fast moving target acquisition, in the case where the fast motion has not been detected, and has occurred it may be determined that a monitor display state completion trigger, and the display state may be restored to by the state. 像图30A所示的示范性处理那样,当已经检测到预定人员时, 可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 FIG. 30A as the exemplary process shown, when a predetermined person has been detected, has occurred may be determined that a monitor display state completion trigger, and the display state may be restored to the through state. 在这种情况下,禁止在监视显示状态下获取和/或显示该预定人员。 In this case, the prohibition of the monitor display state acquisition and / or display the predetermined person. 作为替代,当确定在图像中没有预定人员时,可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 Alternatively, when it is determined there is no predetermined person in the image has occurred may be determined that a monitor display state completion trigger, and the display state may be restored to the through state. 像图30B所示的示范性处理那样,当在图像中检测到明亮和黑暗分布时,在其中还没有检测到亮和暗的差别的情况下,可以确定已经出现了监视显示状态完成触发,而且显示状态可以恢复到通过状态。 Like the case of the exemplary process as shown in FIG. 30B, when detecting the distribution of bright and dark in the image, which has not been detected in the difference between the bright and dark, has occurred may be determined that a monitor display state completion trigger display can be restored to the state by state. 在这些示范性处理中,当确定已经出现了监视显示状态完成触发而且流程返回到图IO所示的步驟FIOI时,在其中用户对监视显示状态的需要降低或者消失的情况下,或者在其中禁止监视显示功能的情况下,显示状态可以自动地切换到通过状态。 In these exemplary processes, when it is determined that a monitor display state has occurred and the flow returns to completion trigger when the step shown in FIG IO FIOI, where the user needs to be reduced to a monitor display state or disappear from, or which prohibits a case where the display monitor, the display state may be automatically switched to the through state. 【6.第二实施例的效果、修改、和扩展l根据这个实施例,由布置在眼镜型安装单元或者头盔型安装单元中的图像获取部分103获取的图像,即,在作为被摄对象方向的用户眼睛方向上的获取图像,被显示在用户他或者她眼睛前面的显示部分102上。 Example 6. Effect of the second embodiment, modifications, and extensions l According to this embodiment, the image acquired by the image acquisition section 103 arranged in a spectacle-type or helmet-type mounting unit mounting unit, i.e., in a direction of the subject acquiring an image of the eye direction of the user, the user is displayed on the front of his or her eyes on the display portion 102. 在这种情况下,与有关作为外部情况的周围亮度、天气、情 In this case, relating to the ambient brightness as an external situation, the weather, the situation

况、识别、被摄对象的运动、位置、日期与时间等有关的信息相对应地控制图像获取操作或者显示操作。 Information about the status, identification, motion of a subject, location, date and time and the like corresponding to control the image capturing operation or a display operation. 因此,可以创建实质上协助或者扩展用户视觉能力的情况。 Therefore, you can create or expand without substantially assist the user's visual capabilities.

因为与外部情况相对应地执行图像获取部分103的图像获取操作和与获取图像信号处理部分115和显示图像处理部分112的信号处理相对应的显示模式改变,所以没有向用户施加操作负担。 Since the external case corresponding to the image acquisition section 103 performs image capturing operation and a captured image signal processing section 115 and the display processing of the display image processing section 112 of the mode signal corresponding to the change, so there is no operational burden is imposed to the user. 另外,因为恰当地控制了图像获取和显示设备101,所以用户可以容易地使用它。 Further, since the proper control of the image capturing and displaying apparatus 101, the user can easily use it. 另外,因为通过控制显示部分102的透射率使其变为透明或者半透明的通过状态,所以当用户戴上安装单元时,它不会扰乱他或者她的正常生活。 Further, since the display by controlling the transmittance of the portion 102 so that it becomes transparent or translucent through state, when the user puts on the mounting unit, it does not disturb his or her normal life. 因此,在用户的正常生活中,可以有效地使用根据这个实施例的图像获取和显示设备101的益处。 Thus, the user's normal life, can be effectively used capturing and displaying apparatus 101 according to the benefits of this embodiment of the image.

在这个实施例中,已经主要描述了图像获取部分103的图像获取操作和由获取图像信号处理部分115和显示图像处理部分112的信号处理实现的显示模式。 In this embodiment, it has been mainly described image acquiring section 103 acquired by the acquisition operation and display mode of the image signal processing section 115 and the display image processing section 112 of the signal processing implementation. 例如,可以与外部情况相对应地控制通电、断电和待机的切换,以及从声音输出部分105输出的声音的音量和音质。 For example, switching may be controlled corresponding to the power, the external power-off, and standby, as well as volume and quality output portion 105 outputs the sound from the sound. 例如,可以与时间和/或地点相对应地调整音量。 For example, the volume can be adjusted relative to the time and / or place. 作为替代,可以检测周围音量,并且可以与所检测的周围音量相对应地调整扬声器的输出音量。 Alternatively, the surrounding sound volume may be detected, and may be adjusted corresponding to the output volume of the speaker and the detected surrounding sound volume. 图像获取和显示设备IOI的外观和结构不局限于图1、图2、和图20所示的那些外观和结构。 The image capturing and displaying apparatus IOI appearance and structure is not limited to FIG. 1, FIG. 2, the appearance and structure as those shown in FIGS. 20 and. 作为替代,可以进行各种修改。 Alternatively, various modifications can be made.

例如,可以在图像获取和显示设备101中布置存储由图像获取部分103获取的图像信号的存储部分,以及将图像信号发送到其它设备的传输部分。 For example, the acquisition and display device 101 are arranged in the storage section stores the acquired image signals by the image acquisition section 103, and the transmission section transmits the image signal to other devices in the image. 除了作为显示部分102上显示的图像的来源的图像获取部分103 之外,还可以在图像获取和显示设备IOI中布置从外部设备输入图像的输入部分和接收部分。 In addition to the source of the image as a display image displayed on the display section 102 acquires outside portion 103 can also acquire and display portion disposed external device input from the input section and the image in the image receiving apparatus IOI. 在这个实施例中,描述了其中图像获取和显示设备101是眼镜型安装单元或者头盔型安装单元的示例。 In this embodiment an example is described in which the image capturing and displaying apparatus 101 is an example of glasses type mounting unit or a helmet type mounting unit. 然而,只要图像获取和显示设 However, as long as the image capturing and displaying

备沿用户眼睛的方向获取图像并且在他或者她眼睛的前面显示图像, 该设备可以是用户可戴上的任何类型,诸如头戴耳机型、领口型、耳桂型等。 Preparation direction along the user's eyes and displays an image acquired his or her eyes in front of an image, the device may be any type of user can be put on, such as a headphone type, neck type, Guangxi ear type. 作为替代,图像获取和显示设备101可以是使用诸如回形针之类的安装部件附着于眼镜、帽舌、头戴耳机等上的单元。 Alternatively, the image capturing and displaying apparatus 101 may be used, such as paper-clips and the mounting member attached to eyeglasses, a visor, a headphone and the like on the unit. 本领域的那些技术人员应当理解:只要在权利要求和它们的等效内容的范围之内,取决于设计要求及其它因素,可以出现各种修改、 組合、子组合以及替换。 Those skilled in the art should be understood: as long as within the scope of the appended claims and their equivalents depending on design requirements and other factors, may occur various modifications, combinations, sub-combinations and alterations.

Claims (53)

  1. 1、一种图像获取和显示设备,包含: 图像获取装置,用于这样获取图像以便使用户看到被摄对象的方向为所述被摄对象的方向; 显示装置,布置在用户眼睛的前面,并且用于显示由图像获取装置获取的图像; 用户信息获得装置,用于获得有关用户的运动和身体情况的信息;以及控制装置,用于与由用户信息获得装置获得的信息相对应地控制图像获取装置的操作或者显示装置的操作。 1. An image capturing and displaying apparatus, comprising: image acquisition means for acquiring an image so that a direction to which a user sees a subject is a direction of the subject; a display means disposed in front of the eyes of the user, and means for displaying an image acquired by the image acquisition; user information obtaining means for obtaining information about the user's movements and physical condition; and a control means for the information obtained by the user information obtaining means controls the image corresponding to operation means or an operation of acquiring the display device.
  2. 2、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置确定与由用户信息获得装置所获得的信息相对应的用户希望或者用户情况,并且与确定结果相对应地控制所述图像获取装置的操作或者所述显示装置的操作。 2. The image capturing and displaying apparatus according to claim l, wherein said determining means and the control means the information corresponding to the obtained user information obtained by the user or the user desired situation, and control corresponding to the determination result operation of the apparatus or the image capturing operation of the display device.
  3. 3、 如权利要求l所述的图像获取和显示设备, 其中所述显示装置能够将显示状态从通过状态切换到图像显示状态或者反过来将显示状态从图像显示状态切换到通过状态,其中所述通过状态为透明或者半透明的,而在所述图像显示状态中,显示由所述图像获取装置获取的图像, 3, image capturing and displaying apparatus according to claim l, wherein said display device can be switched from the display state to the image display state or display state in turn from the image display state to the through state by state, wherein said through the transparent or translucent state, and the image display state, the display device of the image acquired by the image acquisition,
  4. 4、 如权利要求l所述的图像获取和显示设备, 其中所述用户信息获得装置是检测加速度、角速度、或者振动的传感器。 4, the image sensor l vibration acquisition and display device as claimed in claim, wherein the user information obtaining means is detecting acceleration, angular velocity, or.
  5. 5、 如权利要求l所述的图像获取和显示设备,其中所述用户信息获得装置是检测用户头部的运动、用户臂部的运动、用户手部的运动、用户腿部的运动、或者用户整个身体的运动的传感器。 5, image capturing and displaying apparatus according to claim l, wherein the user information obtaining means is detecting the user's head movement, movement of the user's arm, movement of the user's hand, the movement of the user's legs, or the user motion sensors throughout the body.
  6. 6、 如权利要求l所述的图像获取和显示设备, 其中所述用户信息获得装置是检测用户的不行走状态、行走状态、以及跑步状态的传感器。 6, as claimed in claim l image acquisition and display device, wherein the user information obtaining means is not detecting a user's walking state, running state, and a running state of the sensor.
  7. 7、 如权利要求l所述的图像获取和显示设备, 其中所述用户信息获得装置是检测用户视觉信息的视觉传感器。 7, an image as claimed in claim l acquisition and display device, wherein the user information obtaining means is detecting the user visual information in the visual sensor.
  8. 8、 如权利要求l所述的图像获取和显示设备, 其中所述用户信息获得装置是检测用户的视线、用户的焦距、用户的瞳孔扩张、用户的眼底模式、或者用户的眼皮运动作为用户视觉信息的传感器。 8. The image capturing and displaying apparatus according to claim l, wherein the user information obtaining means is detecting the user's gaze, the focal length of the user, the user's pupil dilation, retinal pattern of the user, or the motion of the user's eyelid as the visual user sensor information.
  9. 9、 如权利要求l所述的图像获取和显示设备, 其中所述用户信息获得装置是检测用户的生物学信息的生物学传感器。 9. The image capturing and displaying apparatus according to claim l, wherein the user information obtaining means is a biological sensor for detecting the biological information of the user.
  10. 10、 如权利要求l所述的图像获取和显示设备, 其中所述用户信息获得装置是检测心率信息、脉搏信息、出汗信息、脑电波信息、皮肤电反应信息、血压信息、体温信息、或者呼吸活动信息作为用户的生物学信息的传感器。 10, image capturing and displaying apparatus according to claim l, wherein said information obtaining means is detecting the user heart rate information, pulse information, perspiration information, brain wave information, galvanic skin response information, blood pressure information, body temperature information, or respiratory activity information as biological information of the user sensor.
  11. 11、 如权利要求l所述的图像获取和显示设备,其中所述用户信息获得装置是检测代表用户的紧张状态或者用户的兴奋状态的信息的生物学传感器。 11, an image as claimed in claim l acquisition and display device, wherein the user information obtaining means is a biological sensor for detecting information representative of the excited state of the user or the user's tension.
  12. 12、 如权利要求l所述的图像获取和显示设备,其中所述用户信息获得装置被形成为能够至少输入视野信息的输入部分。 12, an image as claimed in claim l acquisition and display device, wherein the user information obtaining means is formed as a field of view capable of inputting at least information input portion.
  13. 13、 如权利要求l所述的图像获取和显示设备,其中所述控制装置控制所述图像获取装置启动和停止图像获取操作。 13, image capturing and displaying apparatus according to claim l, wherein said control means controls said image obtaining means to start and stop the image capturing operation.
  14. 14、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置可变地控制图像获取装置,以执行从远景图像获取操作到广角图像获取操作的图像获取操作。 14, image capturing and displaying apparatus according to claim l, wherein said control means variably controls the image capturing apparatus to perform an image operation to obtain a wide angle image capturing operation from the perspective of the image capturing operation.
  15. 15、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置控制所述图像获取装置的焦距。 15, image capturing and displaying apparatus according to claim l, wherein said control means controls the focal length of the image acquisition apparatus.
  16. 16、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置可变地控制所述图像获取装置的图像获取灵敏度。 16, as the image capturing and displaying apparatus as claimed in claim l, wherein said control means variably controls the image capturing sensitivity acquisition means.
  17. 17、 如权利要求l所述的图像获取和显示设备,其中所述控制装置可变地控制所述图像获取装置的红外图像获取灵敏度。 17. The image capturing and displaying apparatus as claimed in claim l, wherein said control means variably controls the image capturing infrared image capturing sensitivity of the apparatus.
  18. 18、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置可变地控制所述图像获取装置的紫外图像获取灵敏度。 18, image capturing and displaying apparatus according to claim l, wherein said control means variably controls the image capturing apparatus ultraviolet image capturing sensitivity.
  19. 19、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置可变地控制所述图像获取装置的帧频。 19, image capturing and displaying apparatus according to claim l, wherein said control means variably controlling the frame rate of the image acquisition apparatus.
  20. 20、 如权利要求l所述的图像获取和显示设备,其中所述控制装置控制所述图像获取装置中的图像获取透镜系统的操作。 20, image capturing and displaying apparatus according to claim l, wherein said image control means controls the image capturing apparatus capturing operation of the lens system.
  21. 21、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置控制图像获取信号处理部分的操作,该图像获取信号处理部分处理由所述图像获取装置的图像传感器所获得的获取图像信号。 21, as the image capturing and displaying apparatus as claimed in claim l, wherein said control means controls the image capturing operation of the signal processing section, the image acquisition apparatus acquires an image obtained by the image sensor signal processing section processes the image acquired by the signal.
  22. 22、 如权利要求l所述的图像获取和显示设备, 其中所述显示装置能够将显示状态从通过状态切换到图像显示状态或者反过来将显示状态从图像显示状态切换到通过状态,其中所述通过状态为透明或者半透明的,而在所述图像显示状态中,显示由所述图像获取装置获取的图像;以及其中所述控制装置控制所述显示装置以将显示状态从通过状态切换到图像显示状态或者反过来将显示状态从图像显示状态切换到通过状态。 22, image capturing and displaying apparatus according to claim l, wherein said display device can be switched from the display state to the image display state or display state in turn from the image display state to the through state by state, wherein said through the transparent or translucent state, and the image display state, a display image obtained by the image acquisition means; and wherein said control means controls said display means to switch the display state from the through state to the image or, conversely, the display state is switched from the display state of the image display state to the through state.
  23. 23、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置控制所述显示装置以扩大或者缩小在其上显示的图像。 23, an image as claimed in claim l acquisition and display device, wherein said control means controls said display means to enlarge or reduce the image displayed thereon.
  24. 24、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置控制所述显示装置以分离在其上显示的图像。 24, as the image capturing and displaying apparatus as claimed in claim l, wherein said control means controls said display means to separate the image displayed thereon.
  25. 25、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置控制所述显示装置上显示的图像的显示亮度。 25, image capturing and displaying apparatus according to claim l, wherein said control means controls the display luminance of an image displayed on the display device.
  26. 26、 如权利要求l所述的图像获取和显示设备, 其中所述控制装置控制对所述显示装置上显示的图像信号的信号处理。 26, an image as claimed in claim l acquisition and display device, wherein said control means controls signal processing on the display image signal on a display device.
  27. 27、 如权利要求l所述的图像获取以及显示设备,还包含: 照明装置,用于沿被摄对象方向照亮该被摄对象, 其中所述控制装置控制所述照明装置以便与由所述用户信息获得装置所获得的信息相对应地执行所述照明装置的照明操作。 27. The image acquisition and display device of claim l, claim further comprising: illumination means for illuminating a direction along the subject the subject, wherein the means for controlling the lighting device so as controlled by the said obtaining user information corresponding to the obtained apparatus perform lighting operation of the lighting device.
  28. 28、 一种图像获取和显示设备中的图像获取和显示方法,该图像获取和显示设备具有:图像获取装置,用于这样获取图像以便使用户看到被摄对象的方向是所述被摄对象的方向;以及显示装置,布置在用户的前面并用于显示由图像获取装置所获取的图像,所述方法包含步骤:获得有关用户的运动或者用户的身体情况的信息;以及与在用户信息获得步骤中获得的信息相对应地控制所述图像获取装置的操作或者所述显示装置的操作。 28, an image acquisition and image capturing and displaying method of the display apparatus, the image capturing and displaying apparatus comprising: image acquiring means for acquiring the image so that a direction to which a user sees a subject is a subject direction; and a display means for displaying an image device arranged and acquired by the image acquisition, the method comprising the step of the user in front of: obtaining information about a user's physical condition or movement of the user; and a user information obtaining step information corresponding to the obtained apparatus controls the operation of the image acquisition or the operation of the display device.
  29. 29、 一种图像获取和显示设备,包含:图像获取装置,用于这样获取图像以便使用户看到被摄对象的方向为所述被摄对象的方向;显示装置,布置在用户眼睛的前面,并且用于显示由所述图像获取装置获取的图像;外部信息获得装置,用于获得外部信息;以及控制装置,用于与由所述外部信息获得装置获得的信息相对应地控制所述图像获取装置的操作或者所述显示装置的操作。 29, an image capturing and displaying apparatus, comprising: image acquisition means for acquiring an image so that a direction to which a user sees a subject is a direction of the subject; a display means disposed in front of the eyes of the user, and means for displaying an image acquired by the image acquisition; external information obtaining means for obtaining external information; and a control means for obtaining the information obtained by the external information corresponding to the image acquiring control operating means or said display means.
  30. 30、 如权利要求29所述的图像获取和显示设备, 其中所述显示装置能够将显示状态从通过状态切换到图像显示状态或者反过来将显示状态从图像显示状态切换到通过状态,其中所述通过状态为透明或者半透明的,而在所述图像显示状态中,显示由所述图像获取装置获取的图像。 30, as claimed in claim 29 wherein the image capturing and displaying apparatus, wherein the display device can display the state or the state in turn from the image display state to the display state by switching from state to state through the image display, through the transparent or translucent state, and the image display state, the display device of the image acquired by the image acquisition.
  31. 31、 如权利要求29所述的图像获取和显示设备, 其中所述外部信息获得装置是检测周围环境情况作为外部信息的传感器。 31, as claimed in claim 29 image acquisition and display device, wherein the external information obtaining means is a sensor to detect the ambient environmental conditions as the external information.
  32. 32、 如权利要求29所述的图像获取和显示设备, 其中所述外部信息获得装置是检测有关所述图像获取装置的获取目标的信息作为外部信息的传感器。 32, 29 according to image capturing and displaying apparatus as claimed in claim, wherein the external information obtaining means is related to the detection of the target image obtaining information acquisition apparatus as an external sensor information.
  33. 33、 如权利要求29所述的图像获取和显示设备, 其中所述外部信息获得装置获得当前位置信息作为外部信息。 33, as claimed in claim 29 image acquisition and display device, wherein the external information obtaining means obtains current position information as the external information.
  34. 34、 如权利要求29所述的图像获取和显示设备,其中所述外部信息获得装置获得当前日期与时间作为外部信息。 34, as claimed in claim 29 image acquisition and display device, wherein the external information obtaining means obtains a current date and time as the external information.
  35. 35、 如权利要求29所述的图像获取和显示设备, 其中所述外部信息获得装置通过与外部设备的通信获得外部信息。 35. The image capturing and displaying apparatus as claimed in claim 29, wherein the external information obtaining means obtains the external information through communication with an external device.
  36. 36、 如权利要求29所述的图像获取和显示设备,其中所述外部信息获得装置通过分析由所述获取装置获取的图像来获得外部信息。 36, 29 according to image capturing and displaying apparatus as claimed in claim, wherein the external information obtaining means obtains the image from the external information acquired by the acquisition means analyzing.
  37. 37、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是周围亮度、温度、湿度、大气压力、或者天气的信息。 37, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining means is information about surrounding brightness, temperature, humidity, atmospheric pressure, or weather.
  38. 38、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是有关到所述图像获取装置的获取目标的距离的信息。 38, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining is to obtain information relating to the image acquired from the target device.
  39. 39、 如权利要求29所述的图像获取和显示设备, 其中由所述外部信息获得装置获得的外部信息是由所述图像获取装置的获取目标所发射的红外辐射的信息或者能量。 39, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining means is information or energy of an infrared radiation apparatus obtaining the transmitted target acquired by the image.
  40. 40、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是由所述图像获取装置的获取目标所发射的紫外辐射的信息或者能量。 40, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining means is information or energy of an ultraviolet obtaining the target device acquiring the radiation emitted by the image.
  41. 41、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是标识所述图像获取装置的获取目标的信息。 41, as claimed in claim 29 image acquisition and display device, wherein the external information obtaining means is to identify the image obtained by the external information acquisition object information obtaining apparatus.
  42. 42、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是识别作为所述图像获取装置的获取目标的人、动物、建筑物、或者设备的信息。 42, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining means obtains the target identification information as the person image acquisition device, animal, building, or a facility .
  43. 43、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是所述图像获取装置的获取目标的运动信息。 43, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining means for obtaining the motion information of the target image acquisition device.
  44. 44、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是识别所述图像获取装置的获取目标中的人的信息。 44, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining means for obtaining the image of the acquisition target recognition apparatus person's information.
  45. 45、 如权利要求29所述的图像获取和显示设备, 其中由所述外部信息获得装置获得的外部信息是利用其确定所述图像获取装置的获取目标是否为字符的信息。 45, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information acquired using the image acquisition means which determines whether the target of acquisition of information of the character.
  46. 46、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是有关与当前位置相对应的地点的信息。 46, as claimed in claim 29 image acquisition and display device, wherein the external information obtaining means is information relating to the current location corresponding to the location information obtained by the external.
  47. 47、 如权利要求29所述的图像获取和显示设备, 其中由所述外部信息获得装置获得的外部信息是有关与当前位置相对应的区域中的建筑物或者自然物的信息。 47, 29 of the image capturing and displaying apparatus as claimed in claim, wherein the external information obtaining means is associated with the current position information area corresponding to the building or natural object is obtained by the external information.
  48. 48、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是有关由所述图像获取装置获取的图像的亮度、暗度、或者锐度的信息。 48, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining means is a means for acquiring the relevant luminance image acquired by the image, darkness, or sharpness information.
  49. 49、 如权利要求29所述的图像获取和显示设备,其中由所述外部信息获得装置获得的外部信息是由所述图像获取装置获取的图像的局部亮度、暗度、或者锐度的信息。 49, as claimed in claim 29 image acquisition and display device, wherein the external information obtained by the external information obtaining means is a means for acquiring local brightness of the image acquired by the image, darkness, or sharpness information.
  50. 50、 如权利要求29所述的图像获取和显示设备,还包含: 声音合成装置,用于合成与由所述图像获取装置获取的图像中所包含的字符相对应的声音;以及声音输出装置,用于输出由所述声音合成装置生成的合成声音; 其中所述控制装置与由所述外部信息获得装置获得的信息相对应地控制由所述声音合成装置生成的合成声音的输出操作。 50, as claimed in claim 29 image acquisition and display device further comprising: sound synthesizing means for synthesizing the character image acquired by said image acquisition contained in a sound corresponding to; and a sound output device, for outputting a synthesized sound generated by the sound synthesizing means; wherein said control means with information by the external information obtaining means for obtaining a control output corresponding to the synthesized sound generated by the sound synthesizing means.
  51. 51、 一种图像获取和显示设备中的图像获取和显示方法,该图像获取和显示设备具有:图像获取装置,用于这样获取图像以便使用户看到被摄对象的方向是所述被摄对象的方向;以及显示装置,布置在用户的前面并用于显示由图像获取装置所获取的图像,所述方法包含步骤:获得外部信息;以及与在所述外部信息获得步骤中获得的信息相对应地控制所述图像获取装置的操作或者所述显示装置的操作。 51, an image acquisition and image capturing and displaying method of the display apparatus, the image capturing and displaying apparatus comprising: image acquiring means for acquiring the image so that a direction to which a user sees a subject is a subject direction; and a display means, disposed in front of the user, and means for displaying an image acquired by the image, said method comprising the steps of: obtaining external information; and the information obtained at the external information obtaining step in correspondence with controlling operation of said image capturing means or the operation of the display device.
  52. 52、 一种图像获取和显示设备,包含:图像获取部分,这样获取图像以便使用户看到被摄对象的方向是该被摄对象的方向;显示部分,布置在用户眼睛的前面,并且显示由图像获取部分获取的图像;用户信息获得部分,获得有关用户的运动和身体情况的信息;以及控制部分,与由所述用户信息获得部分获得的信息相对应地控制所述图像获取部分的操作或者所述显示部分的操作。 52, an image capturing and displaying apparatus, comprising: an image acquisition section acquiring the image so that a direction to which a user sees a subject is a direction of the subject; a display portion is arranged in front of the eyes of the user, and a display an image acquisition section acquiring the image; a user information obtaining section to obtain motion information about the user and the physical condition; and a control section, and information obtained by the user information obtaining section is controlled corresponding to the operating portion of the image acquisition or the display operation portion.
  53. 53、 一种图像获取和显示设备,包含:图像获取部分,这样获取图像以便使用户看到被摄对象的方向是该被摄对象的方向;显示部分,布置在用户眼睛的前面,并且显示由所述图像获取部分获取的图像;外部信息获得部分,获得外部信息;以及控制部分,与由所述外部信息获得部分获得的信息相对应地控制所述图像获取部分的操作或者所述显示部分的操作。 53, an image capturing and displaying apparatus, comprising: an image acquisition section acquiring the image so that a direction to which a user sees a subject is a direction of the subject; a display portion is arranged in front of the eyes of the user, and a display the image acquisition section acquiring the image; external information obtaining section, obtaining external information; and a control section, and information by the external information obtaining section obtains the image corresponding to the acquired operation control section or the display section operating.
CN 200710153620 2006-09-08 2007-09-07 Image capturing and displaying apparatus and image capturing and displaying method CN101141567B (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2006-244685 2006-09-08
JP2006244685A JP4961914B2 (en) 2006-09-08 2006-09-08 Imaging display apparatus, an imaging display method
JP2006-261975 2006-09-27
JP2006261975A JP2008083289A5 (en) 2006-09-27

Publications (2)

Publication Number Publication Date
CN101141567A true true CN101141567A (en) 2008-03-12
CN101141567B CN101141567B (en) 2012-12-05

Family

ID=39193289

Family Applications (2)

Application Number Title Priority Date Filing Date
CN 200910126811 CN101520690B (en) 2006-09-08 2007-09-07 Image capturing and displaying apparatus and image capturing and displaying method
CN 200710153620 CN101141567B (en) 2006-09-08 2007-09-07 Image capturing and displaying apparatus and image capturing and displaying method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN 200910126811 CN101520690B (en) 2006-09-08 2007-09-07 Image capturing and displaying apparatus and image capturing and displaying method

Country Status (2)

Country Link
JP (1) JP4961914B2 (en)
CN (2) CN101520690B (en)

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102213831A (en) * 2010-04-08 2011-10-12 索尼公司 Image displaying method for a head-mounted type display unit
CN102223560A (en) * 2011-05-04 2011-10-19 友达光电股份有限公司 Audio and video playing system related to dual-image application and method thereof
CN102918444A (en) * 2011-03-25 2013-02-06 松下电器产业株式会社 Dispay device
CN103064188A (en) * 2011-11-30 2013-04-24 微软公司 Head-mounted display based education and instruction
CN103258107A (en) * 2012-02-17 2013-08-21 普天信息技术研究院有限公司 Monitoring method and assistant monitoring system
CN103369212A (en) * 2012-03-28 2013-10-23 联想(北京)有限公司 Image acquisition method and device
CN103499885A (en) * 2013-09-30 2014-01-08 北京智谷睿拓技术服务有限公司 Imaging device and method
CN103501406A (en) * 2013-09-16 2014-01-08 北京智谷睿拓技术服务有限公司 Image acquisition system and an image acquisition method
CN103499886A (en) * 2013-09-30 2014-01-08 北京智谷睿拓技术服务有限公司 Imaging device and method
CN103576315A (en) * 2012-07-30 2014-02-12 联想(北京)有限公司 Display device
CN103593051A (en) * 2013-11-11 2014-02-19 百度在线网络技术(北京)有限公司 Head-mounted type display equipment
CN103595984A (en) * 2012-08-13 2014-02-19 辉达公司 3D glasses, a 3D display system, and a 3D display method
CN103713387A (en) * 2012-09-29 2014-04-09 联想(北京)有限公司 Electronic device and acquisition method
CN103976733A (en) * 2014-05-21 2014-08-13 蓝江涌 Multi-passage brain wave control glasses
CN104169784A (en) * 2011-11-03 2014-11-26 福尔图纳乌尔比斯有限公司 Eyeglasses
CN104238120A (en) * 2013-12-04 2014-12-24 全蕊 Smart glasses and control method
CN104281266A (en) * 2014-10-17 2015-01-14 栾林林 Head-mounted display equipment
CN104395857A (en) * 2012-05-09 2015-03-04 英特尔公司 Eye tracking based selective accentuation of portions of a display
CN104850217A (en) * 2014-02-19 2015-08-19 联想(北京)有限公司 Human eye movement monitoring device, method and equipment
CN104871525A (en) * 2012-12-26 2015-08-26 索尼公司 Image processing device, and image processing method and program
WO2015131483A1 (en) * 2014-06-05 2015-09-11 中兴通讯股份有限公司 Image shooting processing method and device
CN105137601A (en) * 2015-10-16 2015-12-09 上海斐讯数据通信技术有限公司 Intelligent glasses
CN105144693A (en) * 2013-03-15 2015-12-09 高通股份有限公司 Always-on camera sampling strategies
WO2016070683A1 (en) * 2014-11-05 2016-05-12 努比亚技术有限公司 Screen color temperature adjustment method, device, terminal and computer storage medium
CN105607256A (en) * 2016-01-04 2016-05-25 深圳市华星光电技术有限公司 Intelligent wearable device
CN105654894A (en) * 2014-11-12 2016-06-08 西安诺瓦电子科技有限公司 LED brightness correction method
CN105676458A (en) * 2016-04-12 2016-06-15 王鹏 Wearable calculation device and control method thereof, and wearable equipment with wearable calculation device
CN105850111A (en) * 2013-10-14 2016-08-10 纳拉提弗股份公司 Method of operating a wearable lifelogging device
CN105988590A (en) * 2015-03-23 2016-10-05 卡西欧计算机株式会社 Information output apparatus and information output method
CN106445164A (en) * 2016-10-18 2017-02-22 北京小米移动软件有限公司 Adjusting method and device of intelligent glasses
US9798139B2 (en) 2013-01-28 2017-10-24 Beijing Lenovo Software Ltd. Wearable electronic device and display method

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4730569B2 (en) * 2009-03-27 2011-07-20 カシオ計算機株式会社 Imaging apparatus, imaging method, and program
KR100957575B1 (en) * 2009-10-01 2010-05-11 (주)올라웍스 Method, terminal and computer-readable recording medium for performing visual search based on movement or pose of terminal
CN102404494B (en) * 2010-09-08 2015-03-04 联想(北京)有限公司 Electronic equipment and method for acquiring image in determined area
EP2499960B1 (en) * 2011-03-18 2015-04-22 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method for determining at least one parameter of two eyes by setting data rates and optical measuring device
KR20140059213A (en) * 2011-08-30 2014-05-15 마이크로소프트 코포레이션 Head mounted display with iris scan profiling
US20140361988A1 (en) * 2011-09-19 2014-12-11 Eyesight Mobile Technologies Ltd. Touch Free Interface for Augmented Reality Systems
CN108595009A (en) * 2012-02-29 2018-09-28 联想(北京)有限公司 Kind of human-computer interaction control method and an electronic terminal
JP5938977B2 (en) * 2012-03-23 2016-06-22 ソニー株式会社 Head-mounted display and surgery system
WO2014017200A1 (en) 2012-07-25 2014-01-30 ソニー株式会社 Information processing device and program
CN103677704B (en) * 2012-09-20 2018-11-09 联想(北京)有限公司 A display apparatus and a display method
KR20140066848A (en) * 2012-11-22 2014-06-02 경북대학교 산학협력단 Face detecting device and method for detect of face
EP2956814A1 (en) 2013-02-14 2015-12-23 Seiko Epson Corporation Head mounted display and control method for head mounted display
JP6299067B2 (en) * 2013-02-14 2018-03-28 セイコーエプソン株式会社 The method of the head-mounted display device and head-mounted display device
JP5273323B1 (en) * 2013-03-13 2013-08-28 パナソニック株式会社 Head-mounted display device
EP3013042A4 (en) * 2013-06-19 2016-08-17 Panasonic Ip Man Co Ltd Image display device and image display method
CN103558971A (en) * 2013-10-29 2014-02-05 小米科技有限责任公司 Browsing method, browsing device and terminal device
JP6264855B2 (en) * 2013-11-18 2018-01-24 セイコーエプソン株式会社 The method of the head-mounted display device and head-mounted display device
JP5751315B2 (en) * 2013-11-20 2015-07-22 ソニー株式会社 Image display method in the head-mounted display
WO2015098253A1 (en) * 2013-12-26 2015-07-02 株式会社ニコン Electronic device
CN103823563B (en) * 2014-02-28 2016-11-09 北京云视智通科技有限公司 A head-mounted display device intelligent
CN105511750A (en) * 2014-09-26 2016-04-20 联想(北京)有限公司 Switching method and electronic equipment
JP6405991B2 (en) * 2014-12-24 2018-10-17 セイコーエプソン株式会社 Electronic equipment, a display device, and a control method of an electronic device
WO2016139976A1 (en) * 2015-03-02 2016-09-09 ソニー株式会社 Information processing apparatus, information processing method, and program
CN108369797A (en) * 2015-11-30 2018-08-03 株式会社尼康 Display device, display program, and display method

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5333029A (en) 1990-10-12 1994-07-26 Nikon Corporation Camera capable of detecting eye-gaze
JPH0923451A (en) * 1995-07-05 1997-01-21 Sanyo Electric Co Ltd Sensitivity response controller
JPH09211382A (en) * 1996-02-07 1997-08-15 Canon Inc Optical device
JP3877366B2 (en) * 1997-01-20 2007-02-07 本田技研工業株式会社 Head-mounted display device for a vehicle
DE69840547D1 (en) 1997-10-30 2009-03-26 Myvu Corp Interface system for glasses
JPH11164186A (en) * 1997-11-27 1999-06-18 Fuji Photo Film Co Ltd Image recorder
JP2003011722A (en) * 2001-06-29 2003-01-15 Toyota Motor Corp Nighttime running support device
JP4182730B2 (en) * 2002-11-19 2008-11-19 ソニー株式会社 The imaging device and method
JP4239738B2 (en) * 2003-07-22 2009-03-18 ソニー株式会社 Imaging device
JP2005078045A (en) * 2003-09-04 2005-03-24 Pentax Corp Optical equipment for observation with image display function
JP3968522B2 (en) 2003-10-06 2007-08-29 ソニー株式会社 Recording apparatus and recording method
JP3979394B2 (en) * 2004-02-19 2007-09-19 松下電器産業株式会社 Imaging device
JP2005318973A (en) 2004-05-07 2005-11-17 Sony Corp Biological sensor apparatus, content reproducing method and content reproducing apparatus
JP2006129288A (en) * 2004-10-29 2006-05-18 Konica Minolta Photo Imaging Inc Video display device
JP2006148541A (en) * 2004-11-19 2006-06-08 Denso Corp Navigation device and program
JP2006208997A (en) * 2005-01-31 2006-08-10 Konica Minolta Photo Imaging Inc Video display device and video display system
JP4378636B2 (en) 2005-02-28 2009-12-09 ソニー株式会社 The information processing system, information processing apparatus and an information processing method, program, and recording medium
US20080062291A1 (en) 2006-09-08 2008-03-13 Sony Corporation Image pickup apparatus and image pickup method

Cited By (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102213831B (en) * 2010-04-08 2015-05-13 索尼公司 Image displaying method for a head-mounted type display unit
CN102213831A (en) * 2010-04-08 2011-10-12 索尼公司 Image displaying method for a head-mounted type display unit
CN102918444A (en) * 2011-03-25 2013-02-06 松下电器产业株式会社 Dispay device
CN102918444B (en) * 2011-03-25 2015-12-23 松下电器产业株式会社 The display device
US8537207B2 (en) 2011-05-04 2013-09-17 Au Optronics Corporation Video-audio playing system relating to 2-view application and method thereof
CN102223560A (en) * 2011-05-04 2011-10-19 友达光电股份有限公司 Audio and video playing system related to dual-image application and method thereof
CN104169784A (en) * 2011-11-03 2014-11-26 福尔图纳乌尔比斯有限公司 Eyeglasses
CN104169784B (en) * 2011-11-03 2016-08-24 福尔图纳乌尔比斯有限公司 glasses
CN103064188A (en) * 2011-11-30 2013-04-24 微软公司 Head-mounted display based education and instruction
CN103258107A (en) * 2012-02-17 2013-08-21 普天信息技术研究院有限公司 Monitoring method and assistant monitoring system
CN103369212A (en) * 2012-03-28 2013-10-23 联想(北京)有限公司 Image acquisition method and device
CN104395857A (en) * 2012-05-09 2015-03-04 英特尔公司 Eye tracking based selective accentuation of portions of a display
CN103576315A (en) * 2012-07-30 2014-02-12 联想(北京)有限公司 Display device
CN103576315B (en) * 2012-07-30 2017-03-01 联想(北京)有限公司 The display device
US9316835B2 (en) 2012-07-30 2016-04-19 Lenovo (Beijing) Co., Ltd. Head worn display device
CN103595984A (en) * 2012-08-13 2014-02-19 辉达公司 3D glasses, a 3D display system, and a 3D display method
CN103713387A (en) * 2012-09-29 2014-04-09 联想(北京)有限公司 Electronic device and acquisition method
CN104871525A (en) * 2012-12-26 2015-08-26 索尼公司 Image processing device, and image processing method and program
US9798139B2 (en) 2013-01-28 2017-10-24 Beijing Lenovo Software Ltd. Wearable electronic device and display method
CN105144693A (en) * 2013-03-15 2015-12-09 高通股份有限公司 Always-on camera sampling strategies
US10002293B2 (en) 2013-09-16 2018-06-19 Beijing Zhigu Rui Tuo Tech Co., Ltd. Image collection with increased accuracy
CN103501406A (en) * 2013-09-16 2014-01-08 北京智谷睿拓技术服务有限公司 Image acquisition system and an image acquisition method
CN103501406B (en) * 2013-09-16 2017-04-12 北京智谷睿拓技术服务有限公司 Image acquisition system and an image acquisition method
CN103499885A (en) * 2013-09-30 2014-01-08 北京智谷睿拓技术服务有限公司 Imaging device and method
US9961257B2 (en) 2013-09-30 2018-05-01 Beijing Zhigu Rui Tuo Tech Co., Ltd. Imaging to facilitate object gaze
WO2015043274A1 (en) * 2013-09-30 2015-04-02 Beijing Zhigu Rui Tuo Tech Co., Ltd Imaging to facilitate object observation
CN103499886A (en) * 2013-09-30 2014-01-08 北京智谷睿拓技术服务有限公司 Imaging device and method
CN103499886B (en) * 2013-09-30 2015-07-08 北京智谷睿拓技术服务有限公司 Imaging device and method
CN105850111A (en) * 2013-10-14 2016-08-10 纳拉提弗股份公司 Method of operating a wearable lifelogging device
CN103593051A (en) * 2013-11-11 2014-02-19 百度在线网络技术(北京)有限公司 Head-mounted type display equipment
CN103593051B (en) * 2013-11-11 2017-02-15 百度在线网络技术(北京)有限公司 Head-mounted display device
CN104238120A (en) * 2013-12-04 2014-12-24 全蕊 Smart glasses and control method
CN104850217A (en) * 2014-02-19 2015-08-19 联想(北京)有限公司 Human eye movement monitoring device, method and equipment
CN103976733A (en) * 2014-05-21 2014-08-13 蓝江涌 Multi-passage brain wave control glasses
WO2015131483A1 (en) * 2014-06-05 2015-09-11 中兴通讯股份有限公司 Image shooting processing method and device
US10136047B2 (en) 2014-06-05 2018-11-20 Zte Corporation Focusing method and device for image shooting
CN104281266A (en) * 2014-10-17 2015-01-14 栾林林 Head-mounted display equipment
WO2016070683A1 (en) * 2014-11-05 2016-05-12 努比亚技术有限公司 Screen color temperature adjustment method, device, terminal and computer storage medium
CN105654894A (en) * 2014-11-12 2016-06-08 西安诺瓦电子科技有限公司 LED brightness correction method
CN105988590A (en) * 2015-03-23 2016-10-05 卡西欧计算机株式会社 Information output apparatus and information output method
CN105137601A (en) * 2015-10-16 2015-12-09 上海斐讯数据通信技术有限公司 Intelligent glasses
CN105137601B (en) * 2015-10-16 2017-11-14 上海斐讯数据通信技术有限公司 An intelligent glasses
CN105607256A (en) * 2016-01-04 2016-05-25 深圳市华星光电技术有限公司 Intelligent wearable device
CN105676458A (en) * 2016-04-12 2016-06-15 王鹏 Wearable calculation device and control method thereof, and wearable equipment with wearable calculation device
CN106445164A (en) * 2016-10-18 2017-02-22 北京小米移动软件有限公司 Adjusting method and device of intelligent glasses

Also Published As

Publication number Publication date Type
CN101520690A (en) 2009-09-02 application
CN101520690B (en) 2011-07-06 grant
CN101141567B (en) 2012-12-05 grant
JP2008067218A (en) 2008-03-21 application
JP4961914B2 (en) 2012-06-27 grant

Similar Documents

Publication Publication Date Title
US20130044128A1 (en) Context adaptive user interface for augmented reality display
US20150002808A1 (en) Adaptive visual assistive device
US6307526B1 (en) Wearable camera system with viewfinder means
US8971570B1 (en) Dual LED usage for glint detection
US20150062323A1 (en) Portable eye tracking device
US20160044276A1 (en) Helmet system and methods
US20130242262A1 (en) Enhanced optical and perceptual digital eyewear
US20130208234A1 (en) Enhanced optical and perceptual digital eyewear
US9171198B1 (en) Image capture technique
US8531394B2 (en) Unitized, vision-controlled, wireless eyeglasses transceiver
US20050195277A1 (en) Image capturing apparatus
US20140049452A1 (en) Eye gaze user interface and calibration method
US20020085843A1 (en) Wearable camera system with viewfinder means
JP2005172851A (en) Image display apparatus
US20080129839A1 (en) Imaging apparatus and imaging method
JP2008099834A (en) Display device and display method
JP2000101898A (en) Electronic camera
JP2002278670A (en) Information system
WO1999049656A1 (en) Wearable camera system with viewfinder means
Vargas-Martin et al. Augmented-view for restricted visual field: multiple device implementations
JP2009049951A (en) Imaging apparatus and imaging method
US20080107361A1 (en) Imaging apparatus, display apparatus, imaging method, and display method
US20160156850A1 (en) Methods and Apparatus for Vision Enhancement
US20100066840A1 (en) Image processing device and image processing method
US20080062291A1 (en) Image pickup apparatus and image pickup method

Legal Events

Date Code Title Description
C06 Publication
C41 Transfer of the right of patent application or the patent right
C10 Request of examination as to substance
C14 Granted