Various embodiments are now described with reference to the drawings, wherein like reference numerals are used throughout the drawings to refer to like elements. In this specification, various explanations are given in order to provide an understanding of the present invention. It will be apparent, however, that such embodiments may be practiced without these specific details. In other instances, well-known structures and devices are provided in block diagram form in order to facilitate describing the embodiments.
The terms "component," "module," system, "and the like, as used herein, refer to a computer-related entity, hardware, firmware, software, combination of software and hardware, or execution of software. For example, a component may be, but is not limited to, a process executing on a processor, a processor, an object, an executing thread, a program, and / or a computer. For example, both an application running on a computing device and a computing device may be a component. One or more components may reside within a processor and / or thread of execution, one component may be localized within one computer, or it may be distributed between two or more computers. Further, such components may execute from various computer readable media having various data structures stored therein. The components may be, for example, a signal (e.g., a local system, data from one component interacting with another component in a distributed system, and / or data over a network, such as the Internet, Lt; RTI ID = 0.0 > and / or < / RTI >
The description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features presented herein.
1 is a block diagram of an image magnifying apparatus for a low vision device according to an embodiment of the present invention.
The image magnifier 1000 for a low vision device according to an embodiment of the present invention includes a display unit 100, a camera unit 200, a camera support unit 300, a swing arm 400, a swing arm support unit 500, A brightness sensor 610, a user input unit 620, a speaker 630, an external image input terminal 640, a memory 650, a controller 700, and a guide object 800.
The display unit 100 may display an image and a guide object 800. The display unit 100 displays an image captured by the camera unit, an image obtained by enlarging the captured image, a text extracted from the captured image, an image obtained by adjusting the color mode, brightness, and contrast of the captured image, An image including a marker, a content stored in an external storage device, an external image received through an external video input terminal, self-stored content, and a guide object 800 can be displayed. The marker may include a marker for displaying a specific region of the photographed image. The display unit 100 may display a color or monochrome image. The display unit 100 may display only characters read by the optical character reading module 710 of the control unit 700 in the photographed image, or may display only images from the photographed image. The above description is only an example, and the display unit 100 can display an arbitrary screen.
The display unit 100 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and a head mounted display (HMD). Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The type of the above-described display is only an example, and the display unit 100 may include any display.
The camera unit 200 can take a picture of the object. The camera unit 200 may include a camera module 210 for photographing an object and a close up lens 220 that can be opened or closed according to an operation mode of the image magnifying apparatus for a low vision device.
The camera module 210 may include a camera module capable of photographing at a resolution of 720P or more. The camera module 210 may include a camera module capable of shooting in full color. The camera module 210 can capture an object. The camera module 210 may include various types of lenses and may have various focal lengths so that the camera module 210 can be photographed at a long distance and a short distance. The camera module 210 may include an image sensor such as a CMOS or a CCD.
The close-up lens 220 can be opened or closed according to the operation mode of the image magnifying apparatus 1000 for low vision vision. The close-up lens 220 may include a lens that allows an object to be zoomed in in close-up mode. When the close-up lens 220 is closed, the close-up lens 220 may be positioned in the photographing direction of the camera module 210 of the camera unit 200. The close-up lens 220 may be opened by a sliding door or a casement. The close-up lens 220 may be closed when the image magnifying apparatus 1000 is in the close-up mode and may be opened when it is in the remote mode. The control unit 700 may notify the user to open the close-up lens 220 when the close-up lens 220 is not opened when the image magnifying apparatus 1000 for the vision device is in the long-distance mode.
The camera support part 300 supports the camera part 200 and can be coupled to the swing arm 400. [ The camera support unit 300 includes at least one rotation joint 310 and 320 for changing the angle of view of the camera unit 200 and a first angle sensor and a second angle sensor 311 for measuring the angle of the camera unit 200 , 321). The camera support unit 300 includes a first rotation joint 310 for adjusting the angle of the swing arm 400 and the camera unit 200, a second rotation joint 310 for adjusting the angle of the camera unit 200, And may include a swivel joint 320. The camera support unit 300 includes a first camera angle measurement sensor 311 for measuring an angle between the swing arm 400 and the camera unit 200 and a second angle sensor Lt; RTI ID = 0.0 > 321 < / RTI >
The first rotary joint 310 may pivot the camera unit 200 with respect to the swing arm 400 as shown in FIG. The camera unit 200 can be pivotally moved with respect to the swing arm 400 by the first rotary joint 310. Referring to FIG. 4, the pivotable angle is shown as 0 ° to 164 °, but this is merely an example, and the present invention is not limited thereto. The first angle sensor 311 may measure the angle of the pivot movement so that the control unit 700 can recognize an angle between the camera unit 200 and the swing arm 400.
The second rotary joint 320 may tilt the camera unit 200 with respect to the ground as shown in FIG. The camera unit 200 can be tilted with respect to the ground by the second rotary joint 320. Referring to FIG. 4, the tiltable angle is shown as 0 ° to 210 °, but this is merely an example, and the present invention is not limited thereto. The second angle sensor 321 may measure the angle of the tilting motion so that the controller 700 may know the angle of the current camera unit 200 with the ground. The camera unit 200 can be rotated by two or more axes by the first rotary joint 310 and the second rotary joint 320. The control unit 700 can measure the rotational motion of the camera unit 200 in two or more axes by the first and second angle sensors 311 and 321. The control unit 700 can determine the operation mode of the image magnifying apparatus 1000 for low vision aberration based on the measurement result. This will be described later.
The swing arm 400 may be coupled to the camera support portion 300 and the swing arm support portion 500. The swing arm 400 may swing about the swing arm supporter 500 as a rotation axis. The swing arm 400 can swing with the swing arm supporter 500 as a rotation axis, as shown in Fig. Referring to FIG. 4, swingable angles are shown as 0 ° to 160 °, but this is merely an example, and the present invention is not limited thereto. The swing arm 400 may be rotated by the swing arm supporter 500 on the rotation axis so that the camera unit 200 is positioned on the front surface or the rear surface of the display unit 100. When the user does not use the image magnifying apparatus 1000 for low vision vision, the swing arm 400 can be positioned at 0 DEG as shown in FIG. In this case, the camera unit 200 may be positioned at the rear of the display unit 100. Therefore, it is possible to prevent the swing arm 400 and the camera unit 200 from being damaged, and the image magnifying apparatus 1000 for a low vision device can occupy a smaller space. In addition, the swing arm 400 is rotatable about the swing arm supporter 500, so that the user can enlarge and view various objects. Further, the swing arm 400 includes an inner frame and an outer frame into which the inner frame is inserted. As the inner frame extends from the outer frame in a sliding manner, the swing arm 400 moves in the longitudinal direction of the swing arm 400 Can be extended.
The swing arm supporter 500 is located on the rear surface of the display unit 100 and supports the swing arm 400 and allows the swing arm 400 to rotate. The third angle sensor 510 can be disposed at a position where the angle of the swing arm 400 can be measured. For example, the swing arm support 500 may include a third angle sensor that measures the angle of the swing arm. The third angle sensor 510 may measure the current angle of the swing arm so that the controller 700 can know the state of the swing arm. The control unit 700 can determine the operation mode of the image magnifying apparatus 1000 for low vision aberation based on the measured values.
Further, the swing arm supporting portion 500 can move up and down in the vertical direction. The swing arm supporter 500 may be lowered when the swing arm 400 is positioned on the rear surface of the display unit 100 to prevent the camera unit 200 from being seen when viewed from the front of the display unit 100. As a result, the image magnifying apparatus 1000 for a low vision device can occupy less space and can be easily stored, and can be easily packaged in shipping or the like. The swing arm supporter 500 may be raised by an external force or the like to allow the camera unit 200 to be positioned on the front surface of the display unit 100 when the user intends to use the image magnifying apparatus 1000 for the low vision system.
The camera unit 200 can photograph an object at various positions by rotating the swing arm supporter 500 and the camera supporter 300. Accordingly, the user of the low vision image enhancing apparatus 1000 can enlarge and view the object to be viewed by moving the camera unit 200.
The first angle sensor 311, the second angle sensor 321 and the third angle sensor 510 may include a sensor for sensing a magnetic field, and may specify an angle according to the change of the magnetic field. The magnetic field of the magnet having the polarity can be sensed through the sensor and the angle can be measured according to the change of the magnetic field. At this time, the sensor may be composed of a semiconductor chip, an IC (Integrated Circuit), or the like. The above description is only an example, and the method of detecting the change of the magnetic field may be any method.
The first angle sensor 311 measures the angle between the swing arm 400 and the camera unit 200 and the second angle sensor 321 measures the angle between the camera unit 200 and the ground. (510) measures the angle of the swing arm. And may include one or more angle sensors for measuring the angles of the first angle sensor 311, the second angle sensor 321 and the third angle sensor 510 described above.
The illumination unit 600 can irradiate light to the object to be photographed by the camera unit 200. The lighting unit 600 may include various lighting devices such as an incandescent lamp, a fluorescent lamp, a halogen lamp, and an LED. The illumination unit 600 may irradiate light to the object so that the camera unit 200 can photograph the object even in a dark place. The illumination unit 600 can control the amount of light and the like by the controller 700 so that the brightness of the object is constant.
The illuminance sensor 610 can measure the brightness of an object to be photographed by the camera unit 200. The illuminance sensor 610 controls the intensity of the illumination unit 600 so that the camera unit 200 maintains a constant brightness at all times by keeping the control unit 700 at a value measured by the illuminance sensor 610 can do. For example, when the brightness of the object to be photographed by the camera unit 200 is maintained at 400 lumens, and the brightness measured by the illuminance sensor 610 is 200 lumens by external illumination, natural light, etc., The light intensity of the illumination unit 600 may be 200 lumens, and the brightness of the object may be 400 lumens.
The user input unit 620 can receive a user input for controlling the image enlarging apparatus 1000 for a low vision person from a user of the image enlarging apparatus for a low vision person. The user input unit 620 may be a part of the image magnifying apparatus 1000 for the vision-impaired person, or may include a remote controller connected wirelessly or wirelessly. The user input unit 620 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. The user input 620 may also include a camera or microphone. Also, the user input unit 620 may be implemented as a touch screen, which is a part of the display unit 100.
The user input unit 620 may also include a short range communication unit (not shown). The user input unit 620 may include a local communication unit (not shown). When the user input unit 620 includes a communication unit, the user input unit 620 may be configured to receive the user input input by the external console device. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.
For example, when the user input unit 620 performs near-field communication using infrared communication, the external console device may be an infrared remote controller. Alternatively, when the user input unit 620 performs short-range communication using the Bluetooth function, the external console device may be a mobile device including a Bluetooth module. The mobile device including the Bluetooth module may be, for example, a smart phone including a Bluetooth module.
The user input unit 620 may receive an input from the user of the image enlargement apparatus for the low vision image for setting the detailed setting information according to the operation mode of the image enlargement apparatus for the low vision image. The detailed setting information may include setting information related to at least one of a color mode, a brightness, a contrast, a magnification, and a marker for each of a far mode and a near mode. For example, in the short-distance mode, when the user wishes to view only characters in black and white, the user can make such setting through the user input unit 620. [ In the remote mode, the user can make such setting through the user input unit 620 when viewing in color. The above-described setting is only an example, and the user can perform any setting related to the operation of the image magnifying apparatus 1000 for a low vision person through the user input unit 620. [
The user input unit 620 may receive an input for selecting an image displayed on the display unit 100 from a user of the image magnifying apparatus 1000 for vision device. For example, when a user watches an image photographed from the camera unit 200 and wants to enjoy other contents or the like, an image displayed on the display unit 100 is displayed on the enlarged image through the user input unit 620 It is possible to perform an input to change to content. The above-described contents may include an external image input from the external image input terminal 640. [
The user input unit 620 may receive an input for storing the current position of the camera from the user of the image magnifying apparatus 1000 for the low vision device. For example, when the user wants to store and use the camera time used by the user , The user can perform an input through the user input unit 620 to store the measured value of the angle sensor. The controller 700 may determine to store the measured values of the first, second and third angular sensors 311, 321, 510 to the previous camera position when such user input is sensed.
The speaker 630 can output a voice signal generated by the image magnifying apparatus 1000 for a low vision person. The speaker 630 may include a module for outputting a voice signal as a sound. The speaker 630 can output the voice signal generated by the text-to-speech (TTS) conversion module 720 of the control unit 700. The image enlarging apparatus 1000 for a low vision person can read a book or the like to a user of the image enlarging apparatus 1000 for a low vision person by outputting a text-to-speech signal to the speaker 630. In addition, the speaker 630 can output a notification to open the close-up lens 220 when the operation mode of the image magnifying apparatus 1000 for low vision person is in the remote mode.
The external image input terminal 640 can receive an external image from the outside of the image magnifying apparatus 1000 for a low vision person. The external image input terminal 640 receives image signals such as a high definition multimedia interface (HDMI), a D-subminiature (D-SUB), RGB, a digital video / And may include any video input terminal that can be used. Also, it may receive an external image from an external storage medium, including a universal serial bus (USB) port capable of communicating with an external storage medium. In addition, the external image input terminal 640 may include a wireless communication module and may receive an image through wireless communication with an external device. The user of the image magnifying apparatus 1000 for the vision device can use an external image input terminal 640 as well as an enlarged image of an object.
The memory 650 may store information related to the operation of the image magnifying apparatus 1000 for low vision. The memory 650 may store an arbitrary program for driving the image magnifying apparatus 1000 for a low vision person. Any programs stored in the memory 650 may be executed by the control unit 700 of the image magnifying apparatus 1000 for low vision. The memory 650 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk.
The memory 650 may store detailed setting information according to an operation mode of the image magnifying apparatus 1000 for a low vision person. The detailed setting information may include setting information related to at least one of a color mode, a brightness, a contrast, a magnification, and a marker for each of a far mode and a near mode. In addition, the memory 650 may store contents that can be displayed in the image magnifying apparatus 1000 for low vision.
The memory 650 may store information on the position of the camera of the image magnifying apparatus 1000 for a low vision person as a previous camera position. The position of the previous camera may include at least one of the measured values for the first angle sensor 311, the second angle sensor 321 and the third angle sensor 510.
The control unit 700 may include one or more processors to control the overall operation of the image magnifying apparatus 1000 for low vision vision. The control unit 700 may include an optical character reading module 710 and a character / voice conversion module 720.
The control unit 700 can determine the operation mode of the image magnifying apparatus for low vision aberration based on the measurement value of at least one of the first angle sensor 311, the second angle sensor 321 and the third angle sensor 510 . The operation mode may include a remote mode and a near mode. The near-field mode is a mode in which the photographing direction of the camera section is directed to the ground based on the measured values of at least one of the first angle sensor 311, the second angle sensor 321 and the third angle sensor 510, And a case of facing the user of the image enlarging device for the low vision image. The remote mode is a mode in which the photographing direction of the camera unit 200 is determined based on a measured value of at least one of the first angle sensor 311, the second angle sensor 321 and the third angle sensor 510, May be included. The control unit 700 may load the detailed setting information according to the determined operation mode of the low vision image character image enlarging device to operate the image enlarging device for low vision person. The setting information for each of the short-distance mode and the long-distance mode may include information set by the user, setting information for the last operation for each mode, and default setting information.
For example, as shown in FIGS. 5A, 5B, and 5C, when the camera unit 200 faces the ground, the controller 700 controls the first and second angular sensors 311 and 321 and / 3, it can be seen that the camera unit 200 is oriented toward the ground according to the measured value of the angle sensor 510. In this case, the controller 700 may determine the operation mode of the image magnifying apparatus 1000 for low vision device to be the near mode. The control unit 700 may load the detailed settings related to the near mode to allow the image magnifying apparatus 1000 for the low vision aberration to operate. For example, when the user wants to read a book using the image magnifying apparatus 1000 for low vision, the user can place the book on the front surface of the display unit 100. [ When the user adjusts the position and angle of the camera unit 200 so that the camera unit 200 captures the book, the first angle sensor, the second angle sensor 311, and the third angle sensor 510, It is possible to make the control unit 700 know that the camera unit 200 is in a state of facing the ground so as to take a book. The control unit 700 can determine the operation mode of the image magnifying apparatus 1000 for low vision aberration as the near mode based on the measured value. The control unit 700 may load the predetermined setting for the short-distance mode so that the image magnifying apparatus 1000 for the low vision device operates. For example, the control unit 700 converts the screen output mode to black and white so that the user can easily read it, or converts the character read by the optical character reading module 710 into a voice signal by the character / voice conversion module 720 And output it to the speaker 630. The operation of the short-distance mode described above is merely an example, and the controller 700 can drive the low-vision-device-use image enlarging apparatus 1000 in a short-distance mode in an arbitrary manner.
5B, when the camera unit 200 photographs a user, the controller 700 controls the first angle sensor, the second angle sensor 311, and / or the third angle sensor 321, The sensor 510 can sense that the camera unit 200 is shooting a user. In this case, the control unit 700 may cause the display unit 100 to output a color image.
For example, as shown in FIGS. 6A, 6B, and 6C, when the camera unit 200 does not photograph the ground or the user, the control unit 700 may include a first angle sensor, a second angle sensor 311, And / or the measured value of the third angle sensor 510, the camera unit 200 is in a state in which it does not photograph the ground or the user. In this case, the controller 700 can determine the operation mode of the image magnifying apparatus 1000 for low vision a user as the remote mode. Therefore, the control unit 700 can load the detailed setting information related to the remote mode and operate the image magnifying apparatus 1000 for the low vision aberration. The photographing position of the camera unit 200 is only an example, and the controller 700 can operate in the remote mode in any case where the image magnifying apparatus 1000 for the low vision person does not photograph a close object.
The image magnifying apparatus 1000 for low vision apparatus may have a detailed setting in the case of displaying an object located in a short distance and in a case of displaying a long distance object. For example, in the case of displaying a book located in a short distance, it is possible to display it in black and white, or to perform screen processing by increasing the contrast easily to recognize the character. When displaying an object located at a distance, the color mode may be set to a color, or the object may be enlarged by utilizing the zoom function of the camera. Conventionally, when a user wants to view an object in a short distance, the image enlarging device for a low vision person has a problem that the photographing position of the camera is changed to a close range and the image mode for a near object is manually set. However, when the mode or the like must be manually set, the low vision is required to be set through the user input unit, so that it is difficult to identify the button of the user input unit as the low vision vision person, and the setting is much inconvenient. This inconvenience has made the low vision device reluctant to use the image magnifying device for low vision. However, the image magnifying apparatus 1000 for a low vision device according to the present invention can automatically set a video mode or the like only by adjusting the position of the camera toward the object to be imaged. Therefore, usability of the low vision eye can be greatly improved.
The control unit 700 may control the intensity of the illumination unit 600 so that the object to be photographed by the camera unit always maintains a constant brightness based on the value measured by the illumination sensor 610. [ For example, when the brightness of the object to be photographed by the camera unit 200 is maintained at 400 lumens, and the brightness measured by the illuminance sensor 610 is 200 lumens by external illumination, natural light, etc., The light intensity of the illumination unit 600 may be 200 lumens, and the brightness of the object may be 400 lumens.
The control unit 700 may determine to provide a notification to open the close-up lens 220 when the operation mode of the image magnifying apparatus 1000 for low vision person is the remote mode. For example, the control unit 700 outputs the notification in the form of a voice through the speaker 630, the display in the form of a screen through the display unit 100, Can be output.
The control unit 700 may include an optical character reading (OCR) module 710. The optical character reading module 710 may extract characters from the image captured by the camera unit 200 and the controller 700 may determine to provide the extracted characters in a form according to the user setting. For example, the control unit 700 may include a full text mode for outputting the extracted characters, a line mode for outputting the characters in a line, a mode for outputting one sentence at a time, mode) or the like. The string output mode may be selected by the user. For example, when the user desires to read a book through the image magnifying apparatus 1000 for low vision, the optical character reading module 710 can extract characters. The control unit 700 can display the characters on a line-by-line basis according to user selection. The user can read characters output line by line through the display unit 100. When there is an illustration or the like in the book, the control unit 700 can output the text after outputting the character string of the sentence before the illustration starts. The above description is merely an example, and the control unit 700 can decide to provide the extracted character strings in an arbitrary form that is easily read by the user of the image enlarging apparatus 1000 for low vision.
In addition, the controller 700 may include a text-to-speech (TTS) module 720. The character / voice conversion module 720 can convert characters into voice signals. The character may include the character read by the optical character reading module 710. The converted voice signal can be outputted through the speaker 630 under the control of the controller 700. [
The control unit 700 may detect the use of the user and display the content on the display unit 100 when the user does not use the image magnifying apparatus 1000 for the vision device for a predetermined time or longer. For example, when the image captured by the camera unit 200 is not changed for a long time or when the operation through the user input unit 620 is not present for a long time, . In this case, the control unit 700 may display a photograph of the grandmother stored in the memory 650 or an external storage device or the like on the display unit 100. The above-described usage detection and description of the displayed content is only an example, and the controller 700 can detect the use of the user in an arbitrary manner, and can display arbitrary contents.
In addition, when the controller 700 detects that an external video input terminal is received from the external video input terminal 640, the controller 700 may change the screen mode so that the received external video is displayed on the display unit 100. [ For example, when a user wants to view a picture of his / her grandchild through the image magnifying apparatus 1000 for a low vision person, the controller 700 connects the USB memory or the like, which stores a picture of his or her grandchildren to the external image input terminal 640, A photograph of the grandmothers stored in the USB memory or the like can be displayed on the display unit 100. [ The external storage medium, external image and screen modes described above are merely illustrative and not restrictive. The switching of the screen mode may be performed automatically by the control unit 700 when the external image is sensed or may be performed by receiving a user input from the user to select an image to be displayed on the display unit 100. [
The control unit 700 may determine to store the current angle sensor measurement value of the image magnifying apparatus 1000 for low vision aberration into the memory 650. [ A user input for storing the measured value of the angle sensor received via the user input unit 620 or a measurement of the first angle sensor 311, the second angle sensor 321 and the third angle sensor 510 It may be determined to store the measured value of the angle sensor in the memory 650 when the value is fixed for a predetermined time or more.
The control unit 700 compares the measured value of the angle sensor stored in the memory 650 with the measured value of the current angle sensor and displays the guide object 800 on the display unit 100 so that the user can adjust the position of the camera. It can decide to display. For example, the control unit 700 stores the reference X: 000 ° Y: 000 ° Z: 000 ° as a storage position in the memory 650, and when the angle measured by the angle sensor is positive, And to display the guide object 800 on the display unit 100 in order to notify the user that X: 000 ° Y: 000 ° Z: 000 ° can be returned in the counterclockwise direction in case of a negative number.
The guide object 800 may include means for displaying the measured value of the angle sensor to the user so that the user can know the current position of the camera unit 200. [ The guide object 800 may include measurements of the first, second, and third angle sensors 311, 321, 510. For example, the guide object 800 may include any means by which the measured values of each angle sensor can be displayed to the user in a manner such as numbers, shapes, and coordinate systems.
The guide object 800 may include direction indicating means for instructing the user to move the camera unit so that the user can adjust the position of the camera unit 200 to the previous camera position. For example, the guide object 800 may be an arrow indicating a direction in which the user should turn the camera unit 200. In addition, the guide object 800 may include an arbitrary figure displayed on the display unit 100 in a direction in which the user rotates the camera unit 200. The above description is merely an example, and the direction indicating means may be any image, symbol, or the like capable of displaying a direction that can be displayed on the display unit 100. [
The direction indicating means of the guide object 800 can be displayed in such a way that the transparency of the direction indicating means increases as the measured value of the angle sensor is approximated to the stored angle value. The control unit 700 compares the old position value stored in the memory 650 with the value measured by the first angle sensor 311, the second angle sensor 321 and the third angle sensor 510, The transparency of the recording direction indicating means can be increased. The transparency described above may include an increase in designation of a part of the inside or outside of the direction indicating means.
The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.
According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 700 itself.
According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 650 and can be executed by the control unit 700. [
2 is a perspective view of an image magnifying apparatus for a low vision device according to an embodiment of the present invention.
As shown in FIG. 2, the image magnifying apparatus 1000 for a low vision device according to an embodiment of the present invention may include the components shown in FIG.
The display unit 100 may be positioned on a front surface of the image magnifying apparatus 1000 for a low vision device. The swing arm supporting part 500 may be positioned on the rear surface of the display part 100. A swing arm 400 may be coupled to the swing arm supporter 500. The swing arm 400 can be rotated with the swing arm supporter 500 as a rotation axis, as described above. The swing arm 400 may be coupled to the camera support 300. The camera support part 300 supports the camera part 200 as described above and may include a rotation joint to adjust an angle of view of the camera part 200. [ The user input unit 620 is shown in a wired form, but this is merely an example, and the user input unit 620 may be implemented as a wireless remote controller. The illumination unit 600 is not shown in FIG. 2, but may be arranged to irradiate light in the photographing direction of the camera unit 200.
In addition, the image magnifying apparatus 1000 for a low vision device may further include a display support portion 665 for supporting and / or fixing the display. The display support 665 may be configured in any manner and / or shape for securing the display portion 100 to a ground or wall surface. 2 shows the display support portion 665 in a shape that supports the display portion 100 on the ground. However, the present invention is not limited thereto.
The camera supporting part 300 is capable of rotating at least two axes to adjust an angle between the camera part 200 and the ground and an angle between the camera part 200 and the swing arm 400. 2 is a state in which the swing arm 400 is rotated such that the camera unit 200 is positioned on the front surface of the display unit 100 and the image magnifying apparatus 1000 for a low vision device is mounted on the display unit 100, It may be in a state of photographing the ground surface of the front surface. The user can enlarge and photograph the object to be enlarged and viewed on the front surface of the display unit 100 through the camera unit 200. The state of the camera unit 200, the camera support unit 300, and the swing arm 400 shown in FIG. 2 is merely an example, and each position can be arbitrarily adjusted.
The image enlarging device 1000 for a low vision device according to the present invention is a device for enlarging an image for a low vision device 1000 as shown in FIG. 2 and an explanation of the external appearance of the image enhancing device 1000 for a low vision device described above. And the like.
3 is a rear view of an image magnifying apparatus for a low vision device according to an embodiment of the present invention.
3 is a state in which the camera unit 200 is located at the rear side of the display unit 100 and is invisible from the front of the display unit 100 and the state in which the image enhancing apparatus 1000 for low vision device is in an unused state Respectively. The state shown in Fig. 3 is only an example, and the present invention is not limited thereto.
A close-up lens 220 used in the near mode may be positioned on the lower surface of the camera unit 200. The camera unit 200 can be supported by the camera support unit 300 and the camera support unit 300 can be coupled with the swing arm 400. The swing arm 400 is rotatable about the swing arm supporter 500 as a rotation axis. 2 and 3, the swing arm supporter 500 can be moved up and down to move the swing arm 400 and the swing arm 400, which are positioned on the rear surface of the display unit 100, So that the display unit 100 can be prevented from being visible. The low magnification image magnifying apparatus 1000 may further include a carrying handle 660 located on the display unit 100. [ The user input unit 620 may be mounted on the rear surface of the image magnifying apparatus 1000 for low vision device so as to be easily stored. Various input / output terminals may be located on the rear surface of the image magnifying apparatus 1000 for low vision. As described above, the video input / output terminal, the USB port, and the like can be positioned on the rear side of the image magnifying apparatus 1000 for low vision.
3 and the description of the external appearance of the image enlarging apparatus 1000 for a low vision image are provided for the purpose of explanation. The image enlarging apparatus 1000 for a low vision image according to the present invention is an image enlarging apparatus for a low vision image, And the like.
4 is a top view illustrating movement of each joint of the image magnifying apparatus for a low vision device according to an embodiment of the present invention.
FIG. 4 is a top view of an image magnifying apparatus 1000 for a low vision apparatus, in order to illustrate the movement of each joint of the image enhancing apparatus 1000 for a low vision apparatus according to an embodiment of the present invention.
As shown in FIG. 4, the swing arm 400 may swing about the swing arm supporter 500 as a rotation axis. When the swing arm 400 is positioned at the rear side of the display at 0 °, the swing arm 400 can rotate up to 160 ° in the diagonal direction of the display unit 100. The above-described angle is only an example, and the present invention is not limited thereto. The swing arm 400 may be rotated by the swing arm supporter 500 on the rotation axis so that the camera unit 200 is positioned on the front surface or the rear surface of the display unit 100. When the user does not use the image magnifying apparatus 1000 for low vision vision, the swing arm 400 can be positioned at 0 DEG as shown in FIG. In this case, the camera unit 200 may be positioned at the rear of the display unit 100. Therefore, it is possible to prevent the swing arm 400 and the camera unit 200 from being damaged, and the image magnifying apparatus 1000 for a low vision device can occupy a smaller space. In addition, the swing arm 400 is rotatable about the swing arm supporter 500, so that the user can enlarge and view various objects. The rotation angle of the swing arm 400 may be measured by the third angle sensor 510. [
4, the camera support 300 may include a first rotary joint 310 to allow the camera unit 200 to pivot relative to the swing arm 400. [ The first rotating joint 310 of the camera supporting part 300 can pivot 82 ° to the left and right with respect to the case where the camera unit 200 is linear with the swing arm 400, . The above-described angle is only an example, and the present invention is not limited thereto. The first angle sensor 311 may measure the angle of the pivot movement so that the control unit 700 can recognize an angle between the camera unit 200 and the swing arm 400.
4, the camera support 300 may include a second rotary joint 320 to allow the camera unit 200 to be tilted with respect to the ground. The second rotary joint 320 of the camera supporting part 300 is rotatable by 105 degrees before and after when the camera unit 200 is photographing the ground and a total of 210 degrees is rotatable. The above-described angle is only an example, and the present invention is not limited thereto. The second angle sensor 321 may measure the angle of the tilting motion so that the control unit 700 can know whether the camera unit 200 is currently photographing the ground or other parts of the camera.
The rotation angle of the swing arm 400 measured by the third angle sensor 510, the angle of the camera unit 200 and the swing arm 400 measured by the first angle sensor 311, The controller 700 can determine whether the camera is photographing a near object or a far object by an angle between the camera 200 and the ground measured by the camera 321. [
4 and an external view of the above-described image magnifying apparatus 1000 for a low vision device are described for the sake of explanation. The image enlarging apparatus 1000 for a low vision device according to the present invention includes an image enlarging apparatus 1000 shown in FIG. 4, And the like.
5A, 5B, and 5C are diagrams illustrating an operation mode of the image magnifying apparatus for a low vision device according to an embodiment of the present invention in a short mode.
The image magnifying apparatus 1000 for a low vision device according to an embodiment of the present invention can photograph an object to be imaged in a short distance and enlarge it and display it on the display unit 100. [ The close-up mode may include a case where the photographing direction of the camera unit 200 faces the ground as shown in Figs. 5A and 5C, or the user faces the user as shown in Fig. 5B. When the low vision image enlarging apparatus 1000 operates in the close-up mode, the close-up lens 220 can be closed.
5A and 5C, when the photographing direction of the camera unit 200 is directed toward the ground, the controller 700 determines that the photographing direction of the camera unit 200 is a plane As shown in FIG. The control unit 700 can determine the operation mode of the image magnifying apparatus 1000 for the low vision device as a near mode. The control unit 700 may load the setting of the near mode based on the determined mode so that the image magnifying apparatus 1000 for the low vision apparatus operates in the near mode. For example, the near-field mode is a mode in which a user can read books or newspapers by using the image magnifying apparatus 1000 for a low vision person, As shown in FIG. The detailed description of the above-described near-field operation mode is only an example, and the present invention is not limited thereto.
5B, when the photographing direction of the camera unit 200 is directed to the user, based on the values measured by the first angle sensor 311, the second angle sensor 321, and the third angle sensor 510 The control unit 700 can know that the photographing direction of the camera unit 200 faces the user. The control unit 700 can determine the operation mode of the image magnifying apparatus 1000 for the low vision device as a near mode. The control unit 700 may load the setting of the near mode on the basis of the determined mode so that the image enlarging apparatus 1000 operates in the near mode. For example, the near mode may include an operation mode such as setting the output mode of the shot image to color so that the user can view the camera. The detailed description of the above-described near-field operation mode is only an example, and the present invention is not limited thereto.
The image enlarging apparatus 1000 for low vision apparatus may have a different detailed setting in the case of displaying an object located in a short distance and in a case of displaying a long distance object. For example, in the case of displaying a book located in a short distance, it is possible to display it in black and white, or to perform screen processing by increasing the contrast easily to recognize the character. When displaying an object located at a distance, the color mode may be set to a color, or the object may be enlarged by utilizing the zoom function of the camera. Conventionally, when a user wants to view an object in a short distance, the image enlarging device for a low vision person has a problem that the photographing position of the camera is changed to a close range and the image mode for a near object is manually set. However, when the mode or the like must be manually set, the low vision is required to be set through the user input unit, so that it is difficult to identify the button of the user input unit as the low vision vision person, and the setting is much inconvenient. This inconvenience has made the low vision device reluctant to use the image magnifying device for low vision. However, the image magnifying apparatus 1000 for a low vision device according to the present invention can automatically set a video mode or the like only by adjusting the position of the camera toward the object to be imaged. Therefore, usability of the low vision eye can be greatly improved.
6A, 6B, and 6C are diagrams illustrating an operation mode of the image enlargement apparatus for a low vision device according to an embodiment of the present invention in a long distance mode.
The image magnifying apparatus 1000 for a low vision device according to an embodiment of the present invention can photograph an object to be photographed at a long distance and enlarge it to display it on the display unit 100. [ The remote mode may include any case where the photographing direction of the camera unit 200 faces the ground or faces the user as shown in Figs. 6A, 6B and 6C. When the low vision image enlarging apparatus 1000 operates in the long distance mode, the close-up lens 220 can be opened as shown in FIGS. 6A, 6B and 6C. If it is not opened, the control unit 700 can provide a notification to open it.
6A, 6B, and 6C, when the photographing direction of the camera unit 200 faces the rear surface of the display unit 100, the controller 700 controls the camera unit 200 according to the values measured by the first angle sensor 311, It can be seen that the photographing direction of the photographing apparatus 200 is not the ground. Also, the control unit 700 can recognize that the photographing direction of the camera unit 200 is not the user due to the values measured by the second angle sensor 321 and the third angle sensor 510. In this case, the controller 700 can determine the operation mode of the image magnifying apparatus 1000 for low vision a user as the remote mode. The control unit 700 may load the setting of the remote mode based on the determined mode so that the image magnifying apparatus 1000 for the vision device can operate in the remote mode. For example, the remote mode may include an operation mode such as setting an output mode of a photographed image as a color or displaying a magnification of the photographed image so that a user can view a remote landscape. The detailed description of the above-described remote operation mode is only an example, and the present invention is not limited thereto.
The image enlarging apparatus 1000 for low vision apparatus may have a different detailed setting in the case of displaying an object located in a short distance and in a case of displaying a long distance object. For example, in the case of displaying a book located in a short distance, it is possible to display it in black and white, or to perform screen processing by increasing the contrast to easily recognize the character. When displaying an object located at a distance, the color mode may be set to a color, or the object may be enlarged by utilizing the zoom function of the camera. Conventionally, when a user wants to view an object in a short distance, the image enlarging device for a low vision person has a problem that the photographing position of the camera is changed to a close range and the image mode for a near object is manually set. However, when the mode or the like must be manually set, the low vision is required to be set through the user input unit, so that it is difficult to identify the button of the user input unit as the low vision vision person, and the setting is much inconvenient. This inconvenience has made the low vision device reluctant to use the image magnifying device for low vision. However, the image magnifying apparatus 1000 for a low vision device according to the present invention can automatically set a video mode or the like only by adjusting the position of the camera toward the object to be imaged. Therefore, usability of the low vision eye can be greatly improved.
The image magnifying apparatus 1000 for a low vision apparatus has a structure in which a user views a subject by photographing a subject through a camera, so that a change in the viewing time may occur when the position of the camera changes. In addition, since the user can change the position of the camera in order to view the object located at a long distance or a short distance, the position of the camera may not be constant, which may cause confusion in use to the user. However, according to the invention of the present application, the image magnifying apparatus 1000 for low vision vision can store the position of the camera, so that the user can search for the previous position even after using the camera at another position, thereby providing a certain point of view to the user. Therefore, convenience of the user can be improved.
FIGS. 7A, 7B, and 7C are diagrams showing a step-by-step previous position finding function of the image magnifying apparatus for a low vision device according to an embodiment of the present invention.
The image magnifying apparatus 1000 for a low vision device according to an embodiment of the present invention stores a previous position and the controller 700 can display the guide object 800 on the display unit 100 based on the previous position.
The previous position finding function may be implemented such that one or more guide objects 800 are displayed on the display unit 100 as direction indication means 811, 813, 815, 817 or joint display means 830 as shown in FIGS. 7A, As shown in FIG. 8A and 8B, the guide object 800 includes a coordinate system 850 and / or a fifth direction indicating means 830 for indicating a direction in which the camera unit 200 should be moved to the previous camera position in the coordinate system, . ≪ / RTI > The joint display means 830 of the direction indicating means may include a case where all or part of the images from the camera unit 200 to the swing arm support unit 500 are displayed together as a photograph, a drawing or a model. The first, second, third and fourth direction indicating means 811, 813, 815, 817 in the one or more guide objects 800 shown in Figures 7a, 7b and 7c are only one example, Any shape, symbol, or the like may be included in the present invention.
7A and 7B, the previous position search function may include a first direction indicator for instructing the user to move the camera unit 200 in the first direction, in the left part of the display unit 100, And a second direction designation means 813 indicating the means 811 and instructing the user to move the camera portion in the second direction to the right portion.
7C, the upper portion of the display unit 100 is divided into upper and lower portions, and a portion of the upper portion thereof is provided with a third direction indicator And a fourth direction indicating means 817 for instructing the user to move the camera section in the fourth direction in a part of the lower portion.
The previous position finding function may include a function of searching for the previous position step by step as shown in Figs. 7A, 7B and 7C. The first, second, third, and fourth direction indicating means 811, 813, 815, and 817 may include a first rotating joint 310, a second rotating joint 320, And a step 400 for instructing the user to adjust one of the arms 400. Examples of the step-by-step features may include color, contrast, presence of internal fill, type of outline, and shape of the direction indicating means. For example, the direction indicating means representing the first rotary joint 310 may be a yellow arrow, and the direction indicating means representing the second rotary joint 320 may be represented by a blue arrow or the like. The detailed description of the above-described stepwise features is only one example, and the present invention is not limited thereto.
In one embodiment, the first and second direction indicating means 811 and 813 in FIG. 7A allow the user to match the angle of the swing arm 400 with the previous camera position, The first and second direction indicating means 811 and 813 can adjust the first rotary joint 310 for adjusting the angle between the swing arm 400 and the camera unit 200. The third and fourth direction indicating means 815 and 817 in FIG. 7C adjust the second rotation joint 320 for adjusting the angle of the ground with the camera unit 200 so that the user can find the previous camera position . This is only one example, and the present invention is not limited thereto.
FIGS. 8A and 8B are diagrams showing a previous locating function through a coordinate system of an image enlarging apparatus for a low vision device according to an embodiment of the present invention. FIG.
The image magnifying apparatus 1000 for a low vision vision apparatus according to an embodiment of the present invention includes a coordinate system 850 and a fifth direction unit 819 for indicating a direction in which the camera unit should be moved to the previous coordinate system, As shown in FIG. In the coordinate system 850, one or more of the first, second, and third angle sensors 311, 321, and 510 may be displayed as shown in FIGS. 8A and 8B. The fifth direction indicating means 819 may include any symbol indicating a direction so that the user can adjust the camera unit 200 to a previous position. In addition, the coordinate system 850 may include a case of a three-dimensional coordinate system as shown in FIGS. 8A and 8B.
Alternatively, when there is no previous camera position where the camera unit 200 is located or stored in the previous camera position as shown in FIG. 8A, the fifth direction indicating unit 819 indicating the direction in which the camera unit 200 should be moved, 850 may not be selectively displayed on the display unit 100. The above description is only an example, and the present invention is not limited thereto.
If the camera unit 200 is not positioned at the previous camera position as shown in FIG. 8B, the fifth direction indicating unit 819 indicating the direction in which the camera unit 200 should be moved is displayed on the display unit 100 . The fifth direction indicating means at this time may be displayed by any symbol indicating rotation, an arrow or a movement of the coordinate system 850, and the like. It is also possible to determine whether each fifth direction instructing means 819 should adjust the first rotary joint 310, the second rotary joint 320 and the swing arm 400 when the fifth direction instructing means is a plurality of And the joint indicating means may be displayed on the display unit 100. For example, each of the joint indicating means may be configured in a color corresponding to each fifth direction indicating means. The above description is only illustrative, and the present invention is not limited thereto.
Those of ordinary skill in the art will understand that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced in the above description may include voltages, currents, electromagnetic waves, magnetic fields or particles, Particles or particles, or any combination thereof.
Those skilled in the art will appreciate that the various illustrative logical blocks, modules, processors, means, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be embodied directly in electronic hardware, (Which may be referred to herein as "software") or a combination of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the design constraints imposed on the particular application and the overall system. Those skilled in the art may implement the described functionality in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The various embodiments presented herein may be implemented as a method, apparatus, or article of manufacture using standard programming and / or engineering techniques. The term "article of manufacture" includes a computer program, carrier, or media accessible from any computer-readable device. For example, the computer-readable medium can be a magnetic storage device (e.g., a hard disk, a floppy disk, a magnetic strip, etc.), an optical disk (e.g., CD, DVD, etc.), a smart card, But are not limited to, devices (e. G., EEPROM, cards, sticks, key drives, etc.). The various storage media presented herein also include one or more devices and / or other machine-readable media for storing information. The term "machine-readable medium" includes, but is not limited to, a wireless channel and various other media capable of storing, holding, and / or transferring instruction (s) and / or data.
It will be appreciated that the particular order or hierarchy of steps in the presented processes is an example of exemplary approaches. It will be appreciated that, based on design priorities, certain orders or hierarchies of steps in processes may be rearranged within the scope of the present invention. The appended method claims provide elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.
The description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features presented herein.
