KR20190039680A - Method and system forcontrolling focusing length to enhance vision - Google Patents

Abstract

Disclosed are a method and a system for adjusting a focal length for a vision correction. The method for adjusting a focal length performed by a focal length adjustment system realized by a computer comprises the steps of: configuring a screen for receiving a selection of mode setting information for playing an object based on a vision grade; receiving a command or a control signal for changing optical characteristics of the focal length adjustment system based on the vision setting information while the object is displayed in accordance with the selected mode setting information through the configured screen; and controlling the focal length to be adjusted in accordance with the change of the optical characteristics of the focal length adjustment system based on the command or the control signal.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and system for adjusting a focal distance for correcting a visual acuity,

The following description relates to a technology for adjusting the focal distance when viewing VR (Virtual Reality) and AR (Augmented Reality) related contents.

Recently, the population of caustic myopia is increasing. Generally, I look at a computer monitor from before 10's, and I watch a monitor for a considerably long time from 20s to 30s. In addition, most of the people in the outside world can not look far away because of the dense buildings and they only look at the near area. As a result, nearsightedness is increasing among the diseases of modern people, and wearing glasses is increasing. Furthermore, with the development of educational images through TVs and smartphones, there has been a decrease in outdoor activities and an increase in the number of children watching TVs, computers, and educational images through smart phones. As a result, children have become increasingly affected by myopia, astigmatism, The incidence of eye disease is increasing.

As the media is gradually developed, various AR / VR devices that play media as well as smartphones have become popular, and myopia is expected to become more and more due to smart phones and various AR / VR devices. As such, caustic myopia can be recovered, but if left untreated, it can become chronic myopia. Korean Patent Laid-Open No. 10-2005-0090880 (published on Sep. 14, 2005) discloses a method of adjusting the inclination degree of a DMD element assembly coupled to a projection lens mounting portion through adjustment of a tightening strength of a screw, Discloses an apparatus and method for adjusting a focus balance of a projection type image display apparatus that artificially adjusts a balance degree.

The present invention provides a focal length adjusting method and system for preventing or reducing a visual acuity of a user by adjusting a focal distance even if an AR (Augmented Reality) or VR (Virtual Reality) apparatus is watched and contents are viewed.

The present invention also provides a focal length adjusting method and system for improving eyesight by moving a user's eye based on user's vision information for medical use.

A focal length adjusting method performed by a computer-implemented focal length adjusting system includes: constructing a screen for selecting mode setting information for reproducing an object based on a visual acuity rating; Receiving a command or a control signal for changing an optical characteristic of the focal length adjusting system based on the vision setting information while the object is displayed according to the mode setting information selected through the screen; And controlling the focal distance to be adjusted by changing the optical characteristic of the focal length adjusting system based on the inputted command or control signal.

Wherein the controlling step includes adjusting a focal length indicating a distance to a lens based on a virtual surface on which a user's eye is located as the optical characteristics of the lens configured in the focal length adjusting system are electrically or physically changed .

Wherein the controlling step includes changing an optical characteristic of the lens configured in the focal length adjusting system based on at least one of the vision setting information of the object, the content and the length of the object, and the usage history information of the object .

The controlling step may include controlling the focal distance to be adjusted by comparing the number of times of content reproduction for near vision correction with the number of times of content reproduction for raw correction based on the history information of the content when the object is content can do.

Wherein when the object is a content, if the image corresponding to the far focal point included in the content is included in a predetermined ratio or more than the image corresponding to the near focus, based on the content of the content, The control unit controls the focal distance adjustment so that the focal point is performed with a relatively larger specific gravity than the far focal point, and when the object is the content, the image corresponding to the near focus included in the content, based on the content, And controlling the focal length adjustment so that the far focal point is performed with a relatively larger specific gravity than the near focal point when the predetermined ratio is included in a predetermined ratio.

The controlling step may include controlling the focal distance to be adjusted based on visual acuity setting information including right and left visual information of a user registered through a user terminal displaying the object.

The controlling may include controlling the focal distance to be adjusted by shifting the position of the lens configured in the focal length adjusting system.

The controlling may include controlling the focal distance to be adjusted by changing the amount of current applied to the lens configured in the focal length adjusting system.

Wherein the controlling step includes a step of controlling the focal length of the lens in a state in which the eye of the user gazes at the lens configured in the focal length adjusting system in a front view, and tracing the relaxation and contraction of the eyeshadow muscles of the user's eye while the object is being reproduced while moving the lens back and forth along a rail.

The controlling may include estimating a visual acuity of a user staring at the lens based on an ARK (Auto Refraction Keratometer), and controlling the focal distance to be adjusted based on the estimated visual acuity.

The step of configuring the screen may include any one of a normal mode in which the focal distance is fixed to a focus set on a frame-by-frame basis in relation to the playback of the object, and a vision protection mode in which the focal distance is changed in every predetermined time period, And providing a screen for selecting the setting information.

The step of constructing the screen may include the step of providing a visual acuity class that indicates a degree of visual acuity deterioration due to the viewing of the object and is divided into a plurality of predefined levels.

Wherein the controlling step stops the operation of adjusting the focal distance when the mode setting information is in the normal mode and controls the focal distance to be adjusted every predetermined period of time when the mode setting information is the eyesight protection mode Step < / RTI >

The step of configuring the screen may include providing a calibration item classified into a category of contents for near vision correction, content for primitive correction, content for astigmatism correction when the object is content, To the screen.

Wherein the controlling step includes changing the optical characteristics of the lens configured in the focal length adjusting system based on the left and right vision information of the user registered through the user terminal and then adjusting the focal length by the focal length adjusting system And changing the optical characteristics of the configured lens again.

The step of configuring the screen may include adjusting and displaying the brightness of the object based on the illuminance of the surroundings where the object is located.

A computer program stored in a computer-readable storage medium for executing a focal length adjusting method performed by a computer-implemented focal length adjusting system includes a screen for selecting mode setting information for reproducing an object based on a visual acuity rating Comprising; Receiving a command or a control signal for changing an optical characteristic of the focal length adjusting system based on the vision setting information while the object is displayed according to the mode setting information selected through the screen; And controlling the focal distance to be adjusted by changing the optical characteristic of the focal length adjusting system based on the inputted command or control signal.

The focal length control system forms a screen for selecting mode setting information for reproducing an object on the basis of the visual acuity grade, and displays, on the basis of the sight setting information while the object is displayed according to the mode setting information selected through the screen, A display controller for receiving a command or a control signal for changing an optical characteristic of the focal length adjusting system; And a focal distance control unit for controlling the focal distance to be adjusted by changing the optical characteristic of the focal length adjusting system based on the inputted command or control signal.

According to an embodiment of the present invention, when viewing contents using an Augmented Reality (VR) or VR (Virtual Reality) device, the optical characteristics of the lens (based on the position of the physical lens or the curvature of the lens ) Can be periodically changed to adjust the focal distance, thereby preventing or reducing the visual acuity of the user.

Further, by moving the position of the lens back and forth based on the position corresponding to the visual information, or by changing the curvature of the lens electrically based on the user's visual acuity information for medical use, the user's eyesight muscle and the lens are moved, Can be improved.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention.
2 is a block diagram for explaining an internal configuration of an electronic device, a server, and a focal length adjusting system in an embodiment of the present invention.
FIG. 3 is a diagram illustrating an example of components that a processor of a focal length adjustment system according to an exemplary embodiment of the present invention may include.
4 is a flowchart illustrating an example of a method that a focal length adjusting system according to an embodiment of the present invention can perform.
5 is a view showing a screen for setting visual acuity setting information in an embodiment of the present invention.
FIG. 6 is a diagram illustrating a screen configuration for providing content selection to be played back in an embodiment of the present invention.
FIG. 7 is a view for explaining an operation of controlling focal length adjustment based on usage history information, in an embodiment of the present invention; FIG.
Fig. 8 is a view provided to explain an operation of moving a lens to control focal length adjustment, in an embodiment of the present invention. Fig.
Fig. 9 is a view showing a configuration of a lens barrel in which lenses are arranged according to an embodiment of the present invention. Fig.
10 is a flowchart illustrating an operation of adjusting the brightness of an object based on the ambient illuminance, in an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The present embodiments are directed to a technique for adjusting the focal distance by changing the optical characteristic such as the position or the curvature of a lens positioned in a lens barrel of a VR (Virtual Reality) device or an AR (Augmented Reality) . Particularly, when viewing contents related to VR (Virtual Reality) device or AR (Augmented Reality), it is possible to reduce the risk of caudal myopia due to long focusing on a close focus, Vision, astigmatism, or primacy to improve the visual acuity of the user while enjoying the fun of watching the contents.

In the present embodiments, an 'object' may represent both a physical object existing in the real world and a virtual content existing in the virtual world.

In the present embodiments, when reproducing VR or AR contents to a user terminal such as a smart phone, an application for controlling the position of the lens for protecting the user's eyesight may be installed in the user terminal, And may be installed in a focal length adjusting system.

In this embodiment, the content-related focal length adjustment information may be embedded in the content in advance, and the focal length may be adjusted while the position of the lens is moved during reproduction of the content based on the focal length adjustment information . For example, the visual acuity setting information may be input from the user, or may be set in advance in the system according to the content, length, time period, use history, etc. of the contents, and the preset visual acuity setting information may include a focal distance May correspond to control information.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 illustrates an example that includes a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, a network 170, and a focal length adjustment system 180 have. 1, the number of electronic devices and the number of servers are not limited to those shown in FIG.

The plurality of electronic devices 110, 120, 130, 140 may be a fixed terminal implemented as a computer device or a mobile terminal. Examples of the plurality of electronic devices 110, 120, 130 and 140 include a smart phone, a mobile phone, a navigation device, a computer, a notebook, a digital broadcast terminal, a PDA (Personal Digital Assistants) ), And tablet PCs. For example, the electronic device 1 110 may be connected to other electronic devices 120, 130, 140, servers 150, 160, and / or a focal length adjusting system (not shown) via the network 170 using a wireless or wired communication scheme 180).

The communication method is not limited, and may include a communication method using a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network 170 may include, as well as a short-range wireless communication between the devices. For example, the network 170 may be a personal area network (LAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN) , A network such as the Internet, and the like. The network 170 may also include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, It is not limited.

Each of the servers 150 and 160 is a computer device or a plurality of computers that communicate with a plurality of electronic devices 110, 120, 130 and 140 through a network 170 to provide commands, codes, files, Lt; / RTI > devices.

In one example, the server 160 may provide a file for installation of the application to the electronic device 1 (110) connected via the network 170. [ In this case, the electronic device 1 (110) can install an application using a file provided from the server (160). The server 150 is connected to the server 150 according to the control of the operating system (OS) and at least one program (for example, the browser or the installed application) I can receive contents. For example, when the electronic device 1 (110) transmits a service request message to the server 150 via the network 170 under the control of the application, the server 150 transmits a code corresponding to the service request message to the electronic device 1 The first electronic device 110 can provide contents to the user by displaying and displaying a screen according to the code according to the control of the application. For example, the server 160 may transmit an application for adjusting the focal length, VR or AR contents to the electronic device 110, and the electronic device 110 may display a screen according to the control of the focal length adjusting application So that the AR or VR content can be provided to the user by displaying the corresponding content.

When the electronic apparatus 1 (110) is mounted on the focal length adjusting system 180, the focal length adjusting system 180 controls the focal length of the electronic apparatus 1 (110) According to the command, the focal distance can be adjusted by changing the position of the lens back and forth. For example, the focal length adjustment application may be installed in the electronic devices 110 and 120, and may be associated with the focal length adjustment application to change the position of the lens in relation to the content displayed on the electronic devices 110 and 120 May be installed in the focal length adjusting system 180. [0031]

For example, the focal length adjustment system 180 may represent a VR or AR device, and may be manufactured as a user-wearable head mount, fixed, fixed, or spectacle type.

2 is a block diagram for explaining an internal configuration of an electronic device, a server, and a focal length adjusting system in an embodiment of the present invention. In FIG. 2, an internal configuration of the electronic device 1 (110) as an example of one electronic device and the server 150 as an example of one server will be described. Other electronic devices 120, 130, 140 or server 160 may have the same or similar internal configurations.

The electronic device 1 110 and the server 150 are connected to the memory 211, 221 and 231, the processors 212, 222 and 232, the communication modules 213, 223 and 233 and the input and output interfaces 214 and 224 and 234, . The memory 211, 221, and 231 may be a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), and a disk drive have. The memory 211, 221, and 231 may store an operating system and at least one program code (for example, a browser installed in the electronic device 1 (110) and a code for an application for adjusting the focal length) . These software components may be loaded from a computer-readable recording medium separate from the memories 211, 221, and 231. Such a computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, and a memory card. In other embodiments, the software components may be loaded into memory 211, 221, 231 via communication modules 213, 223, 233 rather than a computer readable recording medium. For example, at least one program may be a program installed by a file distribution system (for example, the server 160 described above) that distributes installation files of developers or applications, 221, 231 based on the application (s) described above.

The processors 212, 222, and 232 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and I / O operations. An instruction may be provided to the processor 212, 222, 232 by the memory 211, 221, 231 or the communication module 213, 223, 233. For example, the processor 212, 222, 232 may be configured to execute instructions received in accordance with a program code stored in a recording device, such as memory 211, 221, 231.

The communication modules 213, 223 and 233 may provide functions for the electronic device 1 110 and the server 150 to communicate with each other via the network 170 and may communicate with other electronic devices ) Or another server (e.g., server 160). For example, when the processor 212 of the electronic device 1 110 receives a request (for example, a request for a vision protection service) generated in accordance with a program code stored in a recording device such as the memory 211, To the server 150 via the network 170 in accordance with the < / RTI > Conversely, control signals, commands, contents, files, and the like provided under the control of the processor 222 of the server 150 are transmitted to the communication module 223 of the electronic device 110 via the communication module 223 and the network 170 213 to the electronic device 1 (110). For example, the control signal or command of the server 150 received through the communication module 213 may be transmitted to the processor 212 or the memory 211, May be stored as a storage medium that may further include a < RTI ID = 0.0 > When a control command for changing the position of the lens with respect to the content is generated through the focus adjustment application as the vision protection service is provided, a control signal or command for changing the position of the lens through the communication module 213 Etc. are transmitted to the communication module 233 and the control signals and commands received through the communication module 233 can be transmitted to the processor 232 or the memory 231. [ The focal length adjusting system 180 includes at least one lens (e.g., two or more lenses) for adjusting the focal distance based on a control signal or command, a rail for moving the lens, and a lens and a rail A housing for mounting the lens barrel, the lens barrel, and the electronic device, and an elastic band for fixing the focal length adjusting system 180 to the user's head in a head mount type, and the like .

The input / output interfaces 214, 224, and 234 may be means for interfacing with the input / output devices 215 and 235. For example, the input device may include a device such as a keyboard or a mouse, or a key button provided in the focal length adjusting system 180, and the output device may include a device such as a display for displaying a communication session of the application . As another example, the input / output interface 214 may be a means for interfacing with a device having integrated functions for input and output, such as a touch screen. More specifically, the processor 212 of the electronic device 1 (110) uses the data provided by the server 150 or the electronic device 2 (120) in processing commands of the computer program loaded in the memory 211 A service screen or contents can be displayed on the display through the input / output interface 214. [

Also, in other embodiments, electronic device 1 110, server 150, and focal length adjustment system 180 may include more components than the components of FIG. However, there is no need to clearly illustrate most prior art components. For example, electronic device 1 110 may be implemented to include at least a portion of input / output devices 215 described above, or may be implemented with other components such as a transceiver, Global Positioning System (GPS) module, camera, Elements. More specifically, when the electronic device 1 (110) is a smart phone, it may be an acceleration sensor, a gyro sensor, a camera, various physical buttons, buttons using a touch panel, input / output ports, It is to be understood that the present invention may be embodied in various forms without departing from the spirit or scope of the invention.

3 is a diagram illustrating an example of a component that a processor of a focal length adjusting system according to an embodiment of the present invention can include; Fig. 2 is a flow chart showing an example of a method that can be performed.

3 and 4 illustrate a case in which the focal distance is adjusted by changing the position of the lens in the focal length adjusting system, but a control command for changing the position of the lens in the electronic devices 110 and 120 A signal may be generated to adjust the focal distance. The processor 212 of the electronic device 110, 120 may then include a display controller and a focal distance controller for focal distance adjustment.

As shown in FIG. 3, the processor 232 of the focal length adjusting system 180 may include a display controller 310 and a focal length controller 320 as components. The processor 232 and components of the processor 232 may control the focal length adjusting system 180 to perform the steps (steps 410 to 420) included in the method of FIG. At this time, the components of the processor 232 and the processor 232 may be implemented to execute an instruction according to code of the operating system and code of at least one program included in the memory 231. [ The components of processor 232 may also be representations of different functions performed by processor 232 in accordance with control commands provided by the operating system or by at least one program. For example, the focal length control section 320 may be used as a functional representation of the processor 232 controlling the focal length adjustment in accordance with the control command described above.

In operation 410, the display control unit 310 may control the display of the object. Here, the object is a physical object of the real world photographed through the camera in the moving direction as the user wearing the focal length adjusting system 180 switches the head or face to the top, bottom, left, right, diagonal, , A desk, a door, a cup, etc.) or may represent a VR / AR content image downloaded or stored in a user terminal (i.e., an electronic device).

For example, when the user wears the focal length adjusting system 180 and it is confirmed that the user views the lenses corresponding to the left and right eyes of the focal length adjusting system 180 (i.e., (I.e., the content) is displayed on the screen of the user terminal when the gaze of the user terminal gazes for the predetermined period of time. In this case, when the object corresponds to the contents of the virtual world, the display control unit 310 recognizes the rotation through the gyro sensor and the acceleration sensor, and selects the content to be played back May be displayed on the screen.

In step 420, the focal length control unit 320 changes the optical characteristics of at least one lens based on the preset or registered vision setting information while the selected object (i.e., the content) or the object photographed through the camera is displayed , The focal distance indicating the distance from the virtual surface to the lens can be controlled based on the virtual plane on which the user's eyes are located.

At this time, the focal length control unit 320 can check the mode set in the mode setting information and control the focal distance adjustment. For example, the mode setting information can be selected from the user through the user terminal (i.e., the electronic device), and if the mode setting information is in the normal mode, the operation of adjusting the focal distance can be stopped. Then, the lens may not automatically move to adjust the focal distance while the corresponding content is being played back, such as a general VR / AR device. When the mode setting information is confirmed as the vision protection mode, the focal length control unit 320 can control the focal length adjustment.

At this time, the focal length control unit 320 may physically control the focal distance by moving the position of the lens in the lens barrel, or may control the focal distance by changing the current applied to the lens electrically.

For example, when the position of the lens is physically adjusted by moving the lens, the focal length control unit 320 determines that the lens positioned inside the lens barrel is positioned on the virtual plane on which the user's eye wearing the focal length adjusting system 180 is located It is possible to generate a control signal or command to move back and forth along a rail. Then, based on the control signal or command, the lens can be adjusted to change the focal distance while moving along the rail.

As another example, when the focal distance is electrically adjusted without moving the position of the lens, the amount of current applied to each of the left and right eyes may be adjusted to change the curvature of the corresponding lens so that the focal distance can be controlled. For example, a lens used for adjusting a focal length (i.e., a variable focus lens) is made of a material such as a polymer instead of glass, and a material used for wrapping a liquid having a refractive index different from that of a polymer is two chambers , It is possible to control the focal distance to be adjusted by changing the radius of the lens, that is, by changing the curvature of the lens by adjusting the pressure applied between the two chambers. For example, the focal length control unit 320 can control the pressure applied to the lens by adjusting the amount of current applied to the lens by using a coil and a piezo motor. And, as the pressure applied to the lens is adjusted, the radius of curvature of the lens may eventually be changed and changed to the focal distance. That is, the focal length control unit 320 can control the focal length adjustment by changing the radius of curvature by controlling the shrinkage and expansion of the polymer material by adjusting the amount of current.

At this time, the focal distance can be adjusted by changing the position of the lens or the amount of current applied to the lens based on the vision setting information. The vision setting information includes content related information including content content and content length, Information on usage history, information on the user's vision, and the like. The visual acuity setting information may be set automatically by the system or may be set by the user.

In step 421, the focal length control unit 320 adjusts the position of the lens so that the focal length is relatively long from a point where the lens is located (e.g., a position corresponding to the initial setting position or the user's visual acuity) The focal distance can be controlled by changing the amount of current applied to the lens.

For example, the focal length control unit 320 generates a command or signal for controlling the lens to move from a position corresponding to a predetermined distance from the position (i.e., a position away from the user's eyes) can do. That is, when the user is nearsighted, it is possible to control the lens to move so that the focal length is relatively long in order to correct the myopia by causing the image to be behind. Then, even if the user does not look at an object such as a tree of a long distance, a user wearing the focal length adjusting system can relax the user's gymnastics as when viewing a specific object at a distance from the actual place. In addition, the focal length control unit 320 calculates a difference value between the curvature corresponding to the current focal length and the curvature corresponding to the focal length to be adjusted, and applies a current amount corresponding to the calculated difference value to the lens, May be controlled to be relatively long or short.

In step 422, the focal length control unit 320 adjusts the position of the lens so that the focal length is relatively short from a point at which the lens is positioned (e.g., a position corresponding to the initial setting position or the user's visual acuity) The focal distance can be controlled by changing the amount of current applied to the lens.

For example, the focal length control unit 320 may control the lens to move to a position corresponding to the predetermined distance from the position (i.e., a position closer to the user's eye) or to change the amount of current applied to the lens, The focal distance can be controlled to be adjusted. That is, when the user is a primitive lens, it is possible to control the movement of the lens or change the amount of current so that the image is formed in front and the focal length is relatively shortened in order to correct the original. Then, even if the user does not look at an object such as a booklet at a close distance, a user wearing the focal length adjusting system can actually shrink the user's obtuse-like muscle such that the user actually focuses on an object at a close distance.

Hereinafter, the case where the focal length adjustment is controlled by mechanically moving the position of the lens based on the vision setting information, the contents, the length, and the use history information will be described with reference to FIGS. 5 to 7, And it is also apparent that the focal distance adjustment is controlled by adjusting the amount of current based on at least one of the visual acuity setting information, content contents, length, and use history information, in addition to the case where the position of the lens is mechanically moved.

5 is a view showing a screen for setting visual acuity setting information in an embodiment of the present invention.

5, a screen for setting sight setting information may be displayed through the display of the user terminal mounted on the focal length adjusting system 180. At this time, the visual acuity setting information may be set in a state where the user terminal is not mounted on the focal length adjusting system 180, or may be set as a login account registered in the server providing the application, Or the like, and the sight setting information may be set. If the sight setting information is set as the login account, the focal distance adjustment application compares the sight setting information stored in the terminal with the set date of the sight setting information stored in the login account with the server according to the predetermined time period, The vision setting information can be periodically updated.

Whether to set the mode setting information to the normal mode or the eyesight protection mode through the screen 500 can be selected from the user. The normal mode is not operated in the vision protection mode for adjusting the focal distance but is operated such that the focal distance is fixed to a predetermined focus for each frame of the content in the same manner as the existing VR / AR device. In the vision protection mode, So that the focal distance is continuously changed.

When the mode setting information is selected as the vision protection mode, it is possible to select whether or not to set the visual acuity. For example, when the check box 501 corresponding to the visual acuity setting is selected, an item for receiving the left eye and right eye visual acuity of the user on the screen 500 can be activated. That is, the user can manually input the left eye and right eye vision of the user. At this time, when the check box 501 is not selected, the focal distance adjustment system 180 automatically estimates the user's left eye and right eye visual acuity based on ARK (Auto Refraction Keratometer), and based on the estimated visual acuity, The distance adjustment may be controlled.

In addition, it is possible to set the operation execution time information for performing the focal distance adjustment from the user. For example, the operation execution time information may be selected from 10 minutes, 20 minutes, 30 minutes until the end of the contents. At this time, when the operation execution time information is not set, the content end time may be set in advance as an initial value. That is, the focal length adjustment control can be performed automatically every predetermined period of time until the content ends.

As the display information 502 corresponding to the setting is selected, the vision setting information can be set by the user, and the focal length control unit 320 can perform control for adjusting the focal length based on the set vision setting information . For example, when the user's vision information is manually input, the focal length control unit 320 may generate a control command or a signal for moving the lens to a position corresponding to the inputted vision information. When the lens is moved and the movement completion signal or command is received, the focal length control unit 320 may generate a control command or signal for moving the lens so that the focal length is relatively long or short on the basis of the moved position have. At this time, the focal length adjustment can be controlled periodically (e.g., at intervals of 10 seconds, 20 seconds, etc.) according to the predetermined time period. As such, nearsightedness or primality can be mitigated as the left and right eyes of the user viewing the display (i.e., the display of the user terminal) on which the lens is moved and the content is reproduced are automatically trained to focus at a distance or near distance.

In this way, the user may set the vision setting information, but the focal length adjustment may be controlled based on the preset vision setting information in the system without user setting.

For example, the focal length control unit 320 may control the focal length adjustment based on the content and length (i.e., playback time) of the content that the user wants to reproduce. The operation of controlling the focal length adjustment based on the contents and the length of the contents will be described later with reference to Fig.

FIG. 6 is a diagram illustrating a screen configuration for providing content selection to be played back in an embodiment of the present invention.

6 illustrates an example of displaying a plurality of contents on the screen 610. This corresponds to an embodiment and can be classified into categories such as contents for near vision correction, contents for original correction, and contents for correction of astigmatism, When a desired calibration item is selected from the user, contents (e.g., contents for near vision correction) belonging to the corresponding category among a plurality of contents may be selected and displayed on the screen 610.

6, a screen for selecting contents to be reproduced through a user terminal (i.e., an electronic device) mounted on the focal length adjusting system 180 may be displayed on the screen 610 of the user terminal through an application have.

Then, the screen 610 may display information such as rank fluctuation information, download count, and likes corresponding to each of a plurality of contents (for example, VR-related contents and AR-related contents, etc.). At this time, if the specific content 601 to be reproduced is selected from the plurality of contents, detailed information corresponding to the selected content 601 can be displayed on the screen 620.

For example, when the content 601 is produced, detailed information such as a set rating (i.e., a rating), a registration date, a playback time, a category (e.g., an action movie, a romance drama, a music, And may be displayed on the screen 620 as information. Here, the visual acuity grade is information indicating the degree of visual acuity deterioration due to viewing of the contents, and may be set to a plurality of predetermined levels. Related information corresponding to the degree of visual deterioration of the corresponding content among a plurality of classes from the safety corresponding to the lowest level of visual loss to the risk corresponding to the most severe level of visual loss is displayed on the screen 620 . In one example, the visual acuity rating may be predetermined based on the time of focusing on a predetermined distance over a predetermined period of time, the number of times of focusing. For example, the longer the time, the greater the number of times, the more likely it is that the viewing rating may be determined to be at a higher risk level than when it is less.

At this time, if the playback time of the selected content is less than the predetermined reference playback time such as 1 minute, 5 minutes, or the like, the focal length adjustment function may not be supported. Accordingly, a phrase such as 'the content is not supported in the focal length adjustment function' is displayed in the predetermined area (for example, the lower end area of the screen or the image right area of the content) on the screen 620 of the user terminal .

If the image corresponding to the far focus is included in the content more than the predetermined ratio based on the content of the selected content (i.e., the attribute information), the focal length control unit 320 determines that the ratio It is possible to control the focal length adjustment so that the near focus is performed with a relatively larger specific gravity than the far focus. Likewise, when the image corresponding to the near focus is included in the content at a predetermined ratio or more than the image corresponding to the far focus based on the content of the selected content (i.e., the attribute information), the focal distance control unit 320 controls the focal distance It is possible to control the focal distance adjustment so that it is performed with a relatively larger specific gravity than the near focus.

At this time, if there is sight information input from the user and the sight information corresponds to myopia such as S-1.07D, the focal distance control unit 320 determines that the image ratio corresponding to the distant focus is high , It is possible to perform the far focus control that changes the position of the lens so that the focal length becomes longer so that the near vision of the user is improved. Then, while the content is being reproduced, the user's gymnastics are relaxed periodically, and the gymnastics are formed behind the images, so that an effect of looking at the distance is generated, and myopia can be improved. Similarly, if the user's sight information corresponds to a source such as S + 1.36D, the focal length control unit 320 may control the focal distance so that the user's originality is improved even if the image ratio corresponding to the near- It is possible to perform near focus control that changes the position of the lens so that the distance becomes short. Then, while the content is being reproduced, the user's gymnastics are periodically contracted, and the image is formed in front of the gymnastics so that an effect of looking at the proximity distance occurs, and the originality can be improved.

FIG. 7 is a view for explaining an operation of controlling focal length adjustment based on usage history information, in an embodiment of the present invention; FIG.

The identifier information of the content in which the content to be reproduced is selected and reproduced and reproduced is matched with the identifier information of the user and can be stored and maintained. For example, a user's login account (ID), a nickname, or a hospital registration number may be used as the user's identifier information. If the VR content or the AR content is selected (e.g., when the same content or other content as the previously reproduced content is selected after a predetermined time has elapsed), the focal distance control unit 320 sets the use history information The focal distance can be adjusted by comparing the number of times of content reproduction for near vision correction with the number of times of content reproduction for raw correction.

For example, the content to be reproduced is content for nearsightedness correction, and as the content is selected, the focal length control unit 320 can confirm the use history information. At this time, when the difference between the number of times of viewing of the two contents and the number of times of reproduction of the near-corrected content is compared with the number of times of reproduction of the original corrected content based on the use history information, If the content is watched more than 10 times more than the original corrected content, the display control unit 310 displays' the near-far corrected content is more than 10 times more than the original corrected content. Quot; Do you want to continue watching myopia correction contents? 'May be displayed on the screen 700. When the display information 701 corresponding to 'Yes' is selected, the display control unit 310 controls the selected near-by correction content to be displayed. The focal length control unit 320 controls the focal length of the current lens, It is possible to control the position of the lens so that the focal length is relatively long from the point where the lens is moved. If the display information 701 corresponding to 'No' is selected, the display control unit 310 can display contents belonging to the original calibration on the screen 710 as shown on the screen 710. And, it can display the selected content among the displayed contents. Then, the focal length control unit 320 can control the position of the lens so that the focal length is relatively short from the point where the current lens is located so that the acuity muscle contracts.

That is, in the case of myopic correction for medical use, it is necessary to continuously reproduce the near vision correction contents for the near vision correction of the user even if the near vision correction contents are regenerated more than the reference number of times. Accordingly, when the display information 701 corresponding to 'Yes' is selected, the myopic correction contents are continuously displayed, and the focal length is increased for the near vision correction, that is, The adjustment can be controlled.

On the other hand, when the user of the normal vision, rather than the medical purpose, wants to prevent visual deterioration while reproducing the VR / AR content, the difference value between the number of times of reproduction of the near- , When the near-far correction contents are reproduced in a large amount, it is possible to preferentially display the original correction contents when displaying a plurality of contents in order to select the contents to be reproduced. That is, rather than confirming the usage history information after the content to be reproduced is selected, the usage history information may be confirmed on the screen displaying a plurality of contents in order to select the content to be reproduced first. If the number of times of reproduction of the near-by corrected content is more than the number of times of reproduction of the original corrected content by a predetermined number of times, the contents are automatically classified on the screen for content selection and the contents for the original correction can be displayed .

As described above, when the user reproduces content such as AR / VR, the user can check the user's history information at the time of selecting the content to be played back. In addition, The distance can be adjusted. For example, while the selected content is being reproduced, the focal length control unit 320 may compare the number of times of focal length adjustment for near vision correction with the number of times of focal distance adjustment for the raw correction up to the present time every predetermined period of time. Here, whenever the focal length is adjusted while the content is being reproduced, the number of times of adjustment of the focal length for near vision or the focal distance can be counted. Then, the focal length control unit 320 controls the focal distance adjustment to increase the number of correction times corresponding to the smaller number of adjustment times, when the difference between the number of focal length adjustment times for near vision correction and the number of times of focal distance adjustment for raw correction is equal to or greater than the reference value . For example, when the number of focal length adjustment times for the near vision correction is smaller than the original correction, the focal length control unit 320 may control the lens position to be shifted so that focal length adjustment for near vision correction is performed until the next time period.

Fig. 8 is a view provided to explain an operation of moving a lens to control focal length adjustment, in an embodiment of the present invention. Fig.

8, in a state in which the eyes of the user wearing the focal length adjusting system 180 (i.e., the left and right eyes), i.e., the eyes gazing at the lenses 812 and 822 in front, The focal lengths 813 and 823 can be adjusted while the lenses 812 and 822 corresponding to the left and right sides move along the rail.

For example, in the case of nearsightedness correction, since the amygdala relaxes when looking at a long distance, it moves from the current point where the lenses 812 and 822 are located to the display 830 of the user terminal so that the amygdala relaxes, 823 may be adjusted to be relatively long. In the case of primitive calibration, the farther from the display 830 of the user terminal from the current point where the lenses 812, 822 are located so that the acupressure shrinks as the eye muscle contracts when focused and viewed at close range (i.e., Eye) so that the focal lengths 813 and 823 can be adjusted to be relatively short.

In this manner, the lenses 812 and 822 are moved back and forth along the rails to continuously adjust the focal length so that the focal length becomes longer or shorter based on the virtual plane corresponding to the user's eyeball (i.e., the lens or the somatic body) By trained to continue the relaxation and contraction of the somatic muscles, it is possible to prevent or reduce visual acuity, and ultimately improve visual acuity.

Fig. 9 is a view showing a configuration of a lens barrel in which lenses are arranged according to an embodiment of the present invention. Fig.

Although two lenses are shown in each of the left and right eyes in FIG. 9, this corresponds to the embodiment, and three or more lenses or one lens may be used for adjusting the focal length. For example, FIG. 9 shows an example in which a zoom lens is located at a position where a user's eye is located, and a variable focus lens is located separately from the zoom lens, and the focal length can be controlled while the variable focus lens moves inside the lens barrel .

9, a display (i.e., a user terminal 910) may be mounted on the focal length adjusting system 180 to reproduce the content at a predetermined distance from the point at which the user's eyes are located . For example, a housing may be formed on one side of the lens barrel 920, 930 in such a manner that the user terminal is detachably attached to the housing in a slide-type or cover-opening manner. A cover cushion on which the user's eyes of the user wearing the focal length adjusting system 180 are positioned may be located on the other side of the lens barrel 920, 930. Each of the lens barrels 920 and 930 corresponding to both sides of the user can be provided with rails for moving the lenses 901 and 902 on both sides and by moving the lenses 901 and 902 along the rails, Can be adjusted. At this time, a high compression lens can be used to treat ophthalmologic diseases in which the degree of visual acuity is refined and high myopia, astigmatism, strabismus, or two or more are combined. The higher the compression ratio of the lens and the larger the size of the lens, , 930 may be longer.

As described above, the focal length adjustment can be controlled based on the contents of the contents, the length, the use history information, and the predetermined time period, and the brightness and the illuminance of the object may be controlled to protect the sight of the user.

10 is a flowchart illustrating an operation of adjusting the brightness of an object based on the ambient illuminance, in an embodiment of the present invention.

In step 1010, the illuminance of the surrounding environment in which an object (for example, a physical object located in the real world) is located can be detected through the user terminal or the illumination sensor provided in the focal length adjusting system.

In step 1020, the display controller 310 may control the brightness of the object or the content image to be displayed based on the illuminance of the surroundings of the object.

For example, a plurality of levels of roughness may be predefined, and a brightness value corresponding to each roughness level may be predefined. Then, the display controller 310 may determine which level of the plurality of predefined levels corresponds to the detected ambient illuminance. When the corresponding level is determined, the display control unit 310 may adjust the brightness of the object or the content image to be reproduced with a brightness value corresponding to the determined level. The object or the content can be controlled to be displayed with the adjusted brightness.

For example, at night or when the ambient light sensed by the weather is low, the brightness of the object may be adjusted to the brightness value for vision protection in the illumination. Even if you watch TV with very bright brightness in a dark environment, eye fatigue may increase, resulting in deterioration of visual acuity. Even if the content is reproduced at too low a brightness, blurred image may cause deterioration of visual acuity. Accordingly, the display control unit 310 displays at least one of the object (the object in the real world) and the content (the object in the virtual world) on the basis of the brightness value for protecting the eyesight by the predefined illuminance level based on the ophthalmic clinical information or the like So that the display can be controlled. For example, the object and virtual contents may be displayed in a combined form, and the display controller 310 may control the brightness and brightness of the object to be displayed and displayed.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit, a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (18)

A focal length adjusting method performed by a computer-implemented focal length adjusting system,
Constructing a screen for selecting mode setting information for reproducing an object based on a visual acuity grade;
Receiving a command or a control signal for changing an optical characteristic of the focal length adjusting system based on the vision setting information while the object is displayed according to the mode setting information selected through the screen; And
Controlling the focal length to be adjusted by changing the optical characteristic of the focal length adjusting system based on the inputted command or control signal
And adjusting the focal length. The method according to claim 1,
Wherein the controlling comprises:
Adjusting the focal distance indicating the distance to the lens based on the virtual surface on which the user's eye is located as the optical characteristics of the lens configured in the focal length adjusting system are electrically or physically changed;
And adjusting the focal length. 3. The method of claim 2,
Wherein the controlling comprises:
Changing the optical characteristic of the lens configured in the focal length adjusting system based on at least one of the vision setting information of the object, the content and length of the object, and the use history information of the object
And adjusting the focal length. The method of claim 3,
Wherein the controlling comprises:
Controlling the focal distance to be adjusted by comparing the number of times of content reproduction for near vision correction with the number of times of content reproduction for primitive correction based on the usage history information of the content when the object is content
And adjusting the focal length. The method of claim 3,
Wherein the controlling comprises:
Wherein when the object corresponding to the far focus included in the content is included in a predetermined ratio or more than the image corresponding to the near focus based on the content of the content, Controlling the focal length adjustment to be performed with a relatively large specific gravity,
Wherein if the object corresponding to the near focus included in the content is included in a predetermined ratio or more than the image corresponding to the far focus on the basis of the content of the content, Controlling the focal length adjustment to be performed with a relatively large specific gravity
And adjusting the focal length. The method of claim 3,
Wherein the controlling comprises:
Controlling the focal distance to be adjusted based on visual acuity setting information including right and left visual information of a user registered through a user terminal displaying the object
And adjusting the focal length. 3. The method of claim 2,
Wherein the controlling comprises:
Controlling the focal length to be adjusted by shifting the position of the lens configured in the focal length adjusting system
And adjusting the focal length. 3. The method of claim 2,
Wherein the controlling comprises:
Controlling the focal distance to be adjusted by changing the amount of current applied to the lens configured in the focal length adjusting system
And adjusting the focal length. 3. The method of claim 2,
Wherein the controlling comprises:
The lens of the user is moved along a rail disposed in the lens barrel in which the lens is located with respect to a virtual plane on which the user's eye is located, Tracing the relaxation and contraction movement of the eye's roots of the user's eye while the object is being reproduced while moving the lens back and forth
And adjusting the focal length. 3. The method of claim 2,
Wherein the controlling comprises:
Estimating a visual acuity of a user staring at the lens based on an ARK (Auto Refraction Keratometer), and controlling the focal distance to be adjusted based on the estimated visual acuity
And adjusting the focal length. The method according to claim 1,
The step of configuring the screen may include:
A screen for selecting the mode setting information in any one of a normal mode in which the focal distance is fixed with a focus set for each frame in association with the reproduction of the object and a vision protection mode in which the focal distance is changed in every predetermined time period, Steps to Offer
And adjusting the focal length. The method according to claim 1,
The step of configuring the screen may include:
A step of providing a visual acuity class indicating a degree of visual acuity deterioration due to the viewing of the object and being divided into a plurality of predefined levels
And adjusting the focal length. 3. The method of claim 2,
Wherein the controlling comprises:
Stopping the operation of adjusting the focal distance if the mode setting information is in the normal mode and controlling the focal distance to be adjusted every predetermined period of time if the mode setting information is the eyesight protection mode
And adjusting the focal length. The method according to claim 1,
The step of configuring the screen may include:
Providing the contents to a correction item classified as a category of contents for near vision correction, content for primitive correction, content for astigmatism correction, and providing a correction item selected from the user to the screen when the object is content
And adjusting the focal length. 3. The method of claim 2,
Wherein the controlling comprises:
After changing the optical characteristics of the lens configured in the focal length adjusting system based on the left and right vision information of the user registered through the user terminal, the optical characteristics of the lens configured by the focal length adjusting system to adjust the focal distance Steps to change again
And adjusting the focal length. The method according to claim 1,
The step of configuring the screen may include:
Adjusting and displaying the brightness of the object based on the illuminance of the surroundings where the object is located
And adjusting the focal length. A computer program stored in a computer-readable storage medium for executing a focal length adjusting method performed by a computer-implemented focal length adjusting system,
Constructing a screen for selecting mode setting information for reproducing an object based on a visual acuity grade;
Receiving a command or a control signal for changing an optical characteristic of the focal length adjusting system based on the vision setting information while the object is displayed according to the mode setting information selected through the screen; And
Controlling the focal length to be adjusted by changing the optical characteristic of the focal length adjusting system based on the inputted command or control signal
And a computer program product stored in the computer readable storage medium. In a focal length control system,
And a display unit configured to configure a screen for selecting mode setting information for reproducing an object based on the visual acuity rating, A display control unit receiving a command or a control signal for changing a characteristic; And
And controls the focal distance to be adjusted by changing the optical characteristic of the focal length adjusting system based on the inputted command or control signal,
And a focal length adjusting system.

Images