KR102138523B1 - Method and system for remote-controlling pictur-taking, device and method for managing the same - Google Patents

Abstract

The present invention is to provide a remote photographing method, a system, a terminal, and a terminal control method capable of accurately monitoring and photographing a patient's affected area. Displaying a screen of a second terminal in real time; Providing a user interface for controlling the camera on a screen of the second terminal; And controlling the camera according to an input through the user interface.

Description

Remote shooting method and system for video treatment, and terminal and terminal control method therefor {METHOD AND SYSTEM FOR REMOTE-CONTROLLING PICTUR-TAKING, DEVICE AND METHOD FOR MANAGING THE SAME}

The present invention relates to remote photographing, and more particularly, to a remote photographing method, a system, a terminal, and a terminal control method for image treatment.

In general, even a healthy person visits the hospital several times a year to receive treatment and receive prescriptions depending on the disease or condition. Because of various inconveniences, patients want to visit the nearest hospital to receive treatment, but this is often not easy. You may not be able to find a nearby hospital, or there may be no hospital nearby. In particular, it is difficult for patients on islands or remote areas to visit hospitals. When a patient occurs on an island or in a remote place like this, it may lead to a serious illness or an unemployment death due to the inability to take prompt action.

In addition, recent office workers do not have enough time to visit a hospital and receive treatment due to their busy work. As a result, they often postpone a visit to the hospital, resulting in worsening symptoms.

In such a situation where it is difficult for patients to visit a hospital, users are increasingly inquiring about symptoms through the Internet and self-diagnosing them. However, this method can lead to a more dangerous situation because a medical professional has not been treated. Therefore, there is a need for a way to receive medical treatment remotely from busy modern people.

The present invention is proposed in order to meet the above-described necessity, and an object of the present invention is to provide a remote imaging method, a system, a terminal, and a terminal control method capable of accurately monitoring and photographing a patient's affected area.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those having ordinary knowledge in the technical field to which the present invention belongs from the following description. Will be able to.

In order to achieve the above object, a remote photographing method according to the present invention includes the steps of displaying an image captured by a camera of a first terminal on a screen of a second terminal in real time; Providing a user interface for controlling the camera on a screen of the second terminal; And controlling the camera according to an input through the user interface.

Here, the user interface includes at least one of buttons, icons, and menus for controlling the operation of the camera or changing settings.

In the step of controlling the camera according to an input through the user interface, the camera is controlled to take the captured image according to the input, or the zoom and illumination of the camera are controlled according to the input.

In addition, in the step of controlling the camera according to the input through the user interface, a guide for guiding the moving direction and the rotation direction of the camera according to the input, and the position of the photographing object in the image captured by the camera At least one of a guideline for determining the size of a photographing object or a ruler and a grid for determining the size of a photographing object is provided on the screen of the first terminal.

In order to achieve the above object, a remote photographing system according to the present invention includes: a first terminal including at least one camera and transmitting an image captured by the camera; And a second terminal that displays an image captured by the camera in real time, provides a user interface for controlling the camera on a screen, and controls the camera according to an input through the user interface.

Here, the first terminal includes: a front camera and a rear camera; A sensor that detects a tilt; And a control unit that selects one of the front and rear cameras according to the sensed inclination, and controls to capture an image through the selected camera.

Then, the controller determines whether to switch to an unselected camera according to the color of the image captured through the selected camera.

In order to achieve the above object, a method for controlling a terminal according to the present invention includes the steps of detecting a tilt of the terminal; Selecting one of the front and rear cameras according to the sensed inclination; Capturing an image through the selected camera.

The effects of the remote photographing method, system, terminal, and terminal control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, since the doctor directly controls the user's terminal using his or her own terminal, a desired image can be obtained, thereby enabling an accurate diagnosis.

Systematic and accurate medical treatment is possible because photos/videos and medical history of the user's treatment area are stored in the server or the terminal of the clinician.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description. will be.

1 is a diagram showing a remote photographing system according to a first embodiment of the present invention.
2 is a diagram illustrating an example of the first terminal of FIG. 1.
3 is a diagram illustrating an example of the second terminal of FIG. 1.
FIG. 4 is a diagram for explaining the operation of the remote photographing system of FIG. 1.
5 is a diagram illustrating a method of capturing a treatment site using the remote imaging system of FIG. 1.
6 is a view showing a method of photographing a treatment site using the remote imaging system of FIG. 1.
7 is a diagram illustrating an example of a guideline for guiding the location of a treatment site in an image.
8 is a diagram for describing a function of an electronic board of a first terminal.
9 is a diagram for describing a multi-capturing function of a second terminal.
10 is a diagram showing another example of a first terminal.
11 is a diagram showing a remote imaging system for image treatment according to a second embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

While the present invention allows various modifications and variations, specific embodiments thereof are illustrated and shown in the drawings, and will be described in detail below. However, it is not intended to limit the present invention to the particular form disclosed, but rather the present invention includes all modifications, equivalents and substitutions consistent with the spirit of the present invention as defined by the claims. Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the drawings.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the present specification and claims should not be construed as limited to their usual or dictionary meanings, and the inventors appropriately explain the concept of terms in order to describe their own invention in the best way. Based on the principle that it can be defined, it should be interpreted as a meaning and concept consistent with the technical idea of the present invention. Accordingly, the embodiments described in the present specification and the configurations shown in the drawings are only the most preferred embodiments of the present invention, and do not represent all the technical spirit of the present invention, and thus various alternatives that can be substituted for them at the time of application It should be understood that there may be equivalents and variations.

First Example

Hereinafter, a remote imaging system for image treatment according to a first embodiment of the present invention will be described with reference to FIG. 1.

As shown in FIG. 1, the remote photographing system of the first embodiment includes a first terminal 10 and a second terminal 30 connected to each other through a communication network 20.

The first terminal 10 is a terminal of a user who wants to receive medical treatment, and is preferably configured in various forms such as a mobile terminal capable of wireless communication, for example, a smartphone, a laptop, or a tablet, but is not limited thereto. It can also be configured as a terminal capable of this. As a main function, the first terminal 10 transmits an image of the body part to be treated to the second terminal 30 in real time and photographs the part to be treated under the control of the second terminal 30. .

2 shows an example of the first terminal 10. As shown in FIG. 2, the first terminal 10 includes at least one camera 11, a lighting unit 12, a memory 13, a control unit 14, a communication unit 15, a speaker 16, and a display. 17).

The camera 11 is configured to take a video image as well as a photograph, and the lighting unit 12 outputs a flash or lighting to a photographing object when capturing or capturing a photograph or image.

The memory 13 includes photographs and images to be taken, setting information of the camera 11, and prescription information transmitted from the second terminal 30 (eg, a list of prescribed drugs, a medication period, medication The number of times, medication time, medication method, precautions, etc.), and history information about burn treatment are stored.

The communication unit 15 is connected to the second terminal 30 through a communication network 20 such as 3G or LTE for long-distance wireless communication. Of course, the communication unit 15 may be connected to the second terminal 30 through a wired communication network. In particular, the communication unit 15 transmits the image captured by the camera 11 to the second terminal 30 in real time, and transmits signals and information for controlling the camera 11 from the second terminal 30. Receive.

The speaker 16 is for outputting sound/sound as in a general mobile terminal, and in particular, outputs a guide sound according to the request of the second terminal 30. In addition, the display 17 outputs an object captured by the camera 11 on the screen, such as a viewfinder, and also outputs a photograph or image to be taken on the screen. In addition, the display 17 displays a guide for guiding the moving direction and the rotation direction of the camera 11 on the screen according to the request of the second terminal 30.

The control unit 14 controls all components included in the first terminal 10. For example, the controller 14 controls the operation of the camera 11 or changes the settings of the camera 11 according to the request of the second terminal 30. In addition, the control unit 14 controls the lighting unit 12 to automatically provide illumination when image treatment starts.

The second terminal 30 is a terminal of a medical staff for treatment and consultation, and may perform wireless or wired communication, and may be configured in various forms such as a smartphone, a laptop, a tablet, and a PC. As a main function, the second terminal 30 outputs the image transmitted from the first terminal 10 on the screen in real time, and a user interface for controlling the camera 11 of the first terminal 10 (User Interface: UI) is displayed on the screen. In addition, the second terminal 30 controls the camera 11 in real time according to an input of a medical staff input through the user interface or provides control information therefor to the first terminal 10.

To this end, as shown in FIG. 3, the second terminal 30 includes a microphone 31, a memory 32, a control unit 33, a communication unit 34, and a display 35.

The microphone 31 is for detecting sound and voice as in a general mobile terminal, and in particular, detects the voice of a medical staff during an image treatment. The memory 32 stores photos and images transmitted from the first terminal 10, diseases and symptoms for each patient, image treatment history for each patient, and prescription information for each patient. In addition, the communication unit 34 is connected to the first terminal 10 through long-distance wireless communication or wired communication.

The display 35 outputs an image transmitted from the first terminal 10 on a screen in real time, and provides a user interface for controlling the camera 11 of the first terminal 10 on the screen. Here, the user interface provided on the screen includes at least one of buttons, icons, and menus for controlling the operation of the camera 11 or changing settings.

The control unit 33 controls the camera 11 in real time according to an input of a medical staff input through the user interface or provides control information for this to the first terminal 10. For example, the control unit 33 controls the first terminal 10 to capture an image captured by the camera 11, and controls the zoom function and lighting of the camera 11. In addition, the control unit 33 provides a guide for guiding the moving direction and rotation direction of the camera 11 and a guideline for guiding the location of the treatment site in the captured image on the screen of the first terminal 10. to provide. In addition, the control unit 33 controls the first terminal 10 to display at least one of a ruler and a grid for determining the size of the treatment area on the captured image.

A detailed operation of the remote photographing system of FIG. 1 will be described with reference to FIGS. 4 to 9.

As shown in FIG. 4, when the user approaches the camera 11 of the first terminal 10 to the area where the user wants to receive treatment while the communication for remote control of the first terminal 10 is maintained, the camera ( The image of the treatment area captured by 11) is transmitted in real time to the second terminal 30 under the control of the controller 14 (S11). In this case, as shown in FIG. 5, the image captured by the camera 11 is output on the screen of the display 17 of the first terminal 10 and is also output on the screen of the second terminal 30 in real time. (S12). Accordingly, a medical staff, that is, a doctor, can check the user's treatment site in real time through the second terminal 30.

The second terminal 30 provides a user interface for controlling the camera 11 on the screen of the display 35 while the image is output on the screen (S13).

In addition, the second terminal 30 not only changes the settings of the camera 11 according to the doctor's input through the user interface, but also controls the camera 11 to photograph the treatment area (S14). The examples will be described as follows (FIGS. 5 to 7 ).

For example, as shown in FIG. 5, the doctor selects all or part of the desired image using a touch or a mouse from the image output on the screen of the second terminal 30, and uses the capture button of the user interface. To capture the desired video. When a user's command is input through the capture button, the first terminal 10 captures an image selected by the doctor, stores it in the memory 13, and transmits it to the second terminal 30 at the same time. Further, the photos and images transmitted to the second terminal 30 are stored in the memory 32. In this way, since the doctor remotely controls the first terminal 10 to take an image, it is possible to directly manage the history of treatment areas such as wounds, treatment history, and recovery progress. In addition, since pictures or images from various directions for a specific region are stored in the second terminal 30, the doctor can accurately diagnose through this.

6, when the doctor selects an arrow-shaped icon of the user interface provided on the screen of the second terminal 30, the camera 11 is displayed on the screen of the first terminal 10. A guide (for example, an arrow or text) for guiding the direction of movement and rotation is displayed, and a voice guide ('point the camera upward') is output through the speaker 16.

In addition, when the doctor touches the image while viewing the image output on the screen of the second terminal 30 or enlarges the image by using the enlargement icon of the user interface, the camera 11 zooms in (zoom-in). ) do. Conversely, when the image on the screen is reduced, the camera 11 zooms out. Likewise, the lighting unit 12 of the first terminal 10 can be controlled using the lighting icon of the user interface. Such camera 11 control is performed by the control unit 33 of the second terminal 30.

As shown in FIG. 7, according to a doctor's input through a user interface provided on the screen of the second terminal 30, a method for guiding the location of the treatment site in the image captured by the camera 11 A guideline is provided on the screen of the first terminal 10. In addition, a voice guide ('Put your arm in the yellow area') is output through the speaker 16 along with this. In addition, according to a doctor's input through the user interface, the second terminal 30 displays at least one of a ruler and a grid for determining the size of the treatment area on the image captured by the camera 11. In this way, since the size can be measured using the guideline, ruler, and grid for the shape of the treatment site, diagnosis using the image captured by the camera 11 can be more accurate.

8 is a diagram for explaining the electronic blackboard function of the first terminal 10.

As shown in FIG. 8, while the image captured by the camera 11 is provided to the second terminal 30 or after being stored in the memory 13, the user In a picture or video on the screen, you can use your finger or pen to point to the actual painful area. At this time, when pointing with a finger or a pen on the screen of the first terminal 10, the display 17 recognizes it and the actual painful area is displayed on the screen of the second terminal 30 (a). In addition, in the case of a part (for example, ribs, internal organs, etc.) that cannot actually take a picture or image, a human body picture stored in the memory 13 is displayed on the screens of the first and second terminals 10 and 30. As shown above, you can use your finger or pen to point to the sore spot (b).

9 is a diagram for describing a multi-capturing function of the second terminal 30.

The second terminal 30 may provide a previously captured photo/video and a currently captured photo/video at the same time by dividing the screen, or simultaneously provide a user's photo/video with another patient's photo/video. have. For this reason, the doctor can check the progress of whether the user's symptoms have improved or compare the symptoms with other patients.

10 is a diagram illustrating another example of the first terminal 10.

As shown in FIG. 10, the first terminal 10 includes a front camera 111, a rear camera 112, a sensor 113, a control unit 114, a memory 115, a communication unit 116, and a speaker ( 117) and a display 118. Although not shown in the drawing, a lighting unit for lighting the camera is further included. Here, the memory 115, the communication unit 116, the speaker 117, and the display 118 are the same as those of the first terminal 10 of FIG. 2.

The front camera 111 is located on the front side of the first terminal 10 together with the display 118, and the rear camera 112 is located on the rear side. The front camera 111 and the rear camera 112 are configured to take a video image as well as a picture.

The sensor 113 is configured as a gyro sensor for detecting the inclination of the first terminal 10. The tilt sensed by the sensor 113 is provided to the control unit 114, and the control unit 114 selects one of the front camera 111 and the rear camera 112 according to the sensed tilt. At this time, the control unit 114 determines whether the first terminal 10 is close to a state parallel to the ground or a state perpendicular to the ground according to the sensed inclination, and if it is close to a state parallel to the ground, the rear If the camera 112 is selected and it is close to a state perpendicular to the ground, the front camera 111 is selected. In addition, the control unit 114 controls to capture an image through the selected camera. For example, if the selected camera is the rear camera 112, a foot close to the ground is captured, and if the selected camera is the front camera 111, the user's face is captured.

In addition, the control unit 114 determines whether to keep the selected camera as it is or to switch to an unselected camera according to the color of the image captured by the selected camera. For example, if the image captured by the selected camera includes a preset color (eg, skin color), the control unit 114 continues to capture the image through the selected camera, and conversely, the image preset color If not included, the controller 114 captures an image by switching to an unselected camera.

Then, the controller 114 determines whether to continue to use the switched camera according to the color of the image captured by the switched camera. Likewise, if the image captured by the switched camera includes a preset color, the control unit 114 continues to capture the image through the switched camera, and conversely, if the image does not contain a preset color, the controller 114 114 determines that there is no body part in the image captured by the front camera 111 and the rear camera 112 and informs the user of this.

In this way, the user's front/rear camera is automatically switched according to the inclination during image treatment, and the presence or absence of the treatment site is determined, thus enhancing the user's convenience.

An example of an emergency treatment guide method using the remote imaging system of FIG. 1 will be described.

As shown in FIG. 4, the image of the treatment site captured by the camera 11 of the first terminal 10 is transmitted to the second terminal 30 in real time, and the screen of the first terminal 10 It is output on the screen of the second terminal 30 in real time. The doctor checks the user's treatment site in real time through the second terminal 30 and controls the camera 11 to photograph the user's treatment site when detailed diagnosis is required.

The captured image is stored in the first and second terminals 10 and 30, in which the second terminal 30 automatically searches for a first aid guide corresponding to the user's symptoms based on the stored image. And display it on the screen. When the doctor checks and selects the first aid guide proposed by the second terminal 30, the second terminal 30 transmits the selected first aid guide to the first terminal 10. Then, the user can take first aid by referring to the transmitted first aid guide. In this way, by providing the user with a first aid guide in real time, quick and appropriate first aid treatment is possible.

2nd Example

Hereinafter, a remote imaging system for image treatment according to a second embodiment of the present invention will be described with reference to FIG. 11.

As shown in FIG. 11, the remote photographing system of the second embodiment includes a first terminal 210, a server 220, and a second terminal 230.

The first terminal 210 is a terminal of a user who wishes to receive medical treatment, and is preferably configured in various forms such as a mobile terminal capable of wireless communication, for example, a smartphone, a laptop, or a tablet, but is not limited thereto. It can also be configured as a terminal capable of this. As a main function, the first terminal 210 captures an image of a body part to be treated and transmits it to the server 220. At this time, the first terminal 210 transmits user identification information including at least one of a user's name, a resident registration number (or ID), and a phone number together.

The server 220 is for health management of patients, and stores diseases and symptoms for each patient, image treatment history for each patient, and prescription information for each patient. The server 220 processes the image transmitted from the first terminal 210 at the request of the first terminal 210 through an image preprocessing process, and automatically processes the image pattern of the affected area/wound included in the image. Analyze as. In addition, the server 220 checks pre-stored data related to a corresponding user using user identification information provided with the transmitted image, and compares the image pattern with pre-stored data. Also, the image pattern may be compared with data of others stored in the server 220.

The second terminal 230 receives the analysis result of the server 220 and provides it to a doctor through a screen. The doctor can check the similar medical treatment history of the user through the server 220, and check the time, cause, site of the same symptom, the condition and characteristics of the user, prescription details, recovery period, and the like. In addition, the doctor may check the images and cases of other patients who showed symptoms similar to those of the user through the server 220, prescription details, and treatment methods.

Through this process, the image including the affected area/wound is automatically analyzed in real time, and the user searches for a similar case of himself or another person through the server 220 and shows it to the doctor. In addition, doctors can accurately diagnose and prescribe through previous cases.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention.

Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

10, 210: first terminal 11: camera
12: lighting unit 13, 32, 115: memory
14, 33, 114: control unit 15, 34, 116: communication unit
16, 117: speaker 17, 35, 118: display
20: communication network 30, 230: second terminal
31: microphone 111: front camera
112: rear camera 113: sensor
220: server

Claims (15)

A first terminal including a camera, a memory, a communication module, and a controller, and transmitting an image captured by the camera;
The image captured by the camera of the first terminal is displayed in real time, a user interface for controlling the camera of the first terminal is provided on the screen, and the camera of the first terminal is displayed according to an input through the user interface. A second terminal to control;
Including,
The controller of the first terminal
When the user of the first terminal points to a specific portion in the image, comparing the selected image of the specific portion in the image captured by the camera of the first terminal with a previous image stored in the memory,
If there is an external damaged part as a result of the comparison, the communication module is controlled to transmit the selected image of the specific part to the second terminal,
When there is no external damaged part, the human body picture stored in the memory is transmitted to the second terminal
A remote photographing system, characterized in that. The method of claim 1,
The user interface,
A remote photographing system comprising at least one of a button, an icon, and a menu for controlling an operation of the camera or changing a setting. The method of claim 1,
In the step of controlling the camera according to an input through the user interface,
And controlling the camera to take the captured image according to the input. The method of claim 1,
In the step of controlling the camera according to an input through the user interface,
A remote photographing system, comprising providing a guide for guiding the moving direction and the rotation direction of the camera according to the input on the screen of the first terminal. The method of claim 1,
In the step of controlling the camera according to an input through the user interface,
And providing a guideline for guiding a location of a photographing object in an image captured by the camera according to the input, on the screen of the first terminal. The method according to claim 4 or 5,
A remote photographing system, characterized in that the first terminal outputs a guide voice along with the guide or the guide line. The method of claim 1,
In the step of controlling the camera according to an input through the user interface,
And displaying on the image captured by the camera at least one of a ruler and a grid for determining the size of an object to be photographed according to the input. The method of claim 1,
In the step of controlling the camera according to an input through the user interface,
A remote photographing system comprising controlling a zoom function of the camera according to the input. The method of claim 1,
In the step of controlling the camera according to an input through the user interface,
The remote photographing system, characterized in that controlling the illumination of the camera according to the input. A first terminal including at least one camera and transmitting an image captured by the camera;
A second terminal that displays the image captured by the camera in real time, provides a user interface for controlling the camera on a screen, and controls the camera according to an input through the user interface,
The first terminal,
Front and rear cameras;
A sensor that detects a tilt;
A control unit that selects one of the front and rear cameras according to the sensed inclination, and controls to capture an image through the selected camera
Remote photographing system comprising a. delete delete The method of claim 10,
The control unit,
And determining whether to switch to an unselected camera according to the color of the image captured by the selected camera. delete delete

Images