WO2019221416A1 - Procédé pour fournir un service permettant de guider une personne ayant une déficience visuelle au moyen d'une diffusion de relais vidéo sur place en temps réel - Google Patents

Procédé pour fournir un service permettant de guider une personne ayant une déficience visuelle au moyen d'une diffusion de relais vidéo sur place en temps réel Download PDF

Info

Publication number
WO2019221416A1
WO2019221416A1 PCT/KR2019/004901 KR2019004901W WO2019221416A1 WO 2019221416 A1 WO2019221416 A1 WO 2019221416A1 KR 2019004901 W KR2019004901 W KR 2019004901W WO 2019221416 A1 WO2019221416 A1 WO 2019221416A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
real
time
requesting terminal
providing
Prior art date
Application number
PCT/KR2019/004901
Other languages
English (en)
Korean (ko)
Inventor
문경진
Original Assignee
Moon Kyong Jin
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Moon Kyong Jin filed Critical Moon Kyong Jin
Publication of WO2019221416A1 publication Critical patent/WO2019221416A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/22—Social work or social welfare, e.g. community support activities or counselling services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Definitions

  • the present invention relates to a method for providing a guide service for the visually impaired by using real-time on-site video relaying, and provides a method for remotely performing a response to a request requested by a guide requester by streaming a screen shot by a camera in real time.
  • the devices for free walking are related to smart wand and smart glasses using image camera, ultrasonic sensor, and acceleration sensor.
  • Typical technologies include technology to identify obstacles and extract walking area and landmark symbol.
  • Technology such as technology that recognizes information and gives surrounding environment information and intelligent walking aid system based on Machine-to-Machine (M2M) has been researched and developed so that blind people can walk safely and conveniently.
  • M2M Machine-to-Machine
  • the smart glasses based on the camera, microphone and speaker interworking with the smart terminal, when the help request event of voice recognition or button recognition occurs available that can help among a plurality of help providers Selecting a terminal and sharing the real-time video collected from the smart glasses from the terminal providing help to guide the requester to approach the object or destination desired, independent living inside and outside the home even if there is no worker or caregiver It is possible to provide a blind hand guide service providing method using real-time on-site video relaying.
  • the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.
  • an embodiment of the present invention when the help request event is received from the requesting terminal, the step of receiving real-time shooting data from the requesting terminal or from the photographing device linked to the requesting terminal Selecting and transmitting the streamed real-time shooting data from among the at least one pre-registered provisioning terminal, the provisioning capable of providing the guide, forming a channel for real-time streaming of the photographing data between the selected provisioning terminal and the requesting terminal, and When the voice corresponding to the description of the real-time shooting data is received from the providing terminal, and transmitting to the requesting terminal in real time.
  • any one of the problem solving means of the present invention described above through the change and improvement in the pedestrian environment for the traffic vulnerable ultimately can play a role in carrying out the same fair and convenient traffic right to the general public who is the traffic vulnerable.
  • In addition to providing a variety of guidance services or assistance services in addition to the road guidance has the effect of eradicating direct discrimination as well as indirect discrimination of the disabled.
  • FIG. 1 is a view for explaining a system for providing a guide service for the visually impaired using real-time on-site video relaying according to an embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating a server for providing a guide service for the visually impaired included in the system of FIG. 1.
  • FIG. 3 is a view for explaining an embodiment of the blind people guide service using the real-time on-site video relay according to an embodiment of the present invention.
  • FIG. 4 is a diagram illustrating a process of transmitting and receiving data between components included in a system for providing a visually-impaired person using the real-time on-site video relay of FIG. 1 according to an embodiment of the present invention.
  • FIG. 5 is an operation flowchart for explaining a method for providing a visually impaired guide service using real-time on-site video relaying according to an embodiment of the present invention.
  • the term 'unit' includes a unit realized by hardware, a unit realized by software, and a unit realized by both.
  • one unit may be realized using two or more pieces of hardware, or two or more units may be realized by one piece of hardware.
  • Some of the operations or functions described as being performed by the terminal, the apparatus, or the device may be performed instead in a server connected to the terminal, the apparatus, or the device.
  • some of the operations or functions described as being performed by the server may be performed by the terminal, apparatus or device connected to the server.
  • mapping or matching with a terminal mean that a unique number of a terminal or identification information of an individual, which is identification data of the terminal, is mapped or matched. Can be interpreted as
  • the blind person guide service providing system 1 using real-time on-site video relaying includes a request terminal 100, a blind person guide service providing server 300, a providing terminal 400, and a companion device 500. And at least one CCTV 600.
  • the visually impaired guide service providing system 1 using the real-time on-site video relay of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1.
  • each component of FIG. 1 is generally connected through a network 200.
  • the request terminal 100 may be connected to the blind person guide service providing server 300 through the network 200, and the request terminal 100 may be connected through the network 200. It may be connected to the companion device 500.
  • the request terminal 100 may be connected to the providing terminal 400 directly or via the guide service providing server 300 for the visually impaired through the network 200.
  • the blind person guide service providing server 300 may be connected to the request terminal 100, the providing terminal 400, the companion device 500, and the CCTV 600 to the network 200.
  • the providing terminal 400 may be connected to the request terminal 100 through the network 200, or may be connected to the CCTV 600.
  • the companion device 500 may be connected to the requesting terminal 100 through the network 200, and the CCTV 600 may be connected to the visual service guide server 300 through the network 200.
  • the network refers to a connection structure capable of exchanging information between respective nodes such as a plurality of terminals and servers.
  • a network examples include RF, 3rd Generation Partnership Project (3GPP) network, and long term (LTE).
  • Evolution network 5th Generation Partnership Project (5GPP) network, World Interoperability for Microwave Access (WIMAX) network, Internet, Local Area Network (LAN), Wireless Local Area Network (WLAN), Wide Area Network (WAN) , PAN (Personal Area Network), Bluetooth (Bluetooth) network, NFC network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network and the like, but is not limited thereto.
  • 5GPP 3rd Generation Partnership Project
  • 5GPP Fifth Generation Partnership Project
  • WWX World Interoperability for Microwave Access
  • WLAN Local Area Network
  • WAN Wide Area Network
  • PAN Personal Area Network
  • Bluetooth Bluetooth
  • NFC satellite broadcasting network
  • analog broadcasting network analog broadcasting network
  • DMB Digital Multimedia Broadcasting
  • the term “at least one” is defined as a singular and plural term, and each component may exist in the singular or plural, even though the term “at least one” does not exist, and may mean the singular or plural. It will be self explanatory. In addition, the singular or plural elements may be changed according to embodiments.
  • the request terminal 100 may be a terminal of a requester who receives a guide service using a web page, an app page, a program, or an application related to a visually impaired guide service using real-time on-site video relaying.
  • the request terminal 100 may be a terminal that generates a help request event by voice recognition or button input and transmits the generated help request event to the blind guide service providing server 300.
  • the request terminal 100 is connected to the providing terminal 400 through the guide service providing server 300 for the visually impaired, video recording or voice input data of the request terminal 100 itself, or from the companion device 500.
  • the visually impaired guide service providing server 300 Provides input so that the input video data or audio data is streamed in real time to the visually impaired guide service providing server 300 to provide the request terminal 100 in real time to transmit the information or a response to the query to the requesting terminal 100 in real time. It may be a terminal. At this time, any help event is possible, and its use or purpose will be obvious if any of the configuration of the patent is the same.
  • the request terminal 100 may be implemented as a computer that can access a server or a terminal in a remote place through a network.
  • the computer may include, for example, a navigation, a laptop equipped with a web browser, a desktop, a laptop, and the like.
  • the request terminal 100 may be implemented as a terminal that can access a server or terminal in a remote place through a network.
  • the request terminal 100 is, for example, a wireless communication device that ensures portability and mobility.
  • the request terminal 100 may include navigation, a personal communication system (PCS), a global system for mobile communications (GSM), a personal digital cellular (PDC), and a personal PHS (PHS).
  • PCS personal communication system
  • GSM global system for mobile communications
  • PDC personal digital cellular
  • PHS personal PHS
  • PDA Personal Digital Assistant
  • IMT International Mobile Telecommunication
  • CDMA Code Division Multiple Access
  • W-CDMA W-Code Division Multiple Access
  • WBRO Wireless Broadband Internet
  • the blind person guide service providing server 300 may be a server for providing a blind person guide service web page, an app page, a program, or an application using real-time on-site video relaying.
  • the visually impaired guide service providing server 300 receives a help request event from the requesting terminal 100, the visually impaired guide service providing server 300 connects to any one of the at least one providing terminal 400 and the providing terminal 400. If the provider of 400 provides help, it may be a server transmitting the request to the requesting terminal 100 in real time.
  • the visually impaired guide service providing server 300 before the providing terminal 400 is connected with the requesting terminal 100, the photographing data photographed at the providing terminal 400 or photographed at the requesting terminal 100 mechanically It may be a server that provides information in real time by analyzing the information, and after connecting, the server may transmit a text or voice input from the providing terminal 400 to the requesting terminal 100.
  • the visually impaired guide service providing server 300 by searching the CCTV 600 based on the location of the request terminal 100 to transmit to the providing terminal 400 to provide a wider field of view to provide assistance. It can be a server.
  • the guide service providing server 300 for the visually impaired may be implemented by a computer that can access a server or a terminal in a remote place through a network.
  • the computer may include, for example, a navigation, a laptop equipped with a web browser, a desktop, a laptop, and the like.
  • the providing terminal 400 may be a terminal of a help provider using a web page, an app page, a program, or an application related to a blind person guide service using real-time on-site video relaying.
  • the providing terminal 400 sends a response thereto as a voice signal. It may be a terminal transmitting to the request terminal 100 in real time.
  • the providing terminal 400 may be provided with the image of the CCTV 600 from the guide service providing server 300 for the visually impaired, and may be a terminal that receives and outputs the screen.
  • the providing terminal 400 may be implemented as a computer that can access a server or a terminal in a remote place through a network.
  • the computer may include, for example, a navigation, a laptop equipped with a web browser, a desktop, a laptop, and the like.
  • the providing terminal 400 may be implemented as a terminal that can access a server or terminal in a remote place through a network.
  • the providing terminal 400 is, for example, a wireless communication device that ensures portability and mobility, and includes a navigation, a personal communication system (PCS), a global system for mobile communications (GSM), a personal digital cellular (PDC), and a personal PHS (PHS).
  • PCS personal communication system
  • GSM global system for mobile communications
  • PDC personal digital cellular
  • PHS personal PHS
  • PDA Personal Digital Assistant
  • IMT International Mobile Telecommunication
  • CDMA Code Division Multiple Access
  • W-CDMA W-Code Division Multiple Access
  • WBRO Wireless Broadband Internet
  • the companion device 500 may be a device including a microphone, a speaker (or earbud), and a camera to transmit the input voice or photographing data to the requesting terminal 100.
  • the companion device 500 may be an input device for transmitting the requester's voice, etc. collected through the microphone to the requesting terminal 100 and transmitting the information to the visually impaired guide service providing server 300.
  • the companion device 500 may be, for example, Electronic Travel Aids (ETA) and Robotic Travel Aids (RTA).
  • ETA may use a distance sensor such as an ultrasonic / laser and a front obstacle using a camera.
  • the RTA is a walking aid device that combines various sensor technologies and mobile robot technology with the ETA to improve convenience of use, and may be implemented as a device combined with the mobile robot technology using outdoor GPS information.
  • various devices can be used without being limited to those listed above.
  • the at least one CCTV 600 may be a photographing apparatus that transmits a screen sharing request from the visually impaired guide service providing server 300 to the visually impaired guide service providing server 300.
  • the at least one CCTV 600 may identify and track an object when an object tracking request exists, and may be a device capable of tilting or rotating up, down, left, and right.
  • the at least one CCTV (600) by storing the location of the point photographed by the at least one CCTV (600) as an identification code to transmit to the blind guide service providing server 300, the blind person guide service providing server 300 ) May be a device that provides this identification code when searching for the CCTV 600 based on the location of the request terminal 100.
  • the at least one CCTV 600 may be implemented as a computer that can be connected to a remote server or terminal through a network.
  • the computer may include, for example, a navigation, a laptop equipped with a web browser, a desktop, a laptop, and the like.
  • the at least one CCTV 600 may be implemented as a terminal that can be connected to a remote server or terminal through a network.
  • At least one CCTV 600 is, for example, a wireless communication device that ensures portability and mobility, navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (Wibro) It may include all kinds of handheld based wireless communication devices such as a terminal, a smart phone, a smart pad, a tablet PC, and the like.
  • PCS Personal Communication System
  • GSM Global System for Mobile communications
  • PDC Personal Digital Cellular
  • PHS Personal Handyphone System
  • PDA Personal Digital Assistant
  • IMT International Mobile Telecommunication
  • CDMA Code Division Multiple Access
  • W-CDMA Wideband Internet
  • It may include all kinds of handheld based wireless communication devices such as a terminal, a smart phone, a smart pad, a tablet PC, and the like.
  • FIG. 2 is a block diagram illustrating a server for providing a guide service for the visually impaired included in the system of FIG. 1
  • FIG. 3 is a view for implementing the guide service for the visually impaired using real-time on-site video relay according to an embodiment of the present invention. It is a figure for demonstrating an Example.
  • the blind person guide service providing server 300 may include a request receiving unit 310, a selecting unit 320, a forming unit 330, a transmitting unit 340, and an object tracking unit 350. Can be.
  • the blind person guide service providing server 300 according to an embodiment of the present invention or another server (not shown) operating in conjunction with the visually impaired using the real-time field video relay to the request terminal 100, and the providing terminal 400
  • the request terminal 100 and the providing terminal 400 include a visually impaired guide service application, a program, an app page, a web page using real-time on-site video relaying. Can install or open the back.
  • the service program may be driven in the request terminal 100 and the provision terminal 400 using a script executed in a web browser.
  • the web browser is a program that enables the use of the World Wide Web (WWW) service, and refers to a program that receives and displays hypertext described in HTML (hyper text mark-up language), for example, Netscape. , Explorer, chrome and the like.
  • an application means an application on a terminal, and includes, for example, an app running on a mobile terminal (smartphone).
  • the request receiving unit 310 streams real-time photographing data from the request terminal 100 or from a photographing device linked with the request terminal 100.
  • the help request event may be input and generated from the request terminal 100 through various interfaces such as voice recognition, button input recognition, motion or touch recognition of the touch panel.
  • voice recognition it may be words such as "where is it?" Or "help”, but the words may be learned to derive similar words to make a database or to learn a user's tone.
  • the present invention may not be limited to the above-described words or preset words.
  • the help request event may be generated by a method of making a call in the request terminal 100, that is, a call origination and received by the request receiving unit 310.
  • the request receiving unit 310 receives the help request event from the request terminal 100
  • the request is received.
  • the terminal 100 100 matches a previously stored word with a word converted into a text through voice recognition
  • a call call for a help request event may be executed. For example, it may be almost impossible for a blind person to take out a smart terminal, unlock a lock screen, and find and execute a required app among a large number of apps. Accordingly, convenience can be provided by allowing help to be requested by a button or voice.
  • the requesting terminal 100 includes or interlocks with any one or a combination of at least one of a microphone, a speaker, and a camera, and the photographing apparatus linked with the requesting terminal 100 is attached to the wearable glass to photograph the opposite direction.
  • the photographing data photographed by interworking with the request terminal 100 by wire or wirelessly may be transmitted to the request terminal 100.
  • consent for sharing the location information of the request terminal 100 may be included, and the location information of the request terminal 100 may be updated and collected in real time until the blind guide service ends. have.
  • the visually impaired person may make various requests for help even if it is not necessarily a road guide, and may require location information but may not.
  • the request for help is determined to agree to the collection of location information, but collecting the location, if it is not necessary in the providing terminal 400 dispose of it or stop collecting any more, agree to the urgent situation To prevent the delay caused by
  • the selector 320 may select and transmit the streamed real-time photographing data from the at least one pre-registered provision terminal 400 to which the provision terminal may be provided.
  • the selection unit 320 may be a method of transmitting a help request event by broadcasting to the providing terminal 400 and connecting to a terminal, that is, an available terminal, in which an Ack is received. It may also be connected by going through the steps or by immediately connecting the available terminal.
  • the providing terminal 400 and the requesting terminal 100 are transmitted.
  • the data may be voice converted and transmitted to the request terminal 100 in real time. For example, if all of the providers are busy or connected and the requester is in a hurry and wants to know what is going on right now, it may be inconvenient to wait for an agent or provider. In this case, by notifying the situation that is mechanically identified during the connection time, it is possible to prevent accidents in an emergency.
  • the landmark area may be recognized and classified from the ROI obtained by detecting the landmark area from the original image.
  • the recognition method using an artificial neural network is a representative technique of machine learning, which is a method of extracting feature vectors from a sign DB and landmark DB image previously detected through neural networks, and learning, classifying, and recognizing them through a hierarchical structure of neural networks.
  • Artificial neural network is a system that recognizes and classifies images by extracting features that are robust to change by forming multi-layered structure and passing through each layer.
  • CNN convolutional neural network
  • Another symbol recognition method is a recognition technique using feature matching.
  • SIFT is widely used, but it is the most common method but requires a large amount of computation.
  • CPT Central Projected Transformation
  • the forming unit 330 may form a channel for real-time streaming of photographing data between the selected providing terminal 400 and the requesting terminal 100.
  • a channel between two terminals 100 and 400 may be formed.
  • the bandwidth and network resources are determined to determine the specification of transcoding, and the real-time streaming is performed through the formed channel. Can provide.
  • the transmitting unit 340 may transmit to the requesting terminal 100 in real time. For example, if the requester wants to find a black suit and needs help, the provider will explain to the requestor while viewing the situation, such as the number of drawers or the number of hangers, while viewing the screen received from the request terminal 100. Can be.
  • the real-time photographing data may be streamed in real time with the received voice data inputted from the request terminal 100 or a microphone linked with the request terminal 100 added thereto. That is, the photographing data may include voice, but if not, the voice data inputted from the microphone is also transmitted, so that the requestor may transmit the request or inquiry to the provider, so as to determine exactly what the provider wants to request. Provide information.
  • the object tracking unit 350 may capture real-time photographing data from the requesting terminal 100 or from a photographing apparatus linked with the requesting terminal 100. After receiving the stream, search for at least one CCTV 600 photographing the direction in which the request terminal 100 is located based on the position of the request terminal 100 and stream the real-time photographing data of the searched at least one CCTV 600. In response, the indicator of the user of the request terminal 100 may be extracted from at least one photographing object captured by the at least one CCTV 600.
  • the object tracking unit 350 may share the screen of the CCTV 600 to the providing terminal 400, and display a tag or an image for identifying the visually impaired and transmit the screen to the providing terminal 400. have.
  • the CCTV 600 may store the GPS coordinates of the shooting location, not the place where the CCTV 600 is located, as an identification code or identification number.
  • the CCTV 600 having the same identification code as the corresponding coordinates can be detected based on the GPS coordinates of the requesting terminal 100, and thus has a wider viewing angle than the image captured by the requesting terminal 100. Allow the screen to be provided. Accordingly, the providing terminal 400 turns around, and there is a stop when a few more steps are taken, and the bus 311 may be informed that it has now arrived.
  • the present invention is not limited to the above example.
  • the visually impaired people have difficulty walking due to various problems caused by the invisibility of the eyes.
  • the visually impaired people are limited in their daily activities by limiting the most dependent of the five senses of human beings.
  • the providing terminal In addition to connecting 400, a service may be provided to allow walking more conveniently.
  • a problem with the visually impaired walking the fact is that the ability to walk is not a problem, but it is difficult to recognize the direction while walking. To this end, first, Obstacle Recognition is performed.
  • an object and a background are separated, and the object is recognized using a shape feature for the object area. Then, after binarizing the image, the feature is extracted. The length and size of the object are determined using the circumferential length and the area size, the feature is selected, and the object is classified to find out what the object is. To this end, clustering is to be achieved, and when the selected features are collected and tied together, the object can be known through the process of clustering. In addition to this understanding, how to deliver information on the road is also important. By providing voice information on the way to the visually impaired, users can reduce the burden of spatial constraints.
  • the request terminal 100 generates a help request event using a call origination, a button press, or a voice recognition as an input value, and transmits the help request event to the blind person guide service providing server 300. And, (b) if there is a waiting time with the providing terminal 400, the visually impaired guide service providing server 300, first, the shape or logo (text of the object depicted by the requester on the screen taken by the companion device 500) Perception, and (c) calculate and measure in which direction how many steps in front or behind, based on the direction the requestor is looking.
  • the visually impaired guide service providing server 300 does not have a ticket machine on the screen photographed by the companion device 500.
  • the CCTV 600 may be searched for photographing the location where the request terminal 100 is located to identify the requestor and may indicate in which direction the ticket is issued.
  • the providing terminal 400 and the requesting terminal 100 are connected by the visually impaired guide service providing server 300, the answer transmitted from the providing terminal 400 may be transmitted to the requesting terminal 100. The requester will then be able to issue a ticket.
  • FIG. 4 is a diagram illustrating a process of transmitting and receiving data between components included in a system for providing a visually-impaired person using the real-time on-site video relay of FIG. 1 according to an embodiment of the present invention.
  • FIG. 4 an example of a process in which data is transmitted and received between each component will be described with reference to FIG. 4, but the present disclosure is not limited to the above-described embodiments, and is illustrated in FIG. 4 according to the various embodiments described above. It is apparent to those skilled in the art that the process of transmitting and receiving data may be changed.
  • the requesting terminal 100 confirms whether help is requested through voice monitoring or input monitoring (S4200) (S4300). If the help is requested, the help service event is sent to the blind guide service providing server 300 (S4400).
  • the visually-impaired guide service providing server 300 checks the availability of the providing terminal 400 (S4500), streams the photographing data from the request terminal 100 during the waiting time and receives a query (S4600). Until the connection with the providing terminal 400 (S4700), the voice guidance is automatically performed through image analysis (S4710).
  • the visually impaired guide service providing server 300 forms a channel when the connection is made (S4730), and if the voice is transmitted from the providing terminal 400 and delivers it to the requesting terminal 100 (S4740), if necessary
  • the CCTV 600 is searched (S4800) to receive the screen shot from the CCTV 600 is shared (S4810), and transmits to the providing terminal 400 (S4820).
  • the visually impaired guide service providing server 300 returns to S4730 and loops until the guide is finished (S4900).
  • the visually impaired guide service providing server receives real-time photographing data from the requesting terminal or from a photographing apparatus linked with the requesting terminal (S5100).
  • the guide service providing server for the visually impaired selects and transmits the streamed real-time shooting data from the at least one pre-registered providing terminal capable of providing the guide (S5200), and the shooting data between the selected providing terminal and the requesting terminal A channel for real time streaming is formed (S5300).
  • the visually impaired guide service providing server receives a voice corresponding to the description of the real-time photographing data from the providing terminal, it transmits to the requesting terminal in real time (S5400).
  • the blind person guide service providing method using a real-time on-site video relay is in the form of a recording medium including instructions executable by a computer, such as an application or a program module executed by a computer. May also be implemented.
  • Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media.
  • Computer readable media may include all computer storage media.
  • Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • the method for providing a visually impaired user guide service using real-time on-site video relaying may include an application basically installed in a terminal (this may include a program included in a platform or an operating system, which is basically installed in the terminal). ), Or may be executed by an application (ie, a program) that is directly installed on the master terminal by an application providing server such as an application store server, an application, or a web server associated with the corresponding service.
  • an application providing server such as an application store server, an application, or a web server associated with the corresponding service.
  • the method for providing a visually-impaired guide service using real-time on-site video relaying according to an embodiment of the present invention described above is implemented as an application (ie, a program) basically installed in a terminal or directly installed by a user, and the like. Can be recorded on a computer readable recording medium.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Tourism & Hospitality (AREA)
  • Multimedia (AREA)
  • Primary Health Care (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • Child & Adolescent Psychology (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

L'invention concerne un procédé pour fournir un service permettant de guider une personne ayant une déficience visuelle au moyen d'une diffusion de relais vidéo sur place en temps réel. Le procédé consiste : lorsqu'un événement de demande d'aide est reçu en provenance d'un terminal demandeur, à recevoir des flux de données d'image en temps réel provenant du terminal demandeur ou d'un dispositif de photographie interconnecté au terminal demandeur ; à sélectionner un terminal fournisseur pouvant fournir un guidage, à partir d'au moins un terminal fournisseur préenregistré, et à transmettre les données d'image en temps réel diffusées en continu au terminal fournisseur sélectionné ; à établir un canal pour une diffusion en continu de données d'image en temps réel entre le terminal fournisseur sélectionné et le terminal demandeur ; et lorsqu'une voix correspondant à une description des données d'image en temps réel est reçue en provenance du terminal fournisseur, à transmettre la voix au terminal demandeur en temps réel.
PCT/KR2019/004901 2018-05-18 2019-04-23 Procédé pour fournir un service permettant de guider une personne ayant une déficience visuelle au moyen d'une diffusion de relais vidéo sur place en temps réel WO2019221416A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020180057491A KR101929875B1 (ko) 2018-05-18 2018-05-18 실시간 현장 동영상 중계를 이용한 시각장애인 안내 서비스 제공 방법
KR10-2018-0057491 2018-05-18

Publications (1)

Publication Number Publication Date
WO2019221416A1 true WO2019221416A1 (fr) 2019-11-21

Family

ID=64952436

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/004901 WO2019221416A1 (fr) 2018-05-18 2019-04-23 Procédé pour fournir un service permettant de guider une personne ayant une déficience visuelle au moyen d'une diffusion de relais vidéo sur place en temps réel

Country Status (2)

Country Link
KR (1) KR101929875B1 (fr)
WO (1) WO2019221416A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112370240A (zh) * 2020-12-01 2021-02-19 創啟社會科技有限公司 视障辅助智能眼镜、系统及其控制方法

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102225456B1 (ko) * 2019-09-03 2021-03-09 삼육대학교산학협력단 로드 메이트 시스템 및 로드 메이트 서비스 제공 방법
KR102495597B1 (ko) * 2020-10-16 2023-02-06 숙명여자대학교산학협력단 시각장애인을 위한 온라인 강의 콘텐츠 제공방법 및 그 사용자 단말
KR102291296B1 (ko) 2021-05-12 2021-08-20 방윤 시각 장애인 보행 보조 시스템
KR102559789B1 (ko) * 2023-01-30 2023-07-28 문경진 실시간 스트리밍을 이용한 시각장애인 안내 서비스 제공 시스템

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003196286A (ja) * 2001-09-04 2003-07-11 Sony Computer Entertainment Inc 情報処理システム、端末装置、情報処理方法、情報処理プログラム、及び情報処理プログラムを記録したコンピュータ読み取り可能な記録媒体
KR20150090951A (ko) * 2014-01-29 2015-08-07 주식회사 중부보안 Nfc와 cctv를 이용한 위급상황 관리 시스템
KR20160063456A (ko) * 2014-11-26 2016-06-07 아바드(주) 시각장애인의 원격 활동보조 서비스 시스템 및 이를 이용한 서비스 방법
KR20170004303A (ko) * 2015-07-02 2017-01-11 김경진 스마트 손잡이
KR101730266B1 (ko) * 2015-11-30 2017-04-26 한양대학교 산학협력단 장애인을 위한 IoT 기반 길안내 장치 및 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003196286A (ja) * 2001-09-04 2003-07-11 Sony Computer Entertainment Inc 情報処理システム、端末装置、情報処理方法、情報処理プログラム、及び情報処理プログラムを記録したコンピュータ読み取り可能な記録媒体
KR20150090951A (ko) * 2014-01-29 2015-08-07 주식회사 중부보안 Nfc와 cctv를 이용한 위급상황 관리 시스템
KR20160063456A (ko) * 2014-11-26 2016-06-07 아바드(주) 시각장애인의 원격 활동보조 서비스 시스템 및 이를 이용한 서비스 방법
KR20170004303A (ko) * 2015-07-02 2017-01-11 김경진 스마트 손잡이
KR101730266B1 (ko) * 2015-11-30 2017-04-26 한양대학교 산학협력단 장애인을 위한 IoT 기반 길안내 장치 및 방법

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112370240A (zh) * 2020-12-01 2021-02-19 創啟社會科技有限公司 视障辅助智能眼镜、系统及其控制方法
WO2022116812A1 (fr) * 2020-12-01 2022-06-09 创启社会科技有限公司 Lunettes intelligentes d'aide aux personnes souffrant de déficience visuelle, et système et procédé de commande associés
GB2611481A (en) * 2020-12-01 2023-04-05 Innospire Tech Limited Visual impaired assisting smart glasses, and system and control method thereof

Also Published As

Publication number Publication date
KR101929875B1 (ko) 2018-12-18

Similar Documents

Publication Publication Date Title
WO2019221416A1 (fr) Procédé pour fournir un service permettant de guider une personne ayant une déficience visuelle au moyen d'une diffusion de relais vidéo sur place en temps réel
US20220270512A1 (en) Augmented Reality Panorama Systems and Methods
JP6525229B1 (ja) デジタルサーチ・セキュリティシステム、方法及びプログラム
KR102391111B1 (ko) 제어 장치 및 방법
KR20180079116A (ko) 시각 장애인 안내 서비스 제공 시스템 및 방법
JP2005059170A (ja) 情報収集ロボット
WO2021180004A1 (fr) Procédé d'analyse de vidéo, procédé de gestion d'analyse de vidéo, et dispositif associé
WO2015102301A1 (fr) Système et procédé de fourniture de service de guidage routier pour les personnes malvoyantes
JP2020021200A (ja) 通信システム及び通信方法
US11514600B2 (en) Information processing device and information processing method
JP6744652B1 (ja) 混雑情報報知システム
KR100583987B1 (ko) 정보 수집 로봇
KR102225456B1 (ko) 로드 메이트 시스템 및 로드 메이트 서비스 제공 방법
Choraś et al. Innovative solutions for inclusion of totally blind people
JP5909984B2 (ja) マップ作成システムおよびマップ作成装置
de Ipiña et al. Interacting with our environment through sentient mobile phones
Choraś et al. Innovative solutions for totally blind people inclusion
KR101442005B1 (ko) 영상정보를 이용한 안내 메시지 방송장치 및 그 방법
Paul et al. Smart Support System for Navigation of Visually Challenged Person Using IOT
WO2010087562A1 (fr) Procédé d'exploitation d'un serveur pour fournir des informations relatives à l'état émotionnel d'un utilisateur
KR20210107556A (ko) 영상기반 얼굴 인식, 건강 체크 및 위치 추적 시스템
CN111479060A (zh) 图像采集方法、装置、存储介质及电子设备
KR20130088969A (ko) 단말기, 이와 연계된 주변정보 자동안내 서비스 시스템 및 방법
KR20150020811A (ko) 열 화상 카메라를 이용하는 사물 찾기 시스템 및 사물 찾기 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19803626

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19803626

Country of ref document: EP

Kind code of ref document: A1