WO2016008210A1 - 一种通信终端及安装于移动终端的工具 - Google Patents

一种通信终端及安装于移动终端的工具 Download PDF

Info

Publication number
WO2016008210A1
WO2016008210A1 PCT/CN2014/086577 CN2014086577W WO2016008210A1 WO 2016008210 A1 WO2016008210 A1 WO 2016008210A1 CN 2014086577 W CN2014086577 W CN 2014086577W WO 2016008210 A1 WO2016008210 A1 WO 2016008210A1
Authority
WO
WIPO (PCT)
Prior art keywords
network
communication terminal
communication
trusted user
audio
Prior art date
Application number
PCT/CN2014/086577
Other languages
English (en)
French (fr)
Inventor
宋晨枫
Original Assignee
北京小鱼儿科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京小鱼儿科技有限公司 filed Critical 北京小鱼儿科技有限公司
Priority to US15/326,246 priority Critical patent/US20180131899A1/en
Publication of WO2016008210A1 publication Critical patent/WO2016008210A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10Architectures or entities
    • H04L65/1059End-user terminal functionalities specially adapted for real-time communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1096Supplementary features, e.g. call forwarding or call holding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/22Arrangements for supervision, monitoring or testing
    • H04M3/2281Call monitoring, e.g. for law enforcement purposes; Call tracing; Detection or prevention of malicious calls
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/44Event detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2203/00Aspects of automatic or semi-automatic exchanges
    • H04M2203/60Aspects of automatic or semi-automatic exchanges related to security aspects in telephonic communication systems
    • H04M2203/6054Biometric subscriber identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N2007/145Handheld terminals

Definitions

  • the present invention relates to communication technologies, and in particular, to a communication terminal and a tool installed on the mobile terminal.
  • the existing communication terminal can only provide communication services, and cannot provide monitoring and automatically remind the user of monitoring one party, such as a stranger at home, an old man falls, a water pipe burst in the bathroom, etc. These events are for monitoring one party. For the user, it is necessary to know in time to respond to these events in a timely manner. Further, even if the user of the monitoring party is notified when these events occur, the user of the monitoring party may not receive the alert due to network conditions or the like.
  • One of the technical problems to be solved by the present invention is that the terminal of the monitored party can promptly send the reminder to the user of the monitoring party regardless of the network environment in which the user of the monitoring party is located.
  • a communication terminal including a camera, an audio collection unit, and a transceiver, wherein the transceiver recognizes a person in response to video and audio collected from the camera and the audio collection unit. Or a specific person, a specific action, or an abnormal situation, obtaining information of a network currently available to the trusted user, and according to the obtained information of the currently available network of the trusted user, the transceiver sends the reminder information to the trusted user through the corresponding network.
  • the trusted user acquired by the transceiver is currently available
  • the information of the used network indicates that the IP network is available, and the reminder information is sent to the trusted user through the IP network.
  • the reminder information is sent to the trusted user over the telecommunications network.
  • the transceiver automatically issues a response to the connection request in response to receiving the first connection request from the trusted user through the first network, thereby automatically establishing the first pass with the trusted user.
  • the first communication of the network
  • the transceiver if the transceiver receives a connection request for the second communication by the trusted user through the second network in the event that the first communication with the trusted user through the first network is interrupted, the automatic transmission is automatically issued to the The response to the request is connected, thereby automatically establishing a second communication with the trusted user through the second network.
  • the communication terminal provided by the present invention further comprises a display and a speaker, wherein in the process of communicating with the trusted user, in the case that the transceiver establishes IP communication or 3G/4G communication with the trusted user, the display uses To display the video received by the transceiver from a trusted user, the speaker is used to output the audio received by the transceiver from the trusted user; in the case that the transceiver establishes 2G communication with the trusted user, the speaker is used Output audio received by the transceiver from a trusted user.
  • the transceiver in the process of communicating with a trusted user, in the case where the transceiver establishes IP communication or 3G/4G communication with a trusted user, the transceiver transmits a camera to the trusted user, The audio and video collected by the audio collection unit; in the case where the transceiver establishes 2G communication with the trusted user, the transceiver only transmits the audio collected by the audio collection unit to the trusted user.
  • the display simultaneously displays video from a plurality of trusted users.
  • the transceiver in response to one or more of the videos of the plurality of trusted users being selected, disconnects communication with a trusted user corresponding to the one or more videos, Or the speaker does not output a trusted one corresponding to the one or more videos The voice of the household.
  • the video of the selected trusted user in response to one of the videos of the plurality of trusted users being selected, the video of the selected trusted user becomes the enlarged home screen.
  • the person or person is identified based on one or more of face recognition, height recognition, voice recognition.
  • the communication terminal provided by the present invention further includes a depth sensor, and the specific action is based on depth recognition of the video, audio, and depth sensor sensed by the camera and the audio collection unit respectively.
  • the abnormal condition is identified by identifying one or more of the following:
  • a predetermined event recognized by the video and audio collected by the camera and the audio collection unit wherein the model of the predetermined event is established in advance, and is searched and established by using video and audio respectively collected by the camera and the audio collection unit.
  • the model matches the events to identify the scheduled event.
  • a communication terminal provided by the present invention further includes: a rotating device that rotates the camera.
  • the rotating device in response to recognizing one of the following elements from the video and audio respectively captured by the camera and the audio collection unit, rotates the camera in a direction facing the identified element:
  • the communication terminal provided by the present invention further includes a light sensor for sensing ambient light changes around the communication terminal, wherein the display brightness of the display is adjusted according to the sensed change of the light.
  • a tool installed on a mobile terminal including:
  • a sending unit configured to detect, in response to the first trigger, a network currently available to the mobile terminal, and send a connection request for the specific communication terminal through the corresponding network according to the network currently available to the mobile terminal;
  • a receiving unit configured to receive an automatic response from the specific communication terminal to automatically establish communication with the specific communication terminal
  • the transmitting unit After establishing communication with the specific communication terminal, the transmitting unit detects the network currently available to the mobile terminal in response to the network currently communicating with the specific communication terminal becoming unavailable, and automatically detects the network currently available to the mobile terminal, automatically passing the network currently available to the mobile terminal. The corresponding network resends the connection request for the specific communication terminal.
  • the transmitting unit detects that the IP network is available in response to the first trigger, a connection request for the specific communication terminal is transmitted through the IP network.
  • the transmitting unit detects that the IP network is unavailable but the telecommunication network is available in response to the first trigger, the connection request for the specific communication terminal is transmitted through the telecommunication network.
  • the transmitting unit detects that the telecommunication network is available in response to the IP network currently communicating with the specific communication terminal, it is detected that the connection request for the specific communication terminal is automatically retransmitted through the telecommunication network.
  • the transmitting unit transmits the mobile terminal to the specific communication terminal in response to the network currently communicating with the specific communication terminal being an IP network or a 3G network.
  • the acquired video and audio, in response to the current communication with the specific communication terminal, is a 2G network, and the audio collected by the mobile terminal is transmitted to the specific communication terminal.
  • the receiving unit receives the source from the specific communication terminal in response to the network currently communicating with the specific communication terminal being an IP network or a 3G network.
  • the view and audio of the specific communication terminal in response to the network currently communicating with the particular communication terminal being a 2G network, receiving audio from the particular communication terminal from the particular communication terminal.
  • the communication terminal provided by one embodiment of the present invention can send reminder information to the trusted user according to the network information currently available to the trusted user when identifying the person or the specific person, the specific action, or the abnormal condition.
  • the communication terminal can send reminder information to the trusted user according to the network information currently available to the trusted user when identifying the person or the specific person, the specific action, or the abnormal condition.
  • it is possible to be notified in time to the occurrence of the location or/and the occurrence of the person and/or abnormal condition at the place where the communication terminal is located, so as to more conveniently locate the communication terminal.
  • On-site monitoring is performed.
  • the monitoring party can actively connect to the monitored terminal in any network environment to perform two-way video communication.
  • the transceiver can support both IP networks and telecommunications networks.
  • the communication terminal provided by one embodiment of the present invention informs the trusted user of the reminder information through the IP network when the information of the network currently available to the trusted user indicates that the IP network is available, thereby, when the trusted user is currently available, When there is an IP network in the network information, regardless of whether there is an available telecommunication network at this time, the reminder information is sent to the trusted user through the IP network.
  • the communication terminal provided by the present invention is usually in an environment of an IP network (such as a home), and a trusted user (a user monitoring a party) may be in an IP network, or may be in a network such as 3G or 2G, in any case, IP.
  • the cost of network call is low.
  • the trusted user is called through the IP network. If the user fails to switch to another network, the beneficial effect of reducing the communication cost is achieved.
  • the communication terminal provided by one embodiment of the present invention automatically receives a connection request sent by the trusted user regardless of the connection request from any network, the communication terminal automatically sends a connection request to the trusted user, and the user next to the communication terminal does not need to perform the connection request.
  • Manual confirmation In this way, for example, the trusted user (the user monitoring the party) is first in the wifi network and communicates with the communication terminal at home.
  • the trusted client automatically re-initiates the connection request through the 3G network, due to the home.
  • the communication terminal is designed to automatically answer, thus re-establishing the 3G connection.
  • the communication from the IP network to the 3G network seems to be seamless, and the communication is achieved.
  • the user next to the terminal does not feel the beneficial effect of the conversion of the network environment in which the trusted user is located.
  • the communication terminal of one embodiment of the present invention automatically issues a response to the connection request in response to receiving the first connection request from the trusted user through the first network, thereby automatically establishing a connection with the trusted user.
  • the beneficial effect that the trusted user can still communicate with the person beside the communication terminal is achieved when the person next to the communication terminal is unable to answer the phone or manually answer.
  • the communication terminal provided by one embodiment of the present invention can also display the video of the trusted user by the display in the case of establishing IP communication or 3G communication with the trusted user, thereby improving the video interaction experience of the user;
  • the audio of the trusted user can also be outputted by the speaker, so that the user can freely select different communication modes for communication according to different communication networks, and the communication is more flexible.
  • the communication terminal provided by one embodiment of the present invention can also simultaneously establish IP or 3G communication with multiple trusted users at the transceiver, the display simultaneously displays videos of multiple trusted users, thereby making the communication terminal
  • the user can simultaneously perform video communication with multiple trusted users, and can simultaneously view real-time scenes of multiple trusted users, and the interactive experience is better.
  • the communication terminal provided by one embodiment of the present invention may also disconnect communication of a trusted user corresponding to the one or more videos in response to one or more videos in the videos of the plurality of trusted users being selected, or
  • the speaker does not output the voice of the trusted user corresponding to the one video or the plurality of videos, so that the user next to the communication terminal can more freely select the beneficial effects of the object to communicate with or talk to, such as the communication terminal at home. Users do not want some trusted users to monitor themselves, this way.
  • the communication terminal provided by one embodiment of the present invention can also change the selected video into an enlarged main picture in response to one of the videos of the plurality of trusted users, thereby realizing the user beside the communication terminal Being able to know the status of all trusted users and highlighting the benefits of communicating with a trusted user at a certain time, both universal and personalized.
  • the communication terminal provided by one embodiment of the present invention can identify a person or a specific person based on one or more of face recognition, height recognition, and voice recognition, that is, comprehensively identifying a person or a specific person through various aspects, the accuracy of the recognition higher.
  • the present invention can also be combined with a depth sensor to identify video and audio, and the accuracy of recognition is significantly improved when the three-dimensional object and motion are recognized due to the depth and depth changes that can be sensed.
  • the communication terminal provided by one embodiment of the present invention can obtain dramatic changes in video captured by the camera, audio collected by the audio collection unit above a certain threshold, and audio collection.
  • an embodiment of the present invention may further include a rotating device for rotating the camera, the camera acquires the field information more comprehensively and flexibly when collecting information.
  • the rotating device can be rotated according to the identified elements, the camera always faces the identified elements, so that the elements recognized in the captured picture are more clearly seen, and the collected content contains more useful information.
  • the communication terminal provided according to an embodiment of the present invention further includes a light sensor, the display brightness of the display is adjusted according to changes in ambient light, so that the user can have a better visual experience by watching the video under different light.
  • the tool installed in the mobile terminal is capable of detecting a network currently available to the mobile terminal in response to the first trigger, transmitting a connection for the specific communication terminal through the corresponding network according to the network currently available to the mobile terminal
  • the request in this way, enables a connection request to be made to a specific communication terminal (for example, at home) regardless of the network environment (for example, a wifi environment or a 3G, 2G environment) of the trusted user (the person carrying the mobile terminal), and Automatically establish the benefits of communication.
  • a tool installed in a mobile terminal can detect a network currently available to the mobile terminal in response to the network currently communicating with the specific communication terminal becoming unavailable, according to the network currently available to the mobile terminal Automatically resending the connection request for the specific communication terminal through the corresponding network, so that, for example, when the user carrying the mobile terminal enters, for example, a 3G, 2G network coverage area, etc.
  • the wifi network coverage area by automatically detecting the available network and Selecting the corresponding network to re-establish the connection, the user carrying the mobile terminal can automatically send a connection request to the specific communication terminal without manual dialing, thereby seamlessly switching the communication (for the user carrying the mobile terminal, it seems that there is no feeling The beneficial effects of changes to the network environment).
  • the present invention it is possible to decide whether to perform video and audio communication with a specific communication terminal or only audio in response to whether the network currently communicating with the specific communication terminal is an IP network or a 3G network or a 2G network. Communication, because the 2G network cannot transmit video, Therefore, it is first determined whether the network currently communicating with the specific communication terminal is an IP network or a 3G network or a 2G network, and then performs corresponding communication, thereby achieving the beneficial effect of not wasting communication resources.
  • FIG. 1 shows a schematic block diagram of a communication terminal in accordance with one embodiment of the present invention
  • FIG. 2 is a schematic diagram of a communication terminal transmitting reminder information to a trusted user through a handover network according to an embodiment of the present invention
  • 3(a) and 3(b) respectively show an external front view and an external side view of a communication terminal according to an embodiment of the present invention
  • FIG. 4 shows a schematic block diagram of a tool installed on a mobile terminal in accordance with one embodiment of the present invention
  • Fig. 1 shows a schematic block diagram of a communication terminal 1 according to an embodiment of the present invention.
  • the communication terminal 1 includes a camera 101, an audio collection unit 102, and a transceiver 105.
  • the transceiver 105 recognizes a person or a specific person, a specific action in response to audio and video collected from the camera 101 and the audio collection unit 102. Or abnormal conditions, obtaining information about the currently available network of the trusted user, according to the obtained information of the currently available network of the trusted user, according to the obtained information of the currently available network of the trusted user, the transceiver 105 passes the corresponding The network sends reminders to trusted users.
  • the block diagrams shown in FIG. 1 are for illustrative purposes only and are not intended to limit the scope of the invention. In some cases, certain units or devices may be added or removed as appropriate.
  • the camera 101 is only used as an example, and any device having a video capture function can be applied to the present invention, such as a camera, which is not limited herein.
  • the audio collection unit 102 includes any device having an audio capture function, such as a recording unit.
  • the transceiver 105 such as an antenna, may also be other transceiver devices, such as a built-in wireless transceiver module that supports wifi and telecommunications networks.
  • the specific person may be preset and stored by the user in the communication terminal, such as an elderly person, a child, or the like at home, such as stranger visit, fire, crying, noise, electrical accident, etc. Wait.
  • the trusted user may be preset by the user of the communication terminal, or may be set and adjusted by the communication terminal according to factors such as the frequency of communication, such as setting the frequently-connected friends and relatives as trusted users.
  • the network information currently available to the trusted user mainly includes the currently available network type, network speed, network address, and the like.
  • the network types mainly include IP networks and telecommunication networks, and the telecommunication networks are further divided into 3G and 2G.
  • the sending of the reminding information to the trusted user may be performed by one or more methods, such as a short message, a WeChat, or a specific application message, which is not limited herein.
  • the communication terminal 1 includes, but is not limited to, any electronic product that can interact with a user through a touch pad, a voice control device, a remote control device, or a keyboard, such as a computer, a tablet (PAD), or a network television (IPTV) and the like, those skilled in the art should understand that other user equipments, as applicable to the present invention, are also included in the scope of the present invention.
  • the transceiver 105 is The obtained network information currently available to the trusted user actively sends a reminder message to the trusted user at the other end through the corresponding network, and informs the other end of the trusted user that someone in the current environment appears.
  • the babysitter is always at home, and at this time, the child's millet comes back from school, and the communication terminal 1 recognizes that the child is a millet through the camera 101 and the audio collection unit 102. Then, the transceiver 105 sends the reminder information to the trusted user at the other end in time or in real time through the corresponding network according to the acquired network information currently available to the trusted user.
  • the camera 101 and the audio collection unit 102 recognize an action such as an old man's fall based on the collected video and audio, and the child dances.
  • the action or the like is sent by the transceiver 105 to the user at the other end through the corresponding network according to the obtained network information currently available to the trusted user.
  • an abnormal situation such as a stranger's visit, a fire, a cry, a noise, an electrical accident, and the like are recognized by the video and audio collected by the camera 101 and the audio collection unit 102, and are transmitted and received.
  • the gateway 105 actively sends the reminder information to the user at the other end through the corresponding network according to the obtained network information currently available to the trusted user.
  • the information of the network currently available to the trusted user acquired by the transceiver 105 indicates that the IP network is available, ie in this case, whether or not the network information currently available to the trusted user is in addition to the IP network
  • Other networks such as telecommunications networks, are preferred to send reminders to trusted users over IP networks. Since the communication terminal 1 is normally in a place such as a home, an office, etc., the IP network of the communication terminal 1 is usually kept available, and thus the communication terminal 1 directly sends a reminder message to the trusted user through the IP network, which can be quickly established and The communication connection of the trusted user can effectively improve the communication efficiency.
  • FIG. 2 is a schematic diagram of a communication terminal transmitting reminder information to a trusted user through a handover network according to an embodiment of the present invention.
  • the trusted user is in the wifi service area
  • the communication terminal knows by, for example, checking the online status of the trusted user displayed on the IP server side (online indicates that it is in the wifi service area, and offline indicates that it is not in the wifi service area)
  • the reminder information is sent to the trusted user via the IP network via the IP server.
  • the trusted user out of the wifi service area can trust the user's current IP network to be unavailable (as shown by the dotted line in Figure 2, the symbol "X" indicates unavailable) but the telecommunication network is available ( Figure 2 In the middle line), the communication terminal 1 obtains this information, for example, by viewing the online status of the trusted user displayed on the IP server side, or directly through the telecommunication network via the telecommunication network or through the IP network to the telecommunication network (not shown) Sending the reminding information to the trusted user.
  • the communication terminal provided in this embodiment can adapt to sending the reminding information to the trusted user in different network environments in time to avoid being unable to be in other network environments due to the limitation of the single communication mode.
  • the communication in turn causes the reminder information not to reach the trusted user in time.
  • the communication terminal 1 provided by the present invention can automatically issue a connection to the connection through the transceiver 105 in response to receiving the first connection request from the trusted user through the first network. Acquiring a response, thereby automatically establishing a first communication with the trusted user through the first network, thereby automatically establishing communication with the trusted user automatically without manual confirmation, and reaching a situation when the person next to the communication terminal cannot connect.
  • the first network includes an IP network, a telecommunication network, and the like, which are not limited herein.
  • the transceiver 105 receives a connection request from the trusted user to perform the second communication through the second network if the first communication of the trusted user is interrupted by the first network, and may also automatically issue a response to the connection request. Thereby a second communication with the trusted user through the second network is automatically established.
  • the second network may be different from the first network.
  • the second network may also include, for example, an IP network, a telecommunication network, and the like, which are not limited herein.
  • the continuity of communication is extremely important to the user, and the communication terminal provided by the embodiment of the present invention can make the user completely
  • the communication process of switching from the first network communication that has been interrupted to the communication of the second network is not felt, and the continuity of the communication is good.
  • the trusted user moves from the wifi coverage area to the non-wifi coverage area, at which time the trusted user's mobile terminal automatically detects the network environment change, thereby automatically resending the connection request to the communication terminal through the telecommunication network.
  • the communication terminal receives the connection request automatic response, thereby establishing a new communication, and for both ends of the user, they are not aware of the process of switching in between, and the communication is perceived to be seamless. This effect is not achieved if the user next to the communication terminal needs a manual response.
  • the communication terminal 1 may further include a display 103 and a speaker 104, in the process of communicating with the trusted user, in the case where the transceiver 105 establishes IP communication or 3G communication with the trusted user.
  • the display 103 is used to display the video received by the transceiver 105 from the trusted user, and the speaker 104 is used to output the audio received by the transceiver 105 from the trusted user.
  • the display 103 can not only display the video of the trusted user, but also display other content such as the identifier corresponding to the video, for example, corresponding to the video. Czech style icon.
  • the speaker 104 can output audio from the trusted user received by the transceiver 105. Therefore, for different communication modes, the communication terminal 1 can output the communication content corresponding thereto, and in the IP or 3G communication mode with high communication rate, the video communication with strong on-site interaction is preferentially adopted, and the communication rate is low. In the 2G communication mode, in order to maintain communication quality, audio communication that can significantly save traffic is preferred.
  • the display 103 simultaneously displays videos from a plurality of trusted users, just as the user of the communication terminal 1 opens and multiple A window in which trusted users can communicate, and can simultaneously follow the live of multiple trusted users.
  • the communication terminal 1 performs IP communication, 3G communication or 2G communication with a single trusted user
  • end-to-end direct communication is adopted, and the server is redirected when performing IP communication, 3G communication or 2G communication with multiple users. Communicating, this flexible communication mode enables the communication terminal 1 to effectively avoid waste of server resources when communicating with a single user, and enables the communication terminal 1 to forward data through the server when communicating with multiple users, faster Transfer large amounts of data more accurately.
  • the transceiver 105 can also disconnect communication of a trusted user corresponding to the one or more videos, or a speaker, in response to one or more of the videos of the plurality of trusted users being selected 104 does not output the voice of a trusted user corresponding to the one or more videos.
  • the user of the communication terminal can freely select the object of communication as needed, or freely choose to hear or not hear the voice of the other party.
  • the communication terminal 1 may also be responsive to one of the videos of the plurality of trusted users, the video of the selected trusted user becoming the enlarged main picture, thereby highlighting the user of the communication terminal 1 Communication with key objects.
  • the communication terminal 1 in the process of transmitting the information, the communication terminal 1 establishes IP communication with the trusted user or in the process of communicating with the trusted user.
  • the transceiver sends the video and audio collected by the camera 101 and the audio collection unit 102 to the trusted user; in the case where the transceiver 105 establishes 2G communication with the trusted user, the transceiver only The trusted user sends the audio collected by the audio collection unit 102.
  • the communication terminal 1 can adjust the type of information received or transmitted according to different networks, and the types of information herein mainly refer to video and audio.
  • the identification of the person or the specific person by the communication terminal 1 can be identified based on one or more of face recognition, height recognition, and voice recognition.
  • the manner in which the communication terminal 1 recognizes a person or a specific person is not limited, and any device or unit having an identification person or a specific person, as applicable to the present invention, should be included in the scope of protection of the present invention, and The reference is included here.
  • the audio collection unit 102 collects The audio to which it arrives is also within a certain range, and the presence of a person can be recognized.
  • the mode and/or height and/or sound frequency of the face of the specific person may be stored in advance in the memory.
  • the mode and/or height and/or sound frequency of the face of the specific person may be stored in advance in the memory.
  • Self-learning methods can also be used to identify the presence of a person or a specific person. For example, if a certain mode in the captured image always coincides with a certain frequency of the collected sound, a prompt may be displayed on the display, that is, the person is recognized, and the person next to the communication terminal 1 is judged and named. If the person next to the communication terminal 1 finds an identification error, it feeds back on the interface of the display. Upon receiving such feedback, a person or a specific person is not considered to be present when such a pattern in the next captured image coincides with such a frequency of the collected sound. In the self-learning mode, the mode and/or height and/or sound frequency of the face of the specific person may not be stored in the memory in advance.
  • the communication terminal 1 is a Bluetooth device, and the trusted user's mobile phone also has a Bluetooth wireless unit.
  • the communication terminal 1 recognizes that the Bluetooth wireless unit of a specific identity appears within a certain distance, it is considered that a specific person is recognized.
  • the communication terminal 1 can also identify a specific action based on the collected video and audio through the camera 101 and the audio collection unit 102, for example, identifying an action of the old man falling, small The action of the child dancing, etc., and the transceiver 105 actively sends reminder information to the trusted user at the other end.
  • the model can be manually set in advance and based on the set action.
  • the transceiver 105 actively sends the reminder information to the trusted user at the other end. For example, for an action such as watching TV, create a model: identify a person sitting on the sofa; follow the person's gaze direction, have an object; recognize that the object is a TV; the person stays on the TV At least 10 seconds.
  • the recognition of the sofa is similar to face recognition, it can also be performed by pattern matching, and the image of the person sitting on the sofa as a whole can also be regarded as one
  • the object performs pattern matching recognition, and then detects the person's gaze direction, and then detects whether the object in the direction of the person's gaze is a television (for example, pattern matching the television as an object), and if so, counts for 10 seconds.
  • the communication terminal 1 can also automatically establish an action model by means of self-learning such as machine learning.
  • the communication terminal 1 extracts an action feature from the video and audio collected by the camera 101 and the audio collection unit 102, and establishes an action model based on the extracted feature.
  • the communication terminal 1 extracts an action feature from the video and audio collected by the camera 101 and the audio collection unit 102, and establishes an action model based on the extracted feature.
  • the action model may not be stored in the database in advance, but the model of the action is extracted in a learning manner based on the view and audio collected from the camera 101 and the audio collection unit 102.
  • FIG. 3(a) shows an external front view of a communication terminal in accordance with one embodiment of the present invention.
  • the communication terminal 1 in order to more accurately identify a specific action when identifying a specific action, the communication terminal 1 further includes a depth sensor 197, based on the captured video and audio by the camera 101, the audio collecting unit 102, and the depth sensor 197. And the depth of the sensing collectively identifies a particular action.
  • the position of the depth sensor 197 is only for the sake of example, which may also be located at other reasonable locations of the communication terminal 1, and is not limited thereto.
  • the positions of other devices or components shown in FIG. 3(a) are also for illustrative purposes only and will not be described again.
  • the communication terminal 1 can recognize by recognizing one or more of the following:
  • the model of the predetermined event is established in advance, and is obtained from the video and audio collected by the camera 101 and the audio collection unit 102 respectively. Search for events that match the established model to identify a predetermined event.
  • the communication terminal 1 recognizes a predetermined event based on the camera 101 and the audio collection unit 102, wherein the model of the predetermined event is established in advance, and the video and audio collected by the camera 101 and the audio collection unit 102 are respectively collected. Search for events that match the established model to identify the scheduled event.
  • the communication terminal 1 can automatically establish a model of a predetermined event by means of self-learning such as machine learning.
  • the communication terminal 1 extracts event features from the video and audio collected by the camera 101 and the audio collection unit 102, and builds a model of a predetermined event based on the extracted event features, classifies various events, and obtains training parameters. Thereby a predetermined event is identified.
  • FIG. 3(b) shows an external side view of a communication terminal in accordance with one embodiment of the present invention.
  • the communication terminal 1 in order to collect audio and video in multiple angles and in multiple directions, the communication terminal 1 further includes a rotating device 199 for rotating the camera.
  • the rotating device 199 in order to collect more useful information when collecting information, in response to recognizing one of the following elements from the video and audio respectively collected by the camera 101 and the audio collection unit 102, the rotating device 199 causes the camera 101 to face the camera. Rotate the direction of the identified element:
  • the communication terminal 1 may further include a light sensor 198 for sensing. Ambient light changes around the communication terminal 1, the display 103 The display brightness is adjusted according to the sensed light change.
  • FIG. 4 shows a schematic block diagram of a tool 31 mounted to the mobile terminal 3 according to an embodiment of the present invention.
  • the tool 31 installed in the mobile terminal 3 comprises:
  • the sending unit 301 is configured to detect, according to the first trigger, a network currently available to the mobile terminal 3, and send a connection request for the specific communication terminal through the corresponding network according to the network currently available to the mobile terminal 3;
  • the receiving unit 302 is configured to receive an automatic response from the specific communication terminal, thereby automatically establishing communication with the specific communication terminal, wherein
  • the transmitting unit 301 After establishing communication with the specific communication terminal, the transmitting unit 301 detects the network currently available to the mobile terminal 3 in response to the network currently communicating with the specific communication terminal becoming unavailable, according to the network currently available to the mobile terminal 3. , automatically send a connection request for a specific communication terminal through the corresponding network.
  • the tool installed on the mobile terminal 3 is installed on the mobile terminal, for example, in the form of an application (app), and is displayed in the form of a corresponding application icon.
  • the opening in response to the first trigger such as in response to activation of the mobile terminal 3 or in response to activation of the tool 31 after the mobile terminal 3 is powered on, such as by responding to a user's click, double tap, long It is carried out in any one or combination.
  • the currently available network generally refers to an IP network, a telecommunications network, and the like.
  • the specific communication terminal is not limited herein, and may refer to the communication terminal 1 described above, and may also refer to any other terminal having a communication function.
  • the specific communication terminal may be a terminal that has established a binding relationship with the mobile terminal 3 before the tool 31 detects the currently available network, and thus after the sending unit 301 detects the current network, directly through the corresponding network.
  • the target terminal that has established the binding relationship sends a connection request.
  • the transmitting unit 301 detects that the IP network is available in response to the first trigger, and transmits a connection request for the specific communication terminal through the IP network (of course, if the transmitting unit 301 detects that the IP network is unavailable at this time)
  • a telecommunications network is available to send a connection request for a particular communication terminal over the telecommunications network.
  • the mobile terminal 3 Upon receiving an automatic response from the specific communication terminal, the mobile terminal 3 performs IP communication with the specific communication terminal.
  • the user (trusted user) carrying the mobile terminal 3 at the time of communication moves out of the wifi service area.
  • the sending unit 301 detects that, for example, the 3G network is available, and automatically sends a connection request to the specific communication terminal through the 3G network (either directly or through the 3G server), receives an automatic response of the specific communication terminal, and establishes communication with the specific mobile terminal. Therefore, since the switching of the network is automatically performed at the time of connection, it is not possible for both users to transmit the connection request through the telecommunication network after the interruption of the IP network, and the continuous experience of communication is better.
  • the connection request to the specific communication terminal is preferentially transmitted through the IP network, thereby being more cost-effectively connected to the usual A specific communication terminal located in a fixed location and placed in an IP network environment.
  • the transmitting unit 301 of the present embodiment can easily transmit a connection request to a specific communication terminal in the case where the telecommunication network is detected.
  • the sending unit 301 responds to the network currently communicating with the specific communication terminal as an IP network or a 3G network, to the specific communication terminal.
  • the video and audio collected by the mobile terminal 3 are transmitted, and in response to the network currently communicating with the specific communication terminal being a 2G network, the audio collected by the mobile terminal 3 is transmitted to the specific communication terminal.
  • the receiving unit 302 upon receiving information, after establishing communication with the specific communication terminal, responds to the network currently communicating with the specific communication terminal as an IP network or a 3G network receiving, from the specific communication terminal, video and audio from the specific communication terminal; in response to the network currently communicating with the specific communication terminal being a 2G network, receiving from the specific communication terminal from the specific communication terminal Audio.
  • the present invention can be implemented as a device, apparatus, method, or computer program product. Therefore, the present disclosure may be embodied in the following forms, that is, it may be complete hardware, full software, or a combination of hardware and software.
  • each block of the flowchart or block diagram can represent a module, a program segment, or a portion of code that includes one or more of the Executable instructions.
  • the boxes are labeled
  • the functions may also occur in an order different from that noted in the drawings. For example, two consecutive blocks may be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts can be implemented in a dedicated hardware-based system that performs the specified function or operation. Or it can be implemented by a combination of dedicated hardware and computer instructions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • Technology Law (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本发明公开了一种通信终端及安装于移动终端的工具,其中,通信终端包括摄像机、音频采集单元以及收发信机,其中收发信机响应于从摄像机、音频采集单元采集的视、音频中识别出人或特定人、特定动作、或异常状况,获取可信任用户当前可用的网络的信息,根据所获取的可信任用户当前可用的网络的信息,收发信机通过相应的网络向可信任用户发送提醒信息。与现有技术相比,本发明使得无论监视一方的用户处于何种网络环境,被监视终端都能将提醒及时发给监视一方的用户;并允许监视一方在任意网络环境下均可主动连接被监视终端,进行双向的视频通信。

Description

一种通信终端及安装于移动终端的工具
本申请要求了2014年7月15日提交的、申请号为201410337297.0、发明名称为“一种通信终端及安装于移动终端的工具”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及通信技术,尤其涉及一种通信终端及安装于移动终端的工具。
背景技术
现有的通信终端仅能提供通信服务,不能提供监视并自动提醒监视一方的用户的功能,例如家里来陌生人了、老人摔倒了,卫生间的水管爆裂了等等,这些事件对于监视一方的用户来说,都是很有必要及时知晓的,以便及时对这些事件做出反应。另外,即使当发生这些事件时通知监视一方的用户,监视一方的用户也由于网络条件等,有时接不到该提醒。
反过来,当监视一方用户呼叫通信终端时也是如此。由于网络条件变化等,经常发生通信中断,使得监视一方不得不重新由人工再次呼叫通信终端。
发明内容
本发明解决的技术问题之一是将使得无论监视一方的用户处于何种网络环境,被监视一方的终端都能将提醒及时发给监视一方的用户。
根据本发明的一个方面的一个实施例,提供了一种通信终端,包括摄像机、音频采集单元以及收发信机,其中收发信机响应于从摄像机、音频采集单元采集的视、音频中识别出人或特定人、特定动作、或异常状况,获取可信任用户当前可用的网络的信息,根据所获取的可信任用户当前可用的网络的信息,收发信机通过相应的网络向可信任用户发送提醒信息。
根据本发明的一个实施例,如果收发信机获取的可信任用户当前可 用的网络的信息指示IP网络可用,通过IP网络向可信任用户发送提醒信息。
根据本发明的一个实施例,如果收发信机获取的可信任用户当前可用的网络的信息指示IP网络不可用但电信网络可用,通过电信网络向可信任用户发送提醒信息。
根据本发明的一个实施例,收发信机响应于接收到来自可信任用户的通过第一网络的第一连接请求,自动发出对该连接请求的应答,从而自动建立与可信任用户的通过第一网络的第一通信。
根据本发明的一个实施例,如果收发信机在与可信任用户通过第一网络的第一通信中断的情况下接收到可信任用户通过第二网络进行第二通信的连接请求,自动发出对该连接请求的应答,从而自动建立与可信任用户的通过第二网络的第二通信。
优选地,本发明提供的通信终端还包括显示器和扬声器,其中在与可信任用户通信的过程中,在收发信机建立了与可信任用户的IP通信或3G/4G通信的情况下,显示器用来显示收发信机接收的来自可信任用户的视频,扬声器用来输出收发信机接收的来自可信任用户的音频;在收发信机建立了与可信任用户的2G通信的情况下,扬声器用来输出收发信机接收的来自可信任用户的音频。
根据本发明的一个实施例,在与可信任用户通信的过程中,在收发信机建立了与可信任用户的IP通信或3G/4G通信的情况下,收发信机向可信任用户发送摄像机、音频采集单元采集的视、音频;在收发信机建立了与可信任用户的2G通信的情况下,收发信机仅向可信任用户发送音频采集单元采集的音频。
根据本发明的一个实施例,在收发信机同时建立了与多个可信任用户的IP或3G/4G通信的情况下,显示器同时显示来自多个可信任用户的视频。
根据本发明的一个实施例,响应于所述多个可信任用户的视频中的一个或多个视频被选择,收发信机断开与所述一个或多个视频对应的可信任用户的通信,或者扬声器不输出与所述一个或多个视频对应的可信任用 户的声音。
根据本发明的一个实施例,响应于所述多个可信任用户的视频中的一个被选择,被选择的可信任用户的视频变为放大的主画面。
根据本发明的一个实施例,人或特定人是基于人脸识别、身高识别、声音识别中的一个或多个来识别的。
根据本发明的一个实施例,本发明提供的通信终端还包括深度传感器,所述特定动作是基于摄像机、音频采集单元分别采集到的视、音频以及深度传感器感测的深度识别的。
根据本发明的一个实施例,所述异常状况是通过识别出以下中的一种或多种识别的:
摄像机采集到的视频的剧烈变化;
音频采集单元采集到的高于特定阈值的音频;
音频采集单元采集到的音频的剧烈变化;
基于摄像机、音频采集单元分别采集到的视、音频识别出的预定事件,其中该预定事件的模型事先已建立,并通过从基于摄像机、音频采集单元分别采集到的视、音频中搜索与建立的模型相匹配的事件,从而识别预定事件。
根据本发明的一个实施例,本发明提供的通信终端还包括:使摄像机转动的转动装置。
根据本发明的一个实施例,响应于从摄像机、音频采集单元分别采集到的视、音频中识别出以下要素中的一个,转动装置使摄像机向着面对识别出的要素的方向转动:
人或特定人;
特定动作;
异常状况。
根据本发明的一个实施例,本发明提供的通信终端还包括光线传感器,用于感测通信终端周围环境光线变化,其中显示器的显示亮度是根据感测到的所述光线的变化调整的。
根据本发明的另一方面的一个实施例,还提供了一种安装于移动终端的工具,包括:
发送单元,被配置为响应于第一触发,检测移动终端当前可用的网络,根据移动终端当前可用的网络,通过相应的网络发送针对特定通信终端的连接请求;
接收单元,被配置为接收来自所述特定通信终端的自动应答,从而自动建立与所述特定通信终端的通信,其中
在建立与所述特定通信终端的通信后,发送单元响应于当前与所述特定通信终端通信的网络变得不可用,再次检测移动终端当前可用的网络,根据移动终端当前可用的网络,自动通过相应的网络再发送针对特定通信终端的连接请求。
根据本发明的一个实施例,如果发送单元响应于第一触发,检测到IP网络可用,通过IP网络发送针对特定通信终端的连接请求。
根据本发明的一个实施例,如果发送单元响应于第一触发,检测到IP网络不可用但电信网络可用,通过电信网络发送针对特定通信终端的连接请求。
根据本发明的一个实施例,如果发送单元响应于当前与所述特定通信终端通信的IP网络变得不可用,检测到电信网络可用,自动通过电信网络再发送针对特定通信终端的连接请求。
根据本发明的一个实施例,在建立与所述特定通信终端的通信后,发送单元响应于当前与所述特定通信终端通信的网络是IP网络或3G网络,向所述特定通信终端发送移动终端采集的视、音频,响应于当前与所述特定通信终端通信的网络是2G网络,向所述特定通信终端发送移动终端采集的音频。
根据本发明的一个实施例,在建立与所述特定通信终端的通信后,接收单元响应于当前与所述特定通信终端通信的网络是IP网络或3G网络,从所述特定通信终端接收来自所述特定通信终端的视、音频,响应于当前与所述特定通信终端通信的网络是2G网络,从所述特定通信终端接收来自所述特定通信终端的音频。
由于本发明的一个实施例所提供的通信终端可以在识别出人或特定人、特定动作、或异常状况时,根据可信任用户当前可用的网络信息,向其发送提醒信息。这样,无论可信任用户当前处于何种网络状态,都能够被及时通知到通信终端所处的场所发生的事或/和出现的人和/或异常状况,以更方便地对通信终端所处的现场情况进行监控。同时,监视一方可以在任意网络环境下均可以主动连接被监视终端,进行双向视频通信。另外,收发信机可同时支持IP网络与电信网络。
由于本发明的一个实施例所提供的通信终端在获知可信任用户当前可用的网络的信息指示IP网络可用时,通过IP网络向可信任用户发送提醒信息,由此,当可信任用户当前可用的网络信息中只要存在IP网络时,无论此时是否存在可用的电信网络,都优先通过IP网络向可信任用户发送提醒信息。而实际上,本发明提供的通信终端通常处于IP网络的环境下(如家里),而可信任用户(监视一方的用户)可能处于IP网络,也可能处于3G、2G等网络,无论如何,IP网络呼叫成本低,先通过IP网络呼叫可信任用户,如失败再转用其它网络,达到了有利于降低通信成本的有益效果。
由于本发明的一个实施例提供的通信终端只要接收到可信任用户无论通过任何网络发来的连接请求,都自动发出对可信任用户的连接请求的应答,无需通信终端旁的用户对连接请求进行人工确认。这样,例如可信任用户(监视一方的用户)先处于wifi网络,与家里的通信终端进行通信,当可信任用户切换到3G网络时,可信任用户端自动通过3G网络重新发起连接请求,由于家里的通信终端设计成自动应答,这样,重新建立了3G连接,对于家里的通信终端旁的用户来说,这种由IP网络转由3G网络的通信看起来好像是无缝的,达到了使通信终端旁的用户感觉不到可信任用户所处网络环境的转换的有益效果。
另外,由于在某些场景中,例如可信任用户想通知家里人一件事情,但家里人正在专心致志地打毛衣或看书而听不到电话振铃。本发明的一个实施例的通信终端响应于接收到来自可信任用户的通过第一网络的第一连接请求,自动发出对该连接请求的应答,从而自动建立与可信任用户的 通过第一网络的第一通信,这样,达到了当通信终端旁的人无法接电话或人工应答的情况下可信任用户仍然能够与通信终端旁的人通信的有益效果。
由于本发明的一个实施例提供的通信终端还可以在建立与可信任用户的IP通信或3G通信的情况下,由显示器显示可信任用户的视频,提升了用户的视频互动体验;而且,在建立与可信任用户的2G通信的情况下,也可以由扬声器输出可信任用户的音频,从而使得用户可以根据不同的通信网络,自由选择不同的通信方式进行通信,通信更灵活。
由于本发明的一个实施例提供的通信终端还可以在收发信机同时建立了与多个可信任用户的IP或3G通信的情况下,显示器同时显示多个可信任用户的视频,从而使得通信终端的用户可以同时与多个可信任用户进行视频通信,并能同时观看多个可信任用户的实时场景,互动体验更佳。
由于本发明的一个实施例提供的通信终端还可以响应于多个可信任用户的视频中的一个或多个视频被选择,断开与该一个或多个视频对应的可信任用户的通信,或扬声器不输出与该一个视频或多个视频对应的可信任用户的声音,达到了使得通信终端旁的用户可以更自由的选择与之通信或通话的对象的有益效果,例如家里的通信终端旁的用户不希望某些可信任用户监视自己,可以采用这种方式。
由于本发明的一个实施例提供的通信终端还可以响应于多个可信任用户的视频中的一个被选择,将该被选择的视频变为放大的主画面,因而实现了通信终端旁的用户既能知道所有可信任用户的状况又能根据需要在某一时段突出与一个可信任用户的交流的有益效果,既通用又个性化。
由于本发明的一个实施例提供的通信终端可以基于人脸识别、身高识别、声音识别中的一个或多个来识别人或特定人,即通过多方面综合识别人或特定人,识别的准确度更高。另外,本发明还可以结合深度传感器来识别视音频,在识别三维物体及动作时由于可以感测深度和深度变化因而识别的准确度显著提升。
由于本发明的一个实施例提供的通信终端可以通过摄像机采集到的视频的剧烈变化、音频采集单元采集到的高于特定阈值的音频、音频采 集单元采集到的音频的剧烈变化、基于摄像机、音频采集单元分别采集到的视、音频识别出的预定事件等多种因素进行综合识别异常状况,提高了识别异常状况的精度。
再者,由于本发明的一个实施例还可以包括使摄像机转动的转动装置,使得摄像机在采集信息时更全面更灵活地采集现场信息。
由于该转动装置可以根据识别出的元素进行相应地转动,使摄像机始终面对识别的元素,使得采集的画面中识别的元素看得更清楚,所采集的内容中包含的有用信息更多。
由于根据本发明的一个实施例提供的通信终端还包括光线传感器,根据周围环境光线变化来调整显示器的显示亮度,使得用户在不同的光线下观看视频都能具有较佳的视觉体验。
由于本发明的一个实施例的一种安装于移动终端的工具能够响应于第一触发,检测移动终端当前可用的网络,根据移动终端当前可用的网络,通过相应的网络发送针对特定通信终端的连接请求,这样,就实现了无论可信任用户(携带移动终端的人)处于何种网络环境(例如wifi环境或3G、2G环境),都能向特定通信终端(例如在家中)发起连接请求,并自动建立通信的有益效果。
另外,由于本发明的一个实施例的一种安装于移动终端的工具能够响应于当前与特定通信终端通信的网络变得不可用,再次检测移动终端当前可用的网络,根据移动终端当前可用的网络,自动通过相应的网络再发送针对特定通信终端的连接请求,这样,就能够例如当携带移动终端的用户由wifi网络覆盖区进入到例如3G、2G网络覆盖区等,通过自动检测可用的网络并选择相应的网络重新建立连接,达到了携带移动终端的用户无需手动再拨号而能够自动再向特定通信终端发连接请求、从而无缝进行通信切换(对于携带移动终端的用户来说,好像没有感觉到网络环境的变化)的有益效果。
另外,在本发明的一个实施例中,可以响应于当前与所述特定通信终端通信的网络是IP网络或3G网络、还是2G网络,决定与特定通信终端进行视、音频通信,还是只进行音频通信,由于2G网络无法传输视频, 因此先判断当前与所述特定通信终端通信的网络是IP网络或3G网络、还是2G网络,然后再进行相应通信,达到了不浪费通信资源的有益效果。
本领域普通技术人员将了解,虽然下面的详细说明将参考图示实施例、附图进行,但本发明并不仅限于这些实施例。而是,本发明的范围是广泛的,且意在仅通过后附的权利要求限定本发明的范围。
附图说明
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:
图1示出根据本发明一个实施例的通信终端的示意性框图;
图2示出了根据本发明一个实施例的通信终端通过切换网络向可信任用户发送提醒信息的示意图;
图3(a)和图3(b)分别示出了根据本发明一个实施例的通信终端的外部正视图和外部侧视图;
图4示出了根据本发明一个实施例的安装于移动终端的工具的示意性框图;
附图中相同或相似的附图标记代表相同或相似的部件。
具体实施方式
下面结合附图对本发明作进一步详细描述。
图1示出了根据本发明一个实施例的通信终端1的示意性框图。根据图1,通信终端1包括摄像机101、音频采集单元102以及收发信机105,其中收发信机105响应于从摄像机101、音频采集单元102采集的音视频中识别出人或特定人、特定动作、或异常状况,获取可信任用户当前可用的网络的信息,根据所获取的可信任用户当前可用的网络的信息,根据所获取的可信任用户当前可用的网络的信息,收发信机105通过相应的网络向可信任用户发送提醒信息。应当理解,图1所示的框图仅仅是为了示例的目的,而不是对本发明范围的限制。在某些情况下,可以根据具体情况增加或减少某些单元或装置。
在此,摄像机101仅用于示例,任何具有视频采集功能的装置都可适用于本发明,例如摄像头,在此不作限定。音频采集单元102包括任何具有音频采集功能的装置,诸如录音单元。收发信机105例如天线,也可以是其他收发设备,例如内置的支持wifi与电信网络的无线收发模块。
在此,所述特定人可以由用户预先设定并存储在所述通信终端,诸如家里的老人、小孩等,所述异常情况诸如陌生人到访、失火、哭声、吵闹声、电器事故等等。所述可信任用户可以由通信终端的用户预先设定,也可以由所述通信终端根据通信频次等因素进行设定和调整,诸如将频繁通信的亲友设定为可信任用户。所述可信任用户当前可用的网络信息主要包括当前可用的网络类型、网速、网络地址等。其中的网络类型主要包括IP网络和电信网络,电信网络又分成3G、2G等。所述向可信任用户发送提醒信息可以通过诸如短信、微信、或特定应用消息等一种或多种方式进行,在此不作限定。
在此,所述通信终端1包括但不限于任何一种可与用户通过触摸板、声控设备、遥控设备或键盘等进行人机交互的电子产品,例如计算机、平板电脑(PAD)、网络电视(IPTV)等,本领域技术人员应能理解,其他的用户设备如可适用于本发明,也应包含在本发明保护范围以内。
典型地,针对人的识别而言,当所述通信终端1从无人环境切换到有人环境时,即通过摄像机101、音频采集单元102识别出当前场所出现人时,则由收发信机105根据所获取的可信任用户当前可用的网络信息,通过相应的网络主动向另一端的可信任用户发送提醒信息,告知另一端的可信任用户当前环境中有人出现。
典型地,针对特定人的识别而言,在现实场景中,保姆一直在家里待着,此时孩子小米放学回来了,所述通信终端1通过摄像机101、音频采集单元102识别出小孩是小米,则由收发信机105根据所获取的可信任用户当前可用的网络信息,通过相应的网络及时或实时向另一端的可信任用户发送提醒信息。
典型地,针对特定动作的识别而言,通过摄像机101、音频采集单元102基于所采集到的视、音频识别出诸如老人摔倒的动作、小孩子跳舞 的动作等等,由收发信机105根据所获取的可信任用户当前可用的网络信息,通过相应的网络主动向另一端的用户发送提醒信息。
典型地,针对异常情况的识别而言,通过摄像机101、音频采集单元102所采集的视音频中识别出诸如陌生人到访、失火、哭声、吵闹声、电器事故等等异常状况,由收发信机105根据所获取的可信任用户当前可用的网络信息,通过相应的网络主动向另一端的用户发送提醒信息。
在一个实施例中,如果收发信机105获取的可信任用户当前可用的网络的信息指示IP网络可用,也即在该种情况下,无论可信任用户当前可用的网络信息是否除IP网络外还包括诸如电信网络等其他网络,都优先通过IP网络向可信任用户发送提醒信息。由于通常情况下所述通信终端1都处于诸如家里、办公室等场所,因而通信终端1的IP网络通常保持可用状态,因而通信终端1直接通过IP网络向可信任用户发送提醒信息,可以快速建立与可信任用户的通信连接,从而有效提升通信的效率。
请参考图2,图2示出了根据本发明一个实施例的通信终端通过切换网络向可信任用户发送提醒信息的示意图。根据图2,一开始,可信任用户处于wifi服务区,通信终端通过例如查看IP服务器端显示的可信任用户的在线状态(在线表示处于wifi服务区,不在线表示不在wifi服务区)得知可信任用户处于wifi服务区,则经由IP服务器通过IP网络向可信任用户发送提醒信息。随着可信任用户的移动,可信任用户出了wifi服务区,即可信任用户当前的IP网络不可用(如图2中的虚线,符号“X”表示不可用)但是电信网络可用(图2中的实线)时,通信终端1例如通过查看IP服务器端显示的可信任用户的在线状态获取到这一信息,也可以直接经由电信服务器通过电信网络或通过IP网络转电信网络(未示出)向可信任用户发送提醒信息,如此,本实施例提供的通信终端可以适应在不同的网络环境下向可信任用户及时发送提醒信息,避免因单一通信方式的限制而导致在其他网络环境下不能通信进而导致提醒信息不能及时到达可信任用户的情况。
此外,本发明提供的通信终端1可以通过收发信机105响应于接收到来自可信任用户的通过第一网络的第一连接请求,自动发出对该连接请 求的应答,从而自动建立与可信任用户的通过第一网络的第一通信,由此在无需人工确认的情况下自动快速建立与可信任用户的通信,达到了当通信终端旁的人无法接电话或人工应答的情况下可信任用户仍然能够与通信终端旁的人通信的有益效果,另外,也实现了不依赖于通信终端旁的人的意志的强硬监视的效果。其中,所述第一网络包括诸如IP网络、电信网络等,在此不作限定。
此外,收发信机105与可信任用户通过第一网络的第一通信中断的情况下接收到可信任用户通过第二网络进行第二通信的连接请求,也可以自动发出对该连接请求的应答,从而自动建立与可信任用户的通过第二网络的第二通信。其中,所述第二网络与第一网络的类型不同,当然,第二网络也可以包括诸如IP网络、电信网络等,在此也不作限定。由此,在通信终端与可信任用户进行通信的情况下,即使遇到第一网络通信中断的情况,只要第二网络可用,都可以无缝切换到第二网络来与可信任用户进行通信,特别在某些紧急的情况下,例如根据对方的口述来记录重要号码、沟通重要问题时,通信的持续性对于用户来说极其重要,而本发明的该实施例提供的通信终端可以使用户完全感觉不到从已经中断的第一网络通信切换到第二网络继续进行通信的切换过程,通信的连续性较好。例如在图2中,可信任用户从wifi覆盖区移动到非wifi覆盖区,这时可信任用户的移动终端自动检测到所处的网络环境改变,从而自动通过电信网络向通信终端重新发送连接请求,通信终端(例如在家中)接到该连接请求自动应答,从而建立新的通信,对两端用户来说,都没有意识到中间有切换的过程,感觉通信是无缝的。如果通信终端旁的用户需要人工应答的话则达不到这一效果。
在一个实施例中,所述通信终端1还可以包括显示器103和扬声器104,在与可信任用户通信的过程中,在收发信机105建立了与可信任用户的IP通信或3G通信的情况下,显示器103用来显示收发信机105接收的来自可信任用户的视频,扬声器104用来输出收发信机105接收的来自可信任用户的音频。其中,显示器103不仅可以显示可信任用户的视频,还可以同时显示与所述视频对应的标识等其他内容,例如与视频对应的快 捷方式图标。在收发信机105建立了与可信任用户的2G通信的情况下,扬声器104可以输出收发信机105接收的来自可信任用户的音频。由此,对于不同的通信方式,通信终端1都可以输出与之对应的通信内容,在通信速率较高的IP或3G通信方式下,优先采用现场互动感强的视频通信,在通信速率较低的2G通信方式下,为了保持通信质量,优先采用可显著节省流量的音频通信。优选地,收发信机105同时建立了与多个可信任用户的IP或3G通信的情况下,显示器103同时显示来自多个可信任用户的视频,就像通信终端1的用户打开了与多个可信任用户进行通信的窗口,可以同时关注到多个可信任用户的实况。优选地,当所述通信终端1与单个可信任用户进行IP通信、3G通信或2G通信时,采用端到端的直接通信,在与多个用户进行IP通信、3G通信或2G通信时改经服务器进行通信,这种灵活的通信方式使得通信终端1在与单个用户进行通信时可以有效避免对服务器资源的浪费,并使得通信终端1在与多个用户进行通信时通过服务器来转发数据,更快更准确地传送大量数据。
进一步地,收发信机105还可以响应于所述多个可信任用户的视频中的一个或多个视频被选择,断开与所述一个或多个视频对应的可信任用户的通信,或者扬声器104不输出与所述一个或多个视频对应的可信任用户的声音。由此,通信终端的用户可根据需要自由选择通信的对象,或自由选择听到或不听到对方用户的声音。特别地,所述通信终端1还可以响应于所述多个可信任用户的视频中的一个被选择,被选择的可信任用户的视频变为放大的主画面,由此突出通信终端1的用户与重点对象进行的通信互动。
与上文所述的通信终端1接收信息的过程相对应,在发送信息时,所述通信终端1在与可信任用户通信的过程中,收发信机105建立了与可信任用户的IP通信或3G通信的情况下,收发信机向可信任用户发送摄像机101、音频采集单元102采集的视、音频;在收发信机105建立了与可信任用户的2G通信的情况下,收发信机仅向可信任用户发送音频采集单元102采集的音频。综上,通信终端1可以根据不同的网络调整所接收或所发送的信息类型,此处的信息类型主要指视频和音频。
其中,通信终端1对于人或特定人的识别可以基于人脸识别、身高识别、声音识别中的一个或多个来识别。在此,对于通信终端1识别人或特定人的方式不予限定,任何具有识别人或特定人的装置或单元如可适用本发明,都应包含在本发明的保护范围以内,并在此以引用方式包含于此。
在识别人的情况下,由于人脸的模式是很像的,绝大多数人的身高也是在特定范围内、人的声音频率也是在特定范围内,因此,例如当拍摄的图像中的某一区域与存储的人脸的模式类似,且/或结合位置传感器和/或深度传感器感测到的人脸与通信终端1的距离判断出其身高在特定范围内,且/或音频采集单元102采集到的音频也在特定范围内,可识别出人的存在。
在识别特定人的情况下,可以预先将特定人的人脸的模式和/或身高和/或声音频率存储在存储器中。当拍摄的图像中的某一区域与存储的该特定人脸的模式匹配,且/或结合位置传感器和/或深度传感器感测到的该特定人脸与通信终端1的距离判断出其身高与存储的身高匹配,且/或音频采集单元102采集到的音频的匹配与存储的改特定人的声音的频率匹配时,可识别出特定人的存在。
识别人或特定人的存在也可以采用自学习的方法。例如,如果拍摄的图像中的某个模式与采集到的声音的某个频率总是同时出现,可以在显示器上显示提示,即识别到了人,请通信终端1旁的人判断并命名。如果通信终端1旁的人发现识别错误,则在显示器的界面上反馈。接收到这种反馈后,在下一次拍摄的图像中的这种模式与采集到的声音的这种频率同时出现时就不认为出现了人或特定人。在自学习的方式下,也可以预先不将特定人的人脸的模式和/或身高和/或声音频率存储在存储器中。
另外,也可以基于携带手机发出的无线信号表明的身份识别人或特定人。例如通信终端1是蓝牙设备,可信任用户的手机中也具有蓝牙无线单元。当通信终端1识别出特定身份的蓝牙无线单元出现在一定距离内时,则认为识别出了特定人。
可选地,所述通信终端1也可以通过摄像机101、音频采集单元102基于所采集到的视、音频识别特定动作,例如识别出老人摔倒的动作、小 孩子跳舞的动作等等,并由收发信机105主动向另一端的可信任用户发送提醒信息。
可选地,可以人为地事先设定并根据设定的动作建立模型。当从摄像机101、音频采集单元102所采集的视、音频中搜索到与存储的一个模型相匹配的特定动作时,则由收发信机105主动向另一端的可信任用户发送提醒信息。例如,对于看电视这样一个动作,建立一个模型:识别出一个人坐在沙发上;顺着该人的目光方向看去,有一个物体;识别出该物体是电视;该人目光停留在电视上至少10秒。如果从摄像机101拍摄的图像中检测到人,然后检测到此人坐在沙发上(沙发的识别类似人脸识别,也可以通过模式匹配进行,也可以将人坐在沙发上的图像整体作为一个对象进行模式匹配识别),然后检测此人的目光方向,然后检测此人目光方向上的物体是否是电视(例如将电视作为一个对象进行模式匹配),如果是则计数10秒。
当然,所述通信终端1也可以通过机器学习等自学习的方式自动建立动作模型。例如,通信终端1从摄像机101、音频采集单元102所采集的视、音频中提取动作特征,并基于提取的特征建立动作模型。例如,从摄像机101、音频采集单元102所采集的视、音频中发现有一个人坐在沙发上、顺着此人目光看去的方向有一个电视、在此人目光停留在电视上的事件超过10秒的频率超过阈值,则认为这是一个特定动作的模型。在这种情况下,动作模型可以不预先存储在数据库中,而是根据从摄像机101、音频采集单元102所采集的视、音频以学习的方式提取动作的模型。
请参考图3(a),图3(a)示出了根据本发明一个实施例的通信终端的外部正视图。根据图3(a),在识别特定动作时,为了更准确地识别出特定动作,所述通信终端1还包括深度传感器197,基于摄像机101、音频采集单元102以及深度传感器197通过采集的视音频以及感测的深度共同识别出特定动作。当然,在图3(a)中,深度传感器197的位置仅是用于示例,其也可以位于通信终端1的其他合理位置,并不在此限定。同理,图3(a)中所示的其他装置或部件的位置也仅是用于示例,不再一一赘述。
在识别异常状况时,所述通信终端1可以通过识别出以下中的一种或多种来识别:
摄像机101采集到的视频的剧烈变化;
音频采集单元102采集到的高于特定阈值的音频;
音频采集单元102采集到的音频的剧烈变化;
基于摄像机101、音频采集单元102分别采集到的视、音频识别出的预定事件,其中该预定事件的模型事先已建立,并通过从基于摄像机101、音频采集单元102分别采集到的视、音频中搜索与建立的模型相匹配的事件,从而识别预定事件。
可选地,所述通信终端1基于摄像机101、音频采集单元102识别出预定事件,其中该预定事件的模型事先已建立,并通过从基于摄像机101、音频采集单元102分别采集到的视、音频中搜索与建立的模型相匹配的事件,从而识别预定事件。在此,所述通信终端1可以通过机器学习等自学习的方式自动建立预定事件的模型。典型地,所述通信终端1从摄像机101、音频采集单元102所采集的视、音频中提取事件特征,并基于提取的事件特征建立预定事件的模型,对各种事件进行分类,得到训练参数,从而识别出预定事件。
请参考图3(b),图3(b)示出了根据本发明一个实施例的通信终端的外部侧视图。根据图3(b),为了多角度、多方位地采集音视频,所述通信终端1还包括使摄像机转动的转动装置199。可选地,为了在采集信息时采集到更多的有用信息,响应于从摄像机101、音频采集单元102分别采集到的视音频中识别出以下要素中的一个,转动装置199使摄像机101向着面对识别出的要素的方向转动:
人或特定人;
特定动作;
异常状况。
请继续参考图3(a),为了使用户在不同的光线环境下都能在进行视频通信或观看视频时具有良好的视觉体验,所述通信终端1还可以包括光线传感器198,用于感测通信终端1周围环境光线变化,显示器103的 显示亮度根据感测到的光线变化予以调整。
请参考图4,图4示出了根据本发明一个实施例的安装于移动终端3的工具31的示意性框图。根据图4,所述安装于移动终端3的工具31包括:
发送单元301,被配置为响应于第一触发,检测移动终端3当前可用的网络,根据移动终端3当前可用的网络,通过相应的网络发送针对特定通信终端的连接请求;
接收单元302,被配置为接收来自所述特定通信终端的自动应答,从而自动建立与所述特定通信终端的通信,其中
在建立与所述特定通信终端的通信后,发送单元301响应于当前与所述特定通信终端通信的网络变得不可用,再次检测移动终端3当前可用的网络,根据移动终端3当前可用的网络,自动通过相应的网络再发送针对特定通信终端的连接请求。
其中,所述安装于移动终端3的工具诸如以应用程序(app)的方式安装在移动终端上,并以相应的应用图标的形式予以展示。所述响应于第一触发的方式诸如响应于所述移动终端3的开机或响应于所述移动终端3开机后所述工具31的开启,所述开启诸如通过响应于用户的点击、双击、长按等任何一种或组合来进行。所述当前可用的网络通常指IP网络、电信网络等。所述特定通信终端在此不作限定,可以指上文所述的通信终端1,也可以指其他具有通信功能的任意终端。优选地,所述特定通信终端可以是在所述工具31检测当前可用的网络前,已与移动终端3建立绑定关系的终端,因而在发送单元301检测当前网络后,直接通过相应的网络向已建立绑定关系的目标终端发送连接请求。
如图2所示,一开始,发送单元301响应于第一触发,检测到IP网络可用,通过IP网络发送针对特定通信终端的连接请求(当然,如果这时发送单元301检测到IP网络不可用但电信网络可用,通过电信网络发送针对特定通信终端的连接请求)。当接收到来自所述特定通信终端的自动应答后,移动终端3与特定通信终端之间进行IP通信。这时,如图2所示,在通信时携带移动终端3的用户(可信任用户)移出wifi服务区。 发送单元301检测到例如3G网络可用,自动通过3G网络再向特定通信终端发连接请求(可用直接发送,也可以通过3G服务器),接收到特定通信终端的自动应答,与特定移动终端建立通信。由此,由于网络的切换在连接时自动进行,对于双方用户来说,其感受不到IP网络中断后通过电信网络来发送连接请求,通信的持续体验较佳。
由此,在IP网络可用的情况下,无论是否还并存有其他可用的诸如电信网络等类型的网络,优先通过IP网络发送对特定通信终端的连接请求,由此可以更节省成本地连接到通常位于固定场所并置于IP网络环境中的特定通信终端。当然,即使在没有IP网络的情况下,由于本实施例的发送单元301在检测到电信网络的情况下,也可以很方便地向特定通信终端发送连接请求。
其中,本实施例提供的所述工具在建立与所述特定通信终端的通信后,发送单元301响应于当前与所述特定通信终端通信的网络是IP网络或3G网络,向所述特定通信终端发送移动终端3采集的视音频,响应于当前与所述特定通信终端通信的网络是2G网络,向所述特定通信终端发送移动终端3采集的音频。
与上文所述的工具31发送信息的过程相对应,在接收信息时,建立与所述特定通信终端的通信后,接收单元302响应于当前与所述特定通信终端通信的网络是IP网络或3G网络,从所述特定通信终端接收来自所述特定通信终端的视、音频;响应于当前与所述特定通信终端通信的网络是2G网络,从所述特定通信终端接收来自所述特定通信终端的音频。
所属技术领域的技术人员知道,本发明可以实现为设备、装置、方法或计算机程序产品。因此,本公开可以具体实现为以下形式,即:可以是完全的硬件,也可以是完全的软件,还可以是硬件和软件结合的形式。
附图中的流程图和框图显示了根据本发明的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注 的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。
对于本领域技术人员而言,显然本发明不限于上述示范性实施例的细节,而且在不背离本发明的精神或基本特征的情况下,能够以其他的具体形式实现本发明。因此,无论从哪一点来看,均应将实施例看作是示范性的,而且是非限制性的,本发明的范围由所附权利要求而不是上述说明限定,因此旨在将落在权利要求的等同要件的含义和范围内的所有变化囊括在本发明内。不应将权利要求中的任何附图标记视为限制所涉及的权利要求。

Claims (22)

  1. 一种通信终端(1),包括摄像机(101)、音频采集单元(102)以及收发信机(105),其中收发信机(105)响应于从摄像机(101)、音频采集单元(102)采集的视、音频中识别出人或特定人、特定动作、或异常状况,获取可信任用户当前可用的网络的信息,根据所获取的可信任用户当前可用的网络的信息,收发信机(105)通过相应的网络向可信任用户发送提醒信息。
  2. 根据权利要求1所述的通信终端(1),其中如果收发信机(105)获取的可信任用户当前可用的网络的信息指示IP网络可用,通过IP网络向可信任用户发送提醒信息。
  3. 根据权利要求1所述的通信终端(1),其中如果收发信机(105)获取的可信任用户当前可用的网络的信息指示IP网络不可用但电信网络可用,通过电信网络向可信任用户发送提醒信息。
  4. 根据权利要求1所述的通信终端(1),其中收发信机(105)响应于接收到来自可信任用户的通过第一网络的第一连接请求,自动发出对该连接请求的应答,从而自动建立与可信任用户的通过第一网络的第一通信。
  5. 根据权利要求1所述的通信终端(1),其中如果收发信机(105)在与可信任用户通过第一网络的第一通信中断的情况下接收到可信任用户通过第二网络进行第二通信的连接请求,自动发出对该连接请求的应答,从而自动建立与可信任用户的通过第二网络的第二通信。
  6. 根据权利要求4所述的通信终端(1),还包括显示器(103)和扬声器(104),其中在与可信任用户通信的过程中,在收发信机(105)建立了与可信任用户的IP通信或3G通信的情况下,显示器(103)用来显示收发信机(105)接收的来自可信任用户的视频,扬声器(104)用来输出收发信机(105)接收的来自可信任用户的音频;在收发信机(105)建立了与可信任用户的2G通信的情况下,扬声器(104)用来输出收发信机(105)接收的来自可信任用户的音频。
  7. 根据权利要求4所述的通信终端(1),其中在与可信任用户通信的过程中,在收发信机(105)建立了与可信任用户的IP通信或3G通信的情况下,收发信机向可信任用户发送摄像机(101)、音频采集单元(102)采集的视、音频;在收发信机(105)建立了与可信任用户的2G通信的情况下,收发信机仅向可信任用户发送音频采集单元(102)采集的音频。
  8. 根据权利要求6的通信终端(1),其中在收发信机(105)同时建立了与多个可信任用户的IP或3G通信的情况下,显示器(103)同时显示来自多个可信任用户的视频。
  9. 根据权利要求8的通信终端(1),其中响应于所述多个可信任用户的视频中的一个或多个视频被选择,收发信机(105)断开与所述一个或多个视频对应的可信任用户的通信,或者扬声器(104)不输出与所述一个或多个视频对应的可信任用户的声音。
  10. 根据权利要求8的通信终端(1),其中响应于所述多个可信任用户的视频中的一个被选择,被选择的可信任用户的视频变为放大的主画面。
  11. 根据权利要求1的通信终端(1),其中人或特定人是基于人脸识别、身高识别、声音识别中的一个或多个来识别的。
  12. 根据权利要求1的通信终端(1),还包括深度传感器(197),所述特定动作是基于摄像机(101)、音频采集单元(102)分别采集到的视、音频以及深度传感器(197)感测的深度识别的。
  13. 根据权利要求1的通信终端(1),其中所述异常状况是通过识别出以下中的一种或多种识别的:
    摄像机(101)采集到的视频的剧烈变化;
    音频采集单元(102)采集到的高于特定阈值的音频;
    音频采集单元(102)采集到的音频的剧烈变化;
    基于摄像机(101)、音频采集单元(102)分别采集到的视、音频识别出的预定事件,其中该预定事件的模型事先已建立,并通过从基于摄像机(101)、音频采集单元(102)分别采集到的视、音频中搜索与建立的模型相匹配的事件,从而识别预定事件。
  14. 根据权利要求1的通信终端(1),还包括:使摄像机(101)转动 的转动装置(199)。
  15. 根据权利要求14的通信终端(1),其中响应于从摄像机(101)、音频采集单元(102)分别采集到的视、音频中识别出以下要素中的一个,转动装置(199)使摄像机(101)向着面对识别出的要素的方向转动:
    人或特定人;
    特定动作;
    异常状况。
  16. 根据权利要求6的通信终端(1),还包括光线传感器(198),用于感测通信终端(1)周围环境光线变化,其中显示器(103)的显示亮度是根据感测到的所述光线的变化调整的。
  17. 一种安装于移动终端(3)的工具(31),包括:
    发送单元(301),被配置为响应于第一触发,检测移动终端(3)当前可用的网络,根据移动终端(3)当前可用的网络,通过相应的网络发送针对特定通信终端的连接请求;
    接收单元(302),被配置为接收来自所述特定通信终端的自动应答,从而自动建立与所述特定通信终端的通信,其中
    在建立与所述特定通信终端的通信后,发送单元(301)响应于当前与所述特定通信终端通信的网络变得不可用,再次检测移动终端(3)当前可用的网络,根据移动终端(3)当前可用的网络,自动通过相应的网络再发送针对特定通信终端的连接请求。
  18. 根据权利要求17的工具(31),其中如果发送单元(301)响应于第一触发,检测到IP网络可用,通过IP网络发送针对特定通信终端的连接请求。
  19. 根据权利要求17的工具(31),其中如果发送单元(301)响应于第一触发,检测到IP网络不可用但电信网络可用,通过电信网络发送针对特定通信终端的连接请求。
  20. 根据权利要求17的工具(31),其中如果发送单元(301)响应于当前与所述特定通信终端通信的IP网络变得不可用,检测到电信网络可用,自动通过电信网络再发送针对特定通信终端的连接请求。
  21. 根据权利要求17的工具(31),其中在建立与所述特定通信终端的通信后,发送单元(301)响应于当前与所述特定通信终端通信的网络是IP网络或3G网络,向所述特定通信终端发送移动终端(3)采集的视、音频;响应于当前与所述特定通信终端通信的网络是2G网络,向所述特定通信终端发送移动终端(3)采集的音频。
  22. 根据权利要求17的工具(31),其中在建立与所述特定通信终端的通信后,接收单元(302)响应于当前与所述特定通信终端通信的网络是IP网络或3G网络,从所述特定通信终端接收来自所述特定通信终端的视、音频;响应于当前与所述特定通信终端通信的网络是2G网络,从所述特定通信终端接收来自所述特定通信终端的音频。
PCT/CN2014/086577 2014-07-15 2014-09-15 一种通信终端及安装于移动终端的工具 WO2016008210A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/326,246 US20180131899A1 (en) 2014-07-15 2014-09-15 Communication terminal and tool installed on mobile terminal

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410337297.0 2014-07-15
CN201410337297.0A CN104092972B (zh) 2014-07-15 2014-07-15 一种通信终端及安装于移动终端的工具

Publications (1)

Publication Number Publication Date
WO2016008210A1 true WO2016008210A1 (zh) 2016-01-21

Family

ID=51640649

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/086577 WO2016008210A1 (zh) 2014-07-15 2014-09-15 一种通信终端及安装于移动终端的工具

Country Status (3)

Country Link
US (1) US20180131899A1 (zh)
CN (1) CN104092972B (zh)
WO (1) WO2016008210A1 (zh)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104038717B (zh) * 2014-06-26 2017-11-24 北京小鱼在家科技有限公司 一种智能录制系统
CN104484259A (zh) * 2014-11-25 2015-04-01 北京奇虎科技有限公司 应用程序的流量监控方法、装置和移动终端
CN105118228A (zh) * 2015-07-11 2015-12-02 深圳市前海安测信息技术有限公司 用于监护儿童安全的自动报警系统及方法
CN105046876A (zh) * 2015-07-23 2015-11-11 中山大学深圳研究院 一种基于图像识别的儿童安全监测系统
CN105788166B (zh) * 2016-01-29 2018-07-27 维沃移动通信有限公司 一种监控报警方法和装置
CN106131769A (zh) * 2016-07-01 2016-11-16 深圳市迅准科技有限公司 一种基于蓝牙的通知方法、蓝牙装置及移动终端
CN106023528A (zh) * 2016-08-01 2016-10-12 王琰 一种老人危机监护装置
CN106817612A (zh) * 2016-12-09 2017-06-09 北海职业学院 一种具有监督功能的电视机的控制方法
CN108616834A (zh) * 2017-01-04 2018-10-02 中国移动通信有限公司研究院 一种附加业务的传输方法、装置及系统
US10469800B2 (en) * 2017-01-26 2019-11-05 Antimatter Research, Inc. Always-on telepresence device
CN107749102A (zh) * 2017-10-12 2018-03-02 武汉九万里科技有限公司 一种智能锁和用户终端的控制方法
EP3707896A4 (en) * 2017-11-10 2021-07-07 Hewlett-Packard Development Company, L.P. CONFERENCE ENVIRONMENT SURVEILLANCE
CN108833820B (zh) * 2018-05-29 2021-03-12 Oppo广东移动通信有限公司 视频通话方法及相关产品
CN108810474A (zh) * 2018-06-19 2018-11-13 广州小狗机器人技术有限公司 一种网络摄像头监控方法及系统
CN109874165B (zh) * 2019-03-29 2021-09-14 努比亚技术有限公司 一种及时关闭可穿戴设备传感器的方法、可穿戴设备及存储介质
CN112312030A (zh) * 2019-08-01 2021-02-02 深圳怡化电脑股份有限公司 拍照补光方法、装置、计算机设备及存储介质
CN110430466B (zh) * 2019-08-13 2021-10-29 陈嘉涵 一种基于ai识别的音视频采集方法及装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101102584A (zh) * 2006-07-05 2008-01-09 华为技术有限公司 一种异构无线通信系统之间切换的方法和装置
CN101860986A (zh) * 2010-04-26 2010-10-13 宇龙计算机通信科技(深圳)有限公司 一种监视用户安全的方法、移动终端及服务器
CN102402828A (zh) * 2010-09-07 2012-04-04 瞿彪 一种3g视频防盗报警器
CN103647941A (zh) * 2013-11-28 2014-03-19 青岛海尔软件有限公司 基于Android平台的智能家居监控系统
CN103645691A (zh) * 2013-11-28 2014-03-19 青岛海尔软件有限公司 具有报警功能的基于Android平台的家居监控系统

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100208634A1 (en) * 1994-10-11 2010-08-19 Arbinet Corporation System and Method For Managing Multimedia Communications Across Convergent Networks
DE10235547A1 (de) * 2002-03-27 2003-10-09 Agere Syst Guardian Corp Alarmierungsverfahren und Mobiltelefon zur Alarmierung
US7266347B2 (en) * 2003-06-10 2007-09-04 Gross John N Remote monitoring device and process
US20050255826A1 (en) * 2004-05-12 2005-11-17 Wittenburg Kent B Cellular telephone based surveillance system
US8219073B2 (en) * 2004-12-28 2012-07-10 Motorola Mobility, Inc. Method for simlutaneous communications management
WO2006137136A1 (ja) * 2005-06-22 2006-12-28 Fujitsu Limited 緊急時連絡を行う携帯情報機器
US8022807B2 (en) * 2007-06-15 2011-09-20 Alarm.Com Incorporated Alarm system with two-way voice
CN101119481B (zh) * 2007-08-27 2010-04-21 刘文萍 一种远程报警视频监控方法
KR20090042715A (ko) * 2007-10-16 2009-04-30 박상래 무선통신망을 이용한 아동 보호 관리 시스템 및 방법
US8724619B2 (en) * 2007-12-31 2014-05-13 Apple Inc. Transparently routing a telephone call between mobile and VOIP services
US8116723B2 (en) * 2008-01-17 2012-02-14 Kaltsukis Calvin L Network server emergency information accessing method
CN101286238A (zh) * 2008-05-06 2008-10-15 苏州纳米技术与纳米仿生研究所 仿生智能监控系统
CN101465033B (zh) * 2008-05-28 2011-01-26 丁国锋 一种自动追踪识别系统及方法
CN101635835A (zh) * 2008-07-25 2010-01-27 深圳市信义科技有限公司 智能视频监控方法及系统
CN101790003A (zh) * 2009-01-23 2010-07-28 英华达(上海)电子有限公司 一种用于具有音频或视频功能的移动装置的监视或监听方法
CN101534425A (zh) * 2009-04-10 2009-09-16 上海伯里春贸易有限公司 车站、机场和地铁人像采集比对识别监控系统及其方法
US11399153B2 (en) * 2009-08-26 2022-07-26 Teladoc Health, Inc. Portable telepresence apparatus
US20120098918A1 (en) * 2010-08-04 2012-04-26 Murphy William A Video analytics as a trigger for video communications
US20120297304A1 (en) * 2011-05-17 2012-11-22 Apple Inc. Adaptive Operating System
US9262068B2 (en) * 2012-05-31 2016-02-16 Opportunity Partners Inc. Interactive surface
KR20150029006A (ko) * 2012-06-29 2015-03-17 비헤이버럴 레코그니션 시스템즈, 인코포레이티드 비디오 감시 시스템을 위한 피처 이례들의 무감독 학습
US8837685B2 (en) * 2012-09-14 2014-09-16 GreatCall, Inc. Adaptive system with call center and trusted network
US20140347436A1 (en) * 2013-05-22 2014-11-27 Sony Corporation Portable transparent display with life-size image for teleconference
US9355306B2 (en) * 2013-09-27 2016-05-31 Konica Minolta Laboratory U.S.A., Inc. Method and system for recognition of abnormal behavior
US8948133B2 (en) * 2014-05-27 2015-02-03 Bandwidth.Com, Inc. Techniques for establishing a communication handoff threshold using user feedback

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101102584A (zh) * 2006-07-05 2008-01-09 华为技术有限公司 一种异构无线通信系统之间切换的方法和装置
CN101860986A (zh) * 2010-04-26 2010-10-13 宇龙计算机通信科技(深圳)有限公司 一种监视用户安全的方法、移动终端及服务器
CN102402828A (zh) * 2010-09-07 2012-04-04 瞿彪 一种3g视频防盗报警器
CN103647941A (zh) * 2013-11-28 2014-03-19 青岛海尔软件有限公司 基于Android平台的智能家居监控系统
CN103645691A (zh) * 2013-11-28 2014-03-19 青岛海尔软件有限公司 具有报警功能的基于Android平台的家居监控系统

Also Published As

Publication number Publication date
US20180131899A1 (en) 2018-05-10
CN104092972A (zh) 2014-10-08
CN104092972B (zh) 2018-10-02

Similar Documents

Publication Publication Date Title
WO2016008210A1 (zh) 一种通信终端及安装于移动终端的工具
US11115227B2 (en) Terminal and method for bidirectional live sharing and smart monitoring
JP6445173B2 (ja) デバイスの制御方法及び装置
US9875627B2 (en) Method and apparatus for processing sensor data of detected objects
US9742582B2 (en) House monitoring system
US10349008B2 (en) Tool of mobile terminal and intelligent audio-video integration server
CN106713418B (zh) 重置结果确认方法、装置、服务器和移动终端
CN113329240A (zh) 投屏的方法及装置
WO2015155936A1 (en) Monitoring camera system
KR101498985B1 (ko) Ip cctv를 이용한 gps 위치정보 기반의 비상상황 발생 현장 촬영 및 모니터링 시스템 그리고 이를 이용한 비상상황 발생 현장의 촬영 및 모니터링 방법
CN106470326B (zh) 音视频通讯的终端切换方法及装置
JP2006285645A (ja) 警備システム、警備装置及び警備方法
WO2015184701A1 (zh) 单呼即通实况通信终端、方法及工具
US8760493B2 (en) Video displaying apparatus and controlling method thereof
CN106230714A (zh) 一种响应通信请求的方法及装置
JP4208019B2 (ja) インターホンシステム及びインターホン親機
CN109040651A (zh) 视频通信的方法及装置
JP2012213123A (ja) 監視装置およびプログラム
JP2014229915A (ja) インターホンシステム
KR101376230B1 (ko) 카메라폰의 원격 제어를 이용한 긴급 상황 대처 방법 및 시스템
JP6145305B2 (ja) インターホンシステム
KR101458365B1 (ko) 영상기기 보이스 알람 시스템 및 그 운용방법
KR101947486B1 (ko) 문자 채팅방식을 통한 음성-영상 통화서비스 시스템
KR101773248B1 (ko) 통신장치, 방송중계 서버 및 그 방송중계방법
CN115134476A (zh) 影像分享与会议参与者的识别方法及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14897689

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02.05.2017)

WWE Wipo information: entry into national phase

Ref document number: 15326246

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 14897689

Country of ref document: EP

Kind code of ref document: A1