WO2022125050A2 - A system for offering a background suggestion in video calls - Google Patents

A system for offering a background suggestion in video calls Download PDF

Info

Publication number
WO2022125050A2
WO2022125050A2 PCT/TR2021/051396 TR2021051396W WO2022125050A2 WO 2022125050 A2 WO2022125050 A2 WO 2022125050A2 TR 2021051396 W TR2021051396 W TR 2021051396W WO 2022125050 A2 WO2022125050 A2 WO 2022125050A2
Authority
WO
WIPO (PCT)
Prior art keywords
background
application
server
participants
call
Prior art date
Application number
PCT/TR2021/051396
Other languages
French (fr)
Other versions
WO2022125050A3 (en
Inventor
Mesut SARAN
Original Assignee
Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi filed Critical Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi
Publication of WO2022125050A2 publication Critical patent/WO2022125050A2/en
Publication of WO2022125050A3 publication Critical patent/WO2022125050A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Definitions

  • the present invention relates to a system for suggesting a background image suitable for participants by detecting the images of participants and objects in the background during an online video call.
  • the United States patent document no. US2020186727 discloses a system for changing the background image of a user during a real-time video conference. Therefore, the system enables to receive the real-time video conference stream while the user is in a video conference; to recognize the user by means of face recognition in the received video conference stream; to separate and detect the user and the background following the face recognition; and then to replace the separated background with a pre-recorded background.
  • An objective of the present invention is to realize a system which enables to gather and analyse images related to users and objects in the background on applications whereby video call is performed, and then to suggest background images specific to users.
  • Figure l is a schematic view of the inventive system.
  • the inventive system (1) for suggesting a background image suitable for participants by detecting the images of participants and objects in the background during an online video call comprises: at least one electronic device (2) which is configured to run at least one application on it; at least one application (3) which runs on the electronic device (2) and is configured to enable users to make a video call with each other; at least one image gathering server (4) which is configured to gather image data related to users and their backgrounds during a video call being realized on the application (3); at least one analysis server (5) which is configured to carry out analysis related to users and objects in the background by using predetermined image processing methods on images obtained by the image gathering server (4); at least one suggestion server (6) which is configured to determine the optimum background media content related to information about the user and objects in the background by receiving the outputs of the analysis server (5), to access the application (3) and present these to the user, and to update the related content as background in the event of receiving approval.
  • the electronic device (2) included in the inventive system (1) is configured to run at least one application (3) on it and to comprise at least one camera.
  • the application (3) included in the inventive system (1) runs on the electronic device (2) and is configured to enable users to make video calls comprising at least two participants.
  • the application (3) is configured to enable users to upload visual media contents that can be viewed in their backgrounds during a call.
  • the application (3) is configured to enable users to identify object images such as of book, clock.
  • the image gathering server (4) included in the inventive system (1) is configured to gather images related to both users and backgrounds of participants during a video call being realized on the application (3).
  • the image gathering server (4) is configured to determine objects in the background by using predetermined image processing algorithms.
  • the analysis server (5) included in the inventive system (1) is configured to calculate the number of participants in a call by using the participant images obtained by the image gathering server (4) in the event that an object apart from objects that were previously identified to the application (3) is included among the objects determined by the image gathering server (4).
  • the analysis server (5) is configured to create estimations of age and gender related to determined participants, by using predetermined face recognition algorithms.
  • the analysis server (5) is configured to obtain location information about the electronic device (2) whereby participants connect to the application (3).
  • the analysis server (5) is configured to create estimations about the theme of the call based on the number of participants.
  • the suggestion server (6) included in the inventive system (1) is configured to create user-based keywords with the support of artificial intelligence algorithms by using the estimations of age, gender related to participants determined by the analysis server (5); the objects determined to be in the background of the user; and the estimations related to the theme of the call.
  • the suggestion server (6) is configured to carry out searches of background contents on the Internet by using the keywords created by it.
  • the suggestion server (6) is configured to submit the background contents, that it determines to may be associated with the keywords specific to users, to the approval of user over the application (3).
  • the suggestion server (6) is configured to designate the related background content as the background of the call ongoing on the application (3) in the event that the participant approves the suggestion of background content.
  • the suggestion server (6) is configured to use the background images which were previously used/liked over the application (3) while creating background suggestions for the participants.
  • a user initiates a video call wherein at least two participants are included, by means of the application (3) over the electronic device (2) at first.
  • the image gathering server (4) can gather images related to participants and their backgrounds, from the call being realized on the application (3).
  • the objects included in the gathered images are detected by means of artificial intelligence models and estimations are generated related to age, gender of participants by the analysis server (5).
  • the analysis server (5) receives location information of the participants. Keywords are created by the suggestion server (6) related to the participants and the background images are searched by these keywords. Upon the visual contents found are submitted to the approval of the participant, these are set as the background of the online call in the event of approval.
  • suggestions of individual background can be created via use of parameters such as ages, genders, locations of persons participating the call in the applications (3) whereby online call is realized.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The present invention relates to a system (1) for suggesting a background image suitable for participants by detecting the images of participants and objects in the background during an online video call.

Description

A SYSTEM FOR OFFERING A BACKGROUND SUGGESTION IN VIDEO CALLS
Technical Field
The present invention relates to a system for suggesting a background image suitable for participants by detecting the images of participants and objects in the background during an online video call.
Background of the Invention
Today, users can use various images as background on online video calling platforms use of which become widespread increasingly. In general, users upload an image they want to use as background, from their own devices during a call.
Considering the studies in the state of the art, it is understood that there is need for a system which enables to detect characteristics of users such as age, gender and accordingly to offer a suggestion of background content specific to users.
The United States patent document no. US2020186727, an application in the state of the art, discloses a system for changing the background image of a user during a real-time video conference. Therefore, the system enables to receive the real-time video conference stream while the user is in a video conference; to recognize the user by means of face recognition in the received video conference stream; to separate and detect the user and the background following the face recognition; and then to replace the separated background with a pre-recorded background.
Summary of the Invention An objective of the present invention is to realize a system which enables to gather and analyse images related to users and objects in the background on applications whereby video call is performed, and then to suggest background images specific to users.
Detailed Description of the Invention
“A System for Offering a Background Suggestion in Video Calls” realized to fulfil the objective of the present invention is shown in the figure attached, in which:
Figure l is a schematic view of the inventive system.
The components illustrated in the figure are individually numbered, where the numbers refer to the following:
1. System
2. Electronic device
3. Application
4. Image gathering server
5. Analysis server
6. Suggestion server
The inventive system (1) for suggesting a background image suitable for participants by detecting the images of participants and objects in the background during an online video call comprises: at least one electronic device (2) which is configured to run at least one application on it; at least one application (3) which runs on the electronic device (2) and is configured to enable users to make a video call with each other; at least one image gathering server (4) which is configured to gather image data related to users and their backgrounds during a video call being realized on the application (3); at least one analysis server (5) which is configured to carry out analysis related to users and objects in the background by using predetermined image processing methods on images obtained by the image gathering server (4); at least one suggestion server (6) which is configured to determine the optimum background media content related to information about the user and objects in the background by receiving the outputs of the analysis server (5), to access the application (3) and present these to the user, and to update the related content as background in the event of receiving approval.
The electronic device (2) included in the inventive system (1) is configured to run at least one application (3) on it and to comprise at least one camera.
The application (3) included in the inventive system (1) runs on the electronic device (2) and is configured to enable users to make video calls comprising at least two participants. The application (3) is configured to enable users to upload visual media contents that can be viewed in their backgrounds during a call. The application (3) is configured to enable users to identify object images such as of book, clock.
The image gathering server (4) included in the inventive system (1) is configured to gather images related to both users and backgrounds of participants during a video call being realized on the application (3). The image gathering server (4) is configured to determine objects in the background by using predetermined image processing algorithms.
The analysis server (5) included in the inventive system (1) is configured to calculate the number of participants in a call by using the participant images obtained by the image gathering server (4) in the event that an object apart from objects that were previously identified to the application (3) is included among the objects determined by the image gathering server (4). The analysis server (5) is configured to create estimations of age and gender related to determined participants, by using predetermined face recognition algorithms. The analysis server (5) is configured to obtain location information about the electronic device (2) whereby participants connect to the application (3). The analysis server (5) is configured to create estimations about the theme of the call based on the number of participants.
The suggestion server (6) included in the inventive system (1) is configured to create user-based keywords with the support of artificial intelligence algorithms by using the estimations of age, gender related to participants determined by the analysis server (5); the objects determined to be in the background of the user; and the estimations related to the theme of the call. The suggestion server (6) is configured to carry out searches of background contents on the Internet by using the keywords created by it. The suggestion server (6) is configured to submit the background contents, that it determines to may be associated with the keywords specific to users, to the approval of user over the application (3). The suggestion server (6) is configured to designate the related background content as the background of the call ongoing on the application (3) in the event that the participant approves the suggestion of background content. The suggestion server (6) is configured to use the background images which were previously used/liked over the application (3) while creating background suggestions for the participants.
In the inventive system (1), a user initiates a video call wherein at least two participants are included, by means of the application (3) over the electronic device (2) at first. The image gathering server (4) can gather images related to participants and their backgrounds, from the call being realized on the application (3). The objects included in the gathered images are detected by means of artificial intelligence models and estimations are generated related to age, gender of participants by the analysis server (5). The analysis server (5) receives location information of the participants. Keywords are created by the suggestion server (6) related to the participants and the background images are searched by these keywords. Upon the visual contents found are submitted to the approval of the participant, these are set as the background of the online call in the event of approval.
With the inventive system (1), suggestions of individual background can be created via use of parameters such as ages, genders, locations of persons participating the call in the applications (3) whereby online call is realized.
Within these basic concepts; it is possible to develop various embodiments of the inventive system (1); the invention cannot be limited to examples disclosed herein and it is essentially according to claims.

Claims

1. A system (1) for suggesting a background image suitable for participants by detecting the images of participants and objects in the background during an online video call; comprising at least one electronic device (2) which is configured to run at least one application on it; at least one application (3) which runs on the electronic device (2) and is configured to enable users to make a video call with each other; and characterized by at least one image gathering server (4) which is configured to gather image data related to users and their backgrounds during a video call being realized on the application (3); at least one analysis server (5) which is configured to carry out analysis related to users and objects in the background by using predetermined image processing methods on images obtained by the image gathering server (4); at least one suggestion server (6) which is configured to determine the optimum background media content related to information about the user and objects in the background by receiving the outputs of the analysis server (5), to access the application (3) and present these to the user, and to update the related content as background in the event of receiving approval.
2. A system (1) according to Claim 1; characterized by the electronic device
(2) such as mobile phone, tablet which is configured to run at least one application (3) on it and to comprise at least one camera.
3. A system (1) according to Claim 1 or 2; characterized by the application
(3) which runs on the electronic device (2) and is configured to enable users to make video calls comprising at least two participants.
6
4. A system (1) according to any of the preceding claims; characterized by the application (3) which is configured to enable users to upload visual media contents that can be viewed in their backgrounds during a call.
5. A system (1) according to any of the preceding claims; characterized by the application (3) which is configured to enable users to identify object images such as of book, clock.
6. A system (1) according to any of the preceding claims; characterized by the image gathering server (4) which is configured to gather images related to both users and backgrounds of participants during a video call being realized on the application (3).
7. A system (1) according to any of the preceding claims; characterized by the image gathering server (4) which is configured to determine objects in the background by using predetermined image processing algorithms.
8. A system (1) according to any of the preceding claims; characterized by the analysis server (5) which is configured to calculate the number of participants in a call by using the participant images obtained by the image gathering server (4) in the event that an object apart from objects that were previously identified to the application (3) is included among the objects determined by the image gathering server (4).
9. A system (1) according to any of the preceding claims; characterized by the analysis server (5) which is configured to create estimations of age and gender related to determined participants, by using predetermined face recognition algorithms.
10. A system (1) according to any of the preceding claims; characterized by the analysis server (5) which is configured to obtain location information about the electronic device (2) whereby participants connect to the application (3).
11. A system (1) according to any of the preceding claims; characterized by the analysis server (5) which is configured to create estimations about the theme of the call based on the number of participants.
12. A system (1) according to any of the preceding claims; characterized by the suggestion server (6) which is configured to create user-based keywords with the support of artificial intelligence algorithms by using the estimations of age, gender related to participants determined by the analysis server (5); the objects determined to be in the background of the user; and the estimations related to the theme of the call.
13. A system (1) according to any of the preceding claims; characterized by the suggestion server (6) which is configured to carry out searches of background contents on the Internet by using the keywords created by it.
14. A system (1) according to any of the preceding claims; characterized by the suggestion server (6) which is configured to submit the background contents, that it determines to may be associated with the keywords specific to users, to the approval of user over the application (3).
15. A system (1) according to any of the preceding claims; characterized by the suggestion server (6) which is configured to designate the related background content as the background of the call ongoing on the application (3) in the event that the participant approves the suggestion of background content.
8
PCT/TR2021/051396 2020-12-13 2021-12-13 A system for offering a background suggestion in video calls WO2022125050A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2020/20387 2020-12-13
TR2020/20387A TR202020387A2 (en) 2020-12-13 2020-12-13 A SYSTEM THAT OFFERS BACKGROUND SUGGESTION IN VIDEO CALLS

Publications (2)

Publication Number Publication Date
WO2022125050A2 true WO2022125050A2 (en) 2022-06-16
WO2022125050A3 WO2022125050A3 (en) 2022-07-14

Family

ID=75575806

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2021/051396 WO2022125050A2 (en) 2020-12-13 2021-12-13 A system for offering a background suggestion in video calls

Country Status (2)

Country Link
TR (1) TR202020387A2 (en)
WO (1) WO2022125050A2 (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8294823B2 (en) * 2006-08-04 2012-10-23 Apple Inc. Video communication systems and methods
US20120011454A1 (en) * 2008-04-30 2012-01-12 Microsoft Corporation Method and system for intelligently mining data during communication streams to present context-sensitive advertisements using background substitution
US8823739B2 (en) * 2010-08-25 2014-09-02 International Business Machines Corporation Background replacement for videoconferencing
US9992450B1 (en) * 2017-03-24 2018-06-05 Apple Inc. Systems and methods for background concealment in video conferencing session

Also Published As

Publication number Publication date
WO2022125050A3 (en) 2022-07-14
TR202020387A2 (en) 2021-01-21

Similar Documents

Publication Publication Date Title
CN110113316B (en) Conference access method, device, equipment and computer readable storage medium
US9179191B2 (en) Information processing apparatus, information processing method, and program
KR101825569B1 (en) Technologies for audiovisual communication using interestingness algorithms
US8411130B2 (en) Apparatus and method of video conference to distinguish speaker from participants
US11741949B2 (en) Real-time video conference chat filtering using machine learning models
CN106021496A (en) Video search method and video search device
US11803579B2 (en) Apparatus, systems and methods for providing conversational assistance
CN105981375A (en) Information processing apparatus, control method, program, and system
CN111182218A (en) Panoramic video processing method, device, equipment and storage medium
KR101895846B1 (en) Facilitating television based interaction with social networking tools
Liu et al. Learning to predict salient faces: A novel visual-audio saliency model
CN111314620B (en) Photographing method and apparatus
CN108629241A (en) A kind of data processing method and data processing equipment
US20190034757A1 (en) Method and system for on-device image recognition
JP2011223369A (en) Conversation system for patient with cognitive dementia
WO2022125050A2 (en) A system for offering a background suggestion in video calls
CN113301352A (en) Automatic chat during video playback
CN114727119B (en) Live broadcast continuous wheat control method, device and storage medium
CN111918112B (en) Video optimization method, device, storage medium and terminal
US8203593B2 (en) Audio visual tracking with established environmental regions
WO2024038699A1 (en) Expression processing device, expression processing method, and expression processing program
CN116866509B (en) Conference scene picture tracking method, device and storage medium
US11949727B2 (en) Organic conversations in a virtual group setting
CN112165582B (en) Method and device for generating video, storage medium and electronic equipment
Chenfu et al. Generating Experiential Descriptions and Estimating Evidence Using Generative Language Model and User Products Reviews

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21904017

Country of ref document: EP

Kind code of ref document: A2