WO2021112807A1 - A system for using augmented reality in messaging applications - Google Patents

A system for using augmented reality in messaging applications Download PDF

Info

Publication number
WO2021112807A1
WO2021112807A1 PCT/TR2020/051234 TR2020051234W WO2021112807A1 WO 2021112807 A1 WO2021112807 A1 WO 2021112807A1 TR 2020051234 W TR2020051234 W TR 2020051234W WO 2021112807 A1 WO2021112807 A1 WO 2021112807A1
Authority
WO
WIPO (PCT)
Prior art keywords
message
application
content
augmented reality
electronic device
Prior art date
Application number
PCT/TR2020/051234
Other languages
French (fr)
Inventor
Yasin CETIN
Azize Busra ULAK
Original Assignee
Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to TR2019/19286 priority Critical
Priority to TR201919286 priority
Application filed by Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi filed Critical Turkcell Teknoloji Arastirma Ve Gelistirme Anonim Sirketi
Publication of WO2021112807A1 publication Critical patent/WO2021112807A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/06Message adaptation to terminal or network requirements
    • H04L51/063Content adaptation, e.g. replacement of unsuitable content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/18Commands or executable codes

Abstract

The present invention relates to a system (1) whereby addition of augmented reality content into message content is enabled by analysis of message contents in messaging that are performed in a messaging application running on an electronic device (2).

Description

A SYSTEM FOR USING AUGMENTED REALITY IN MESSAGING
APPLICATIONS
Technical Field
The present invention relates to a system whereby addition of augmented reality content into message content is enabled by analysis of message contents in messaging that are performed in a messaging application running on an electronic device.
Background of the Invention Use of smart phones and applications included on smart phones increase day by day. Messaging applications are the leading applications that are most commonly used on smart phones. In said messaging applications, mutual communication is realized by media components such as text, photo, and sound provided for applications. The said media components can only present their own technical characteristics to users. However, the message or feeling that you give to the person you communicate is limited to text and media components. Therefore, the message or feeling that you can give to the other party is as much as the characteristic and quality that the said components have. And this causes us not to be able to express our feelings to the other party clearly in our messaging with other parties. For this reason, today there is need for a solution whereby user experience is enhanced by interpreting text, sound and media components further in messaging applications and it is enabled to transfer feelings to persons to whom messages are delivered more clearly. The United States patent document no. US2019204994 discloses a system which comprises interacting with one or more electronic messages. In the said system, each of avatars represents sender of one of a plurality electronic messages. The invention comprises selecting the one corresponding to one of a plurality of messages that are presented in a virtual space in a computing environment, in connection with one of avatars. The system comprises receiving an indicator in order to present the corresponding electronic message in a virtual space and presentation of the corresponding electronic message in the virtual space by the computer.
Summary of the Invention
An objective of the present invention is to realize a system whereby addition of augmented reality content into message content is enabled in a real or virtual environment by analysis of message contents in messaging that are performed in a messaging application on an electronic device being able to take picture and run a messaging application.
Detailed Description of the Invention
“A System for Using Augmented Reality in Messaging Applications” realized to fulfil the objective of the present invention is shown in the figure attached, in which:
Figure 1 is a schematic block diagram of the inventive system for using augmented reality in messaging applications.
The components illustrated in the figure are individually numbered, where the numbers refer to the following: 1. System
2. Electronic device
3. Application
4. Server
The inventive system (1) for enabling addition of compatible augmented reality content into a message content comprises: at least one electronic device (2) which is configured to run at least one application on itself; at least one application (3) which runs on the electronic device (2) and is configured to ensure that the messaging content among the electronic devices (2) are transmitted over external server and the image or content and message contents symbolizing the person are viewed by augmented reality in a virtual or real environment; and at least one server (4) which is configured to decide on the message type - -that can be text, photo or sound- of the message content reaching from a messaging server to the application (3) in mutual messaging; to analyse the message content based on the message type it determines; and to add augmented reality content into the message; and to send the message wherein it added the augmented reality data to the application (3) of the other party.
The electronic device (2) included in the inventive system (1) is a device such as mobile phone, tablet computer, desktop computer or portable computer. The electronic device (2) is configured to perform data exchange by using any communication protocol. In a preferred embodiment of the invention, the electronic device (2) performs data exchange over a mobile communication network or a data bus such as Internet. In a preferred embodiment of the invention, the electronic device (2) is a mobile phone. In the inventive system (1), the application (3) is an instant messaging application configured to be run on the electronic device (2) and to present at least one interface. In a preferred embodiment of the invention, the application (3) is configured to enable users to make data entry. Message contents comprising elements such as text, sound, video, photo are created on the interface owned by the application (3); and the elements included in the content of the incoming message are viewed.
The application (3) is configured to ensure that the chat type is selected as augmented reality; it is determined by the user whether the messaging comprising the augmented reality data will be realized in virtual or real environment; and the messages are sent in an environment determined by the other party. Thereby, the user selects over the interface of the application (3) whether the augmented reality mode will be realized in a virtual or real environment.
The server (4) included in the inventive system (1) is configured to receive the message content reaching the electronic device (2); to determine the type of the message content received; to analyse the message content on the basis of the message type it determined; and to obtain information about the content. The server (4) is preferably configured to communicate with external servers wherein the message contents are included in order to analyse the message content it received. Thereby, accuracy of the augmented reality data to be added is increased by analysing the message content with high precision. The server (4) is configured to add the augmented reality data -that is compatible with the content information it received after analysis- into the message content and to share it with the application (3) over the electronic device (2). The server (4) adds the augmented reality data into the message content reaching the electronic device (2) over the application (3), on the basis of the virtuality or reality selection made over the application (3); and ensures that it is shared with the user by resending it to the application (3). For example, when a message comprising a sad emoji is delivered to the application (3), the server (4) first determines the message type and in case that it determines that the message type comprises media, it adds compatible augmented reality data into the related message content and then resends it to the application (3). When a sad emoji is delivered to the application (3), the server (4) ensures that the avatar of the message owner looks sad by using augmented reality on the application (3).
The server (4) adds augmented reality data onto the avatar -that is usually a photo or content symbolizing the message owner- on the basis of the message type and content received over the application (3). Thereby, when a sad emoji is included in the message content, the sad face status of the message owner is shared with the other party from the application (3).
In the inventive system (1), in order that message contents can be received by augmented reality, users determine the chat type over the application (3) as augmented reality and then decides on whether the messaging comprising the augmented reality data will be realized in virtual or real environment. In the inventive system (1), after the chat type and the augmented reality environment are determined, the server (4) receives the message reaching the application (3); determines the message type; and analyses the content thereof. The server (4) adds the augmented reality data into the content information obtained as a result of the content analysis and shares it with the user over the application (3). Thereby, avatar of the message owner created by the augmented reality and his/her messages are viewed on the application (3).
With the inventive system (1), it is ensured that the chats wherein a plurality of users included in the messaging applications (3) running on the electronic device (2), are presented to users’ experience in virtual or real environment. With the inventive system (1), due to the fact that the message type characteristics used in the chat are transferred to the virtual environment and the message contents are interpreted further, the communication problems encountered are avoided by bringing the feelings into the forefront in the messaging applications (3) further.
It is possible to develop various embodiments of the inventive system for using augmented reality in messaging applications (1); the invention cannot be limited to examples disclosed herein and it is essentially according to claims.

Claims

1. A system (1) for enabling addition of compatible augmented reality content into a message content comprising - at least one electronic device (2) which is configured to run at least one application on itself; characterized by at least one application (3) which runs on the electronic device (2) and is configured to ensure that the messaging content among the electronic devices (2) are transmitted over external server and the image or content and message contents symbolizing the person are viewed by augmented reality in a virtual or real environment; and at least one server (4) which is configured to decide on the message type - -that can be text, photo or sound- of the message content reaching from a messaging server to the application (3) in mutual messaging; to analyse the message content based on the message type it determines; and to add augmented reality content into the message; and to send the message wherein it added the augmented reality data to the application (3) of the other party.
2. A system (1) according to Claim 1; characterized by the electronic device (2) which is a device such as mobile phone, tablet computer, desktop computer or portable computer.
3. A system (1) according to Claim 1 or 2; characterized by the electronic device (2) which is configured to perform data exchange by using any communication protocol.
4. A system (1) according to any of the preceding claims; characterized by the electronic device (2) which performs data exchange over a mobile communication network or a data bus such as Internet.
5. A system (1) according to any of the preceding claims; characterized by the application (3) which is an instant messaging application configured to be run on the electronic device (2) and to present at least one interface.
6. A system (1) according to any of the preceding claims; characterized by the application (3) which is configured to enable users to make data entry.
7. A system (1) according to any of the preceding claims; characterized by the application (3) wherein message contents comprising elements such as text, sound, video, photo are created on the interface that it owns; and the elements included in the content of the incoming message are viewed.
8. A system (1) according to any of the preceding claims; characterized by the application (3) which is configured to ensure that the chat type is selected as augmented reality; it is determined by the user whether the messaging comprising the augmented reality data will be realized in virtual or real environment; and the messages are sent in an environment determined by the other party.
9. A system (1) according to any of the preceding claims; characterized by the server (4) which is configured to receive the message content reaching the electronic device (2); to determine the type of the message content received; to analyse the message content on the basis of the message type it determined; and to obtain information about the content.
10. A system (1) according to any of the preceding claims; characterized by the server (4) which is configured to communicate with external servers wherein the message contents are included in order to analyse the message content it received.
11. A system (1) according to any of the preceding claims; characterized by the server (4) which is configured to add the augmented reality data -that is compatible with the content information it received after analysis- into the message content and to share it with the application (3) over the electronic device (2).
12. A system (1) according to any of the preceding claims; characterized by the server (4) which adds the augmented reality data into the message content reaching the electronic device (2) over the application (3), on the basis of the virtuality or reality selection made over the application (3); and ensures that it is shared with the user by resending it to the application (3).
13. A system (1) according to any of the preceding claims; characterized by the server (4) which adds augmented reality data onto the avatar -that is usually a photo or content symbolizing the message owner- on the basis of the message type and content received over the application (3).
PCT/TR2020/051234 2019-12-04 2020-12-04 A system for using augmented reality in messaging applications WO2021112807A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TR2019/19286 2019-12-04
TR201919286 2019-12-04

Publications (1)

Publication Number Publication Date
WO2021112807A1 true WO2021112807A1 (en) 2021-06-10

Family

ID=76221856

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2020/051234 WO2021112807A1 (en) 2019-12-04 2020-12-04 A system for using augmented reality in messaging applications

Country Status (1)

Country Link
WO (1) WO2021112807A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125491A (en) * 2022-01-20 2022-03-01 阿里巴巴(中国)有限公司 Virtual live broadcast control method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140181229A1 (en) * 2012-08-15 2014-06-26 Imvu Inc. System and method for increasing clarity and expressiveness in network communications
US20180143761A1 (en) * 2016-11-22 2018-05-24 Lg Electronics Inc. Mobile terminal and method for controlling the same
US20190228552A1 (en) * 2018-01-22 2019-07-25 Samsung Electronics Co., Ltd. Electronic device providing text-related image and method for operating the same

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140181229A1 (en) * 2012-08-15 2014-06-26 Imvu Inc. System and method for increasing clarity and expressiveness in network communications
US20180143761A1 (en) * 2016-11-22 2018-05-24 Lg Electronics Inc. Mobile terminal and method for controlling the same
US20190228552A1 (en) * 2018-01-22 2019-07-25 Samsung Electronics Co., Ltd. Electronic device providing text-related image and method for operating the same

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125491A (en) * 2022-01-20 2022-03-01 阿里巴巴(中国)有限公司 Virtual live broadcast control method and device

Similar Documents

Publication Publication Date Title
US20170041254A1 (en) Contextual content sharing using conversation medium
KR102327571B1 (en) Displaying video call data
AU2013280679B2 (en) Communication system
KR100968298B1 (en) User interface for conducting chats over a network
CN102150443B (en) System and methods for communication between instant message users and short message service users
CN103326923B (en) Method and device for information sharing
US8775561B2 (en) Expanding a social network by the action of a single user
US20100050092A1 (en) Content Sharing and Instant Messaging
CN102138156A (en) Persisting a group in an instant messaging application
US9083693B2 (en) Managing private information in instant messaging
JP2015534676A (en) System and method for agent-based integration of instant messaging and video communication systems
CN102859480A (en) Screen sharing
JP6560453B2 (en) Information updating method and apparatus, and server
EP3105891B1 (en) Instant messaging with non subscriber users
US20130007142A1 (en) Processing A Message
US20170019484A1 (en) System and method for aggregating communication connections
US20160294982A1 (en) Unified Location & Presence, Communication Across Real and Virtual Worlds
US20160127292A1 (en) Method and system for controlling polling in message conversations across multiple devices
WO2021112807A1 (en) A system for using augmented reality in messaging applications
JP2010087704A (en) Communication method, server device, and system for the same
WO2016149312A1 (en) Information sharing control
US20140287787A1 (en) Connection System and Method to Dynamically Create and Collect a Group of Contextual Contacts
EP2294780B1 (en) A method for masking data
CN109347973B (en) Client instant messaging method and system
AU2015230714B1 (en) Chat system, key telephone unit, & recording medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20897037

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE