JP2022028842A - Interaction method and system for sharing content in messaging service environment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an interaction method and system in a messaging service environment.

SOLUTION: An interaction method includes the steps of: providing a messaging interface on a screen of a computer; accessing a plurality of contents stored in the computer in response to recognition of user input in a first region set to the messaging interface; displaying one content of the plurality of contents on the messaging interface on the basis of maintaining the recognition of the user input in a second region, but selecting and displaying one content of the plurality of contents on the basis of a position at which the user input is recognized in the second region; and transmitting the content of the plurality of contents, which is displayed on the messaging interface, by a messaging service on the basis of deviation of the position, at which the user input is recognized, from the second region.

SELECTED DRAWING: Figure 21

COPYRIGHT: (C)2022,JPO&INPIT

Description

The following description relates to interaction methods and systems for content sharing in a messaging service environment, and more specifically, not only photos stored on a computer, but also files and media, network addresses or geolocations accessed by the user. An interaction method that can be easily shared on a messaging service, a computer device that executes the interaction method, a computer recorded on a computer-readable recording medium in order to combine with a computer and cause the computer to execute the interaction method. Regarding the program and its recording medium.

A messaging service is one of interactive services or conversational services, which is operated by a storage device having message processing functions such as operation of a storage type post office box and information editing, processing, and conversion. It provides terminal communication services to users, and corresponds to e-mail services and message communication processing services (for example, chat using messenger).

In such a conventional messaging service, in order for a user to take a picture with the camera of his / her own terminal and send it, the user activates the camera while using the user interface provided by the messaging service. There is a problem that it has to go through complicated processes such as the operation of the operation, the operation of taking a picture with the activated camera, and the operation of attaching the taken picture to the messaging service and sending it.

Also, when sending information such as photos and files saved in the terminal or media accessed by the user with the messaging service, the photos and files can be displayed while the user uses the user interface provided by the messaging service. Access the saved location and select the desired photo or file to attach to the messaging service, or search for the address of the media accessed by the user, the link of the related application, etc. and attach it to the messaging service. There is the problem of having to go through a complicated process.

In a messaging service environment provided by a computer including a camera such as a smartphone, an interaction method that allows a user to easily take a picture with the camera and share it, a computer device that executes the interaction method, and a computer are combined. Provided are a computer program recorded on a computer-readable recording medium and the recording medium thereof in order to cause a computer to execute an interaction method.

An interaction method that can easily share not only photos stored in a computer but also files and media accessed by the user, network address, geolocation information, etc. on a messaging service, a computer device that executes the interaction method. The present invention relates to a computer program recorded on a computer-readable recording medium and the recording medium thereof in order to combine with the computer and cause the computer to perform an interaction method.

Based on the application installed on the computer and executed on the computer in connection with the messaging service, the user input is recognized in the first area set in the messaging interface at the stage of providing the messaging interface on the screen of the computer. In response to this, at the stage of accessing the plurality of contents stored in the computer, the content of one of the plurality of contents is messaged based on the recognition of the user input being maintained in the second region. A stage of displaying on the interface, but selecting and displaying one content from the plurality of contents based on the position where the user input is recognized in the second area, and a position where the user input is recognized. Provides an interaction method comprising the step of transmitting the content displayed on the messaging interface among the plurality of contents by the messaging service based on the deviation from the second region.

Provided is a computer program for combining with a computer and causing the computer to execute the interaction method.

Provided is a computer-readable recording medium, characterized in that a program for causing a computer to execute the interaction method is recorded.

A computer device that includes at least one processor implemented to execute a computer-readable instruction, said one processor for an application installed on the computer and executed on the computer in connection with a messaging service. Based on this, a messaging interface is provided on the screen of the computer, in response to recognizing a user input in a first area set in the messaging interface, access to a plurality of contents stored in the computer, and the user. Based on the fact that the recognition of the input is maintained in the second area, the content of one of the plurality of contents is displayed on the messaging interface, but based on the position where the user input is recognized in the second area. , One content is selected and displayed from the plurality of contents, and the position where the user input is recognized deviates from the second region, and based on the above-mentioned plurality of contents, on the messaging interface. Provided is a computer device characterized in that the displayed content is transmitted by the messaging service.

In a messaging service environment provided by a computer including a camera such as a smartphone, a user can easily take a picture with the camera and share it.

Not only photos stored on your computer, but also files and media accessed by users, network addresses or geolocation information can be easily shared on messaging services.

It is a figure which showed the example of the network environment in one Embodiment of this invention. It is a block diagram for demonstrating the internal structure of the electronic device and the server in one Embodiment of this invention. It is a figure which showed the example which the user has long-press-touched the user interface area for activating the camera in one Embodiment of this invention. It is a figure which showed the example which displays the image input to the in-camera on the messaging interface for the messaging service in one Embodiment of this invention. It is a figure which showed the example which the in-camera image displayed on the messaging interface is moved by moving the position which recognizes a user input in one Embodiment of this invention. It is a figure which showed the example which transmits the in-camera image in one Embodiment of this invention. It is a figure which showed the example which changes the image displayed on a messaging interface from the image input to an in-camera to the image input to an out-camera in one embodiment of the present invention. It is a figure which showed the example which changes the image displayed on a messaging interface from the image input to an out-camera to the image input to an in-camera in one Embodiment of this invention. It is a figure which showed the example of transmitting the out-camera image in one Embodiment of this invention. It is a flowchart which showed the example of the interaction method in one Embodiment of this invention. It is a figure which showed the example which the user has long-press-touched the user interface area for loading the photograph stored in an album in another embodiment of this invention. It is a figure which showed the example which the photograph stored in an album is displayed on the messaging interface for the messaging service in another embodiment of this invention. It is a figure which showed the example which changes the photograph displayed on a messaging interface in order by moving the position which recognizes a user input in another embodiment of this invention. It is a figure which showed the example which changes the photograph displayed on a messaging interface in order by moving the position which recognizes a user input in another embodiment of this invention. It is a figure which showed the example of transmitting the photograph which is currently displaying in another embodiment of this invention. It is a figure which showed the example of the user interface for transmitting additional content in another embodiment of this invention. It is a figure which showed the example of the user interface for transmitting additional content in another embodiment of this invention. It is a figure which showed the example of the user interface for transmitting additional content in another embodiment of this invention. It is a figure which showed the example of the user interface for transmitting additional content in another embodiment of this invention. It is a figure which showed the example of the user interface for transmitting additional content in another embodiment of this invention. It is a flowchart which showed the example of the interaction method in another embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The interaction method according to the embodiment of the present invention may be performed by a computer device such as an electronic device described below. At this time, in the computer device, the computer program according to the embodiment of the present invention (for example, a messenger application for a messaging service) may be installed and executed, and the computer device controls the computer program to be executed. The interaction method according to the embodiment of the present invention may be executed according to the above. The computer program described above may be recorded on a computer-readable recording medium in order to be combined with a computer device to cause the computer to perform an interaction method.

FIG. 1 is a diagram showing an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Such FIG. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited as in FIG.

The plurality of electronic devices 110, 120, 130, 140 may be fixed terminals or mobile terminals realized by a computer device. Examples of a plurality of electronic devices 110, 120, 130, 140 include smartphones, mobile phones, navigation systems, PCs (personal computers), notebook PCs, digital broadcasting terminals, PDAs (Personal Digital Assistants), and PMPs (Portable Multimedia Players). ), Tablets, etc. As an example, FIG. 1 shows a smartphone as an example of the electronic device 1 (110), but in the embodiment of the present invention, the electronic device 1 (110) substantially uses a wireless or wired communication method. It may mean one of a variety of physical computer devices capable of communicating with other electronic devices 120, 130, 140 and / or servers 150, 160 via network 170.

The communication method is not limited, and not only the communication method using the communication network (for example, mobile communication network, wired Internet, wireless Internet, broadcasting network) that can be included in the network 170, but also the short distance between devices. Wireless communication may be included. For example, the network 170 includes a PAN (personal area network), a LAN (local area network), a CAN (campus area network), a MAN (metropolitan area network), a WAN (wise Internet) network, etc. It may include any one or more of the networks. Further, the network 170 may include, but is limited to, any one or more of network topologies, including bus networks, star networks, ring networks, mesh networks, star-bus networks, tree or hierarchical networks, and the like. Will not be done.

Each of the servers 150, 160 is realized by one or more computer devices that communicate with a plurality of electronic devices 110, 120, 130, 140 via a network 170 to provide instructions, codes, files, contents, services, and the like. good. For example, the server 150 may be a system that provides the first service to a plurality of electronic devices 110, 120, 130, 140 connected via the network 170, and the server 160 may also be a plurality of systems connected via the network 170. It may be a system that provides a second service to electronic devices 110, 120, 130, 140. As a more specific example, the server 150 is a service (for example, broadcast distribution) aimed at by the application through an application which is a computer program installed and executed in a plurality of electronic devices 110, 120, 130, 140. A service, a content transmission service, an information providing service, a messaging service, a mail service, etc.) may be provided to a plurality of electronic devices 110, 120, 130, 140 as a first service. As another example, the server 160 may provide a service for distributing the files for installing and executing the above-mentioned application to a plurality of electronic devices 110, 120, 130, 140 as a second service.

FIG. 2 is a block diagram for explaining an internal configuration of an electronic device and a server according to an embodiment of the present invention. FIG. 2 describes the internal configuration of the electronic device 1 (110) and the internal configuration of the server 150 as examples for the electronic device. Further, the other electronic devices 120, 130, 140 and the server 160 may have the same or similar internal configuration as the above-mentioned electronic device 1 (110) or the server 150.

The electronic device 1 (110) and the server 150 may include memories 211, 221s, processors 212, 222, communication modules 213, 223, and input / output interfaces 214, 224. The memory 211, 221 is a computer-readable recording medium and may include a permanent large-capacity recording device such as a RAM (random access memory), a ROM (read only memory), and a disk drive. Here, a permanent large-capacity recording device such as a ROM or a disk drive may be included in the electronic device 1 (110) or the server 150 as a permanent recording device separate from the memories 211 and 221. Further, the memories 211 and 221 include an operating system, a browser installed and executed by the electronic device 1 (110) as an example, and the electronic device 1 (for example, to provide a specific service). The code for applications and the like installed in 110) may be recorded. Such software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221. Such other computer-readable recording media may include computer-readable recording media such as floppy (registered trademark) drives, discs, tapes, DVD / CD-ROM drives, and memory cards. In other embodiments, software components may be loaded into memory 211, 221 through communication modules 213, 223, which are not computer readable recording media. For example, at least one program is a computer program installed by a file provided by a file distribution system (eg, server 160 described above) that distributes a developer or application installation file via a network 170 (eg, described above). It may be loaded into the memory 211 or 221 based on the application.

Processors 212 and 222 may be configured to process instructions in a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to processor 212, 222 by memory 211, 221 or communication modules 213, 223. For example, the processors 212 and 222 may be configured to execute instructions received according to a program code recorded in a recording device such as memories 211 and 221.

The communication modules 213 and 223 may provide a function for the electronic device 1 (110) and the server 150 to communicate with each other via the network 170, and the electronic device 1 (110) and / or the server 150 may provide other functions. A function for communicating with an electronic device (for example, electronic device 2 (120)) or another server (for example, server 160) may be provided. As an example, a request generated by the processor 212 of the electronic device 1 (110) according to a program code recorded in a recording device such as a memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. .. On the contrary, the control signals, instructions, contents, files, etc. provided according to the control of the processor 222 of the server 150 pass through the communication module 223 and the network 170, and pass through the communication module 213 of the electronic device 1 (110) to the electronic device 1. It may be received at (110). For example, control signals, instructions, contents, files, etc. of the server 150 received through the communication module 213 may be transmitted to the processor 212 and the memory 211, and the contents, files, etc. may be further included in the electronic device 1 (110). It may be recorded on a recording medium (permanent recording device described above).

The input / output interface 214 may be a means for an interface with the input / output device 215. For example, the input device may include a device such as a keyboard or mouse, and the output device may include a device such as a display or speaker. As another example, the input / output interface 214 may be a means for an interface with a device that integrates functions for input and output, such as a touch screen. The input / output device 215 may be composed of an electronic device 1 (110) and one device. Also, the input / output interface 224 of the server 150 may be a means for connecting to the server 150 or for interfacing with a device (not shown) for input or output that the server 150 can include. As a more specific example, when the processor 212 of the electronic device 1 (110) processes an instruction of a computer program loaded in the memory 211, it is configured by using the data provided by the server 150 and the electronic device 2 (120). The service screen or content to be generated may be displayed on the display through the input / output interface 214.

Also, in other embodiments, the electronic device 1 (110) and the server 150 may include more components than the components of FIG. However, most prior art components need not be clearly shown in the figure. For example, the electronic device 1 (110) may be realized to include at least a part of the above-mentioned input / output device 215, a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, and a database. It may further include other components such as. As a more specific example, when the electronic device 1 (110) is a smartphone, the acceleration sensor and gyro sensor, the camera module, various physical buttons, the buttons using the touch panel, and the input / input, which are generally included in the smartphone, are included. Various components such as an output port, a vibrator for vibration, and the like may be realized to be further included in the electronic device 1 (110).

FIG. 3 is a diagram showing an example in which a user long press-touches a user interface area for activating a camera in one embodiment of the present invention. The embodiment of FIG. 3 is based on a messenger application installed in electronic device 1 (110) and executed in electronic device 1 (110) in connection with a messaging service, and messaging on screen 310 of electronic device 1 (110). An example in which an interface is provided is shown, and an example in which user input occurs in the first region 320 set in the messaging interface is shown. At this time, the electronic device 1 (110) may activate the camera included in the electronic device 1 (110) (or connected to the electronic device 1 (110)) in response to the recognition of the user input. For example, the electronic device 1 (110) according to the present embodiment may be a smartphone including a touch screen screen, and the user input may be a long press touch with respect to the first area 320. In this case, the electronic device 1 (110) may activate the camera when the user's touch to the first region 320 is maintained for a preset time or longer. In the present embodiment, an example will be described in which the electronic device 1 (110) includes two cameras, an in-camera and an out-camera, and the in-camera is set to be activated by default when a user input is generated. Depending on the embodiment, the out-camera may be activated by default, or the user may be provided with a function that allows the user to set which camera, the in-camera or the out-camera, is activated first.

FIG. 4 is a diagram showing an example of displaying an image input to an in-camera on a messaging interface for a messaging service according to an embodiment of the present invention. The electronic device 1 (110) may display the in-camera image 410 input to the activated camera on the messaging interface based on the recognition of the user input being maintained in the second region 420. At this time, the in-camera image 410 may be an image input to the camera in real time. In other words, the frame recently input to the camera may be displayed on the messaging interface as an in-camera image 410. Further, the in-camera image 410 may be displayed at a position related to the position where the user input is being recognized. The second area 420 may be visually represented as shown in FIG. 4 so as to be recognizable by the user, and may be set in the messaging interface to include at least the first area 320.

FIG. 5 is a diagram showing an example in which the in-camera image displayed on the messaging interface is moved by moving the position where the user input is recognized in one embodiment of the present invention. FIG. 5 shows an example in which the position of the in-camera image 410 is moved to a position related to the position where the user input is recognized by moving the position where the user input is recognized in the second area 420. .. In other words, if the position where the user input is recognized continues to move within the second area 420, the area where the image is displayed may also be dynamically changed according to the position where the user input is recognized.

FIG. 6 is a diagram showing an example of transmitting an in-camera image in one embodiment of the present invention. In FIG. 6, the electronic device 1 (110) has at least one frame from the image input to the activated camera based on the position where the user input is recognized deviates from the second region 420 described with reference to FIG. May be captured and sent by a messaging service. At this time, at least one frame may be, for example, a frame input to the camera at a time when the position where the user input is recognized deviates from the second region 420. In FIG. 6, when the in-camera image 410 is transmitted by the messaging service, the transmitted in-camera image 410 is displayed as a transmitted message in the third area 610 displaying messages sent and received by the messaging service. An example is shown.

The shape of the camera displayed in the first region 320 described with reference to FIG. 3 may be a conventional user interface for activating the camera with the messaging interface. In other words, if the user simply touches the first area 320 where the user interface for activating the camera is displayed, the camera will be activated and the user will take a picture with the camera and take a picture. By going through the selection process, I was able to send the photos I took. On the other hand, in the present embodiment, the user can take a picture and send it by a single operation of performing a long press touch only once. For example, when the user makes a long press touch on the first area 320, the camera is activated, the image input to the camera is displayed on the messaging interface instead of being displayed on another screen, and the user makes a long press touch. After the generation, the camera can take a picture and send it only by the operation of deviating from the second area 420 while the touch is maintained.

FIG. 7 is a diagram showing an example of changing the image displayed on the messaging interface from the image input to the in-camera to the image input to the out-camera according to the embodiment of the present invention. In the embodiment of FIG. 7, the camera to be activated is changed from the in-camera to the out-camera by changing (or moving) the position where the user input is recognized, and the image displayed on the messaging interface is also the in-camera image 410. An example of changing from to the out-camera image 710 is shown. For example, the second area 420 is a second area for displaying the image input to the in-camera and a second-2 area for displaying the image input to the out-camera. May include. In other words, the in-camera image 410 may be displayed on the messaging interface while the user input is recognized in the 2-1 area, and out while the user input is recognized in the 2-2 area. The camera image 710 may be displayed on the messaging interface. Therefore, the user can change the in-camera and the out-camera while maintaining one long press touch.

FIG. 8 is a diagram showing an example of changing the image displayed on the messaging interface from the image input to the out-camera to the image input to the in-camera according to the embodiment of the present invention. In the embodiment of FIG. 8, the camera to be activated is changed again from the out-camera to the in-camera by changing (or moving) the position where the user input is recognized, and the image displayed on the messaging interface is also an out-camera image. An example of changing from 710 to the in-camera image 410 is shown. In the above example, by changing the position where the user input is recognized from the 2-2 area to the 2-1 area, the camera to be activated and the displayed image may be changed.

As another embodiment, the in-camera and the out-camera may be switched based on the direction in which the position where the user input is recognized moves, instead of dividing the second region 420 into another region. For example, in the electronic device 1 (110), when the position where the user input is recognized moves from the left to the right, the in-camera is switched to the out-camera, and the position where the user input is recognized moves from the right to the left. When moving, the out-camera may be switched to the in-camera.

FIG. 9 is a diagram showing an example of transmitting an out-camera image in one embodiment of the present invention. The embodiment of FIG. 9 is based on the fact that the position where the user input is recognized deviates from the second region 420 while the out-camera image 710 input to the out-camera is displayed on the messaging interface. An example is shown in which at least one frame is captured from an input video and transmitted by a messaging service. In FIG. 9, the out-camera image 710 is transmitted to the third region 610 as a frame input to the out-camera when the position where the user input is recognized deviates from the second region 420. The displayed example is shown.

FIG. 10 is a flowchart showing an example of the interaction method in one embodiment of the present invention. The interaction method according to this embodiment may be executed by a computer device such as electronic device 1 (110). For example, the processor 212 of the electronic device 1 (110) may be implemented to execute a control instruction (instruction) by the code of the operating system included in the memory 211 and the code of at least one program. Here, the processor 212 electronically causes the electronic device 1 (110) to perform steps 1010 to 1060 included in the interaction method of FIG. 10 according to a control instruction provided by the code recorded in the electronic device 1 (110). The device 1 (110) may be controlled.

In step 1010, the electronic device 1 (110) is a screen of the electronic device 1 (110) based on an application installed on the electronic device 1 (110) and executed on the electronic device 1 (110) in connection with the messaging service. A messaging interface may be provided on top. The application may include, but is not limited to, the messenger application as described in the embodiments of FIGS. 3-9. For example, the application may be one of applications for a variety of messaging services such as SMS (Short Messaging Service), MMS (Multi-media Messaging Service), or email service. The messaging interface may mean a user interface that the application provides to the user for sending and receiving messages.

At step 1020, the electronic device 1 (110) may activate the camera in response to the recognition of user input in the first area set in the messaging interface. As a specific embodiment, the screen of the electronic device 1 (110) may include a touch screen screen, and the user input may include a touch input to such a touch screen screen. At this time, the electronic device 1 (110) responds to the fact that the touch input is recognized in the first region (for example, the first region 320 described with reference to FIG. 3) for a preset time or longer, and the camera responds. May be started. Depending on the embodiment, the camera may be included in the electronic device 1 (110) or may include any one of an in-camera and an out-camera connected to the electronic device 1 (110). The camera to be activated may be changed from the in-camera to the out-camera or from the out-camera to the in-camera depending on the conditions, as described below.

In step 1030, the electronic device 1 (110) responds to the recognition of the user input in the first region set in the messaging interface and responds to the second region (as an example, FIGS. 4, 5, 7, and). A user interface for visually displaying the second region 420) described with reference to FIG. 8 may be provided by a messaging interface. In such a second area, information for notifying that the user can change the in-camera and the out-camera by changing the position of the user input may be displayed.

In step 1040, the electronic device 1 (110) may display the video input to the activated camera on the messaging interface based on the recognition of the user input being maintained in the second region. In this case, the second region may be set in the messaging interface to include at least the first region. In other words, if the user generates a long press touch in the first area and maintains the touch, the camera may be activated and the video input to the camera may be displayed on the messaging interface.

At this time, the electronic device 1 (110) displays the image input at the position related to the position where the user input is recognized, but the position where the user input is recognized is changed in the second area. , The position where the input video is displayed may be dynamically changed.

In step 1050, the electronic device 1 (110) switches the camera from the in-camera to the out-camera or switches the switched out-camera again based on the position in which the user input is recognized moves within the second region. You may switch to the in-camera. In this case, the electronic device 1 (110) may display the image input to the in-camera or the out-camera on the messaging interface. For example, when the activated camera is an in-camera, the electronic device 1 (110) may display the image input to the in-camera on the messaging interface, and when the activated camera is an out-camera, the electronic device 1 (110). ) May display the image input to the out-camera on the messaging interface.

As one embodiment, the electronic device 1 (110) inserts a camera to be activated when the position where the user input is recognized moves from the 2-1 region included in the second region to the 2-2 region. When the camera is switched to the out-camera and the position where the user input is recognized moves from the 2-2 area to the 2-1 area again, the activated camera is switched from the switched out-camera to the in-camera again. It's okay.

In another embodiment, the electronic device 1 (110) switches the activated camera from the in-camera to the out-camera or reinserts the switched out-camera based on the direction in which the position where the user input is recognized moves. You may switch to the camera. For example, use the out-camera when the position where user input is recognized moves from left to right, and use the in-camera when the position where user input is recognized moves from right to left. You may switch.

The camera activated by default may be an in-camera or an out-camera.

In step 1060, the electronic device 1 (110) captures at least one frame from the video input to the activated camera based on the position where the user input is recognized deviates from the second region, and is used in the messaging service. You may send it.

As one embodiment, the second region includes at least the first region and is described as a third region (as an example, with reference to FIGS. 6 and 9), which displays messages sent and received by the messaging service on the messaging interface. It may be set in the messaging interface so as to be adjacent to the area 610). In this case, the electronic device 1 (110) may transmit at least one frame when the position where the user input is recognized deviates from the second region and moves to the third region.

In this way, the user can generate one long press touch and select a camera (in-camera or out-camera) to take a picture before releasing the touch, taking a picture. And you can send the pictures you take with the messaging service. Therefore, the process for selecting a camera, taking a picture, and transmitting can be significantly reduced, and the convenience of the user can be improved.

FIG. 11 is a diagram showing an example in which a user long press touches a user interface area for loading a photograph stored in an album in another embodiment of the present invention. The embodiment of FIG. 11 is based on a messenger application installed in electronic device 1 (110) and executed in electronic device 1 (110) in connection with a messaging service, and messaging on screen 310 of electronic device 1 (110). An example in which an interface is provided is shown, and an example in which user input occurs in the first region (1110) set in the messaging interface is shown. At this time, the electronic device 1 (110) may access a plurality of contents stored in the electronic device 1 (110) in response to the recognition of the user input. For example, the electronic device 1 (110) according to the present embodiment may be a smartphone including a touch screen screen, and the user input may be a long press touch with respect to the first area 1110. In this case, the electronic device 1 (110) may access a plurality of contents when the user's touch to the first region 1110 is maintained for a preset time or longer. At this time, the types of the plurality of contents that can be accessed by the electronic device 1 (110) may differ depending on the user interface set in the first region (1110). In this embodiment, a preset number of images in which a plurality of contents have been recently stored in connection with an album application installed on the electronic device 1 (110) and executed on the electronic device 1 (110). Or consider an example that includes a video.

Depending on the embodiment, the user interface shown in the first area 1110 may include the function of providing an image or video stored in an album upon touch by the user. In other words, if the user simply touches the user interface shown in the first area 1110, the image or video stored in the album is provided and the user selects one of the provided images or video. It may provide a function to enable transmission. On the other hand, when the user long press touches the user interface shown in the first area 1110, as described below, the image or video is selected before the corresponding long press touch is released. A function that can be transmitted may be provided.

FIG. 12 is a diagram showing an example in which a photograph stored in an album is displayed on a messaging interface for a messaging service in another embodiment of the present invention. The electronic device 1 (110) may display the content of one of the plurality of contents on the messaging interface based on the recognition of the user input being maintained in the second region 1220. In the embodiment of FIG. 12, the electronic device 1 (110) interfaces with the most recent image, the first image 1210, of a preset number of images recently stored in connection with the album application. The example shown above is shown. At this time, the image displayed on the messaging interface may be selected based on the position where the user input is recognized in the second region 1220.

13 and 14 are diagrams showing an example in another embodiment of the present invention in which the photographs displayed on the messaging interface are sequentially changed by moving the position where the user input is recognized. 13 and 14 show that the image displayed on the messaging interface is the first image 1210 described with reference to FIG. 12 by changing the position in which the user input is recognized in the second region 1220. The second image 1310 and the second image 1310 to the third image 1410 are shown in order.

As one embodiment, the electronic device 1 (110) sequentially associates a preset number of images or videos with a preset number of regions included in the second region 1220, and a preset number of regions. Of these, the image or video corresponding to the area including the position where the user input is recognized may be displayed on the messaging interface. For example, the second region 1220 may be divided into five regions so as to correspond to the five images, and each time the user input is recognized in each region, the image corresponding to the corresponding region is displayed on the messaging interface. May be done.

Further, the electronic device 1 (110) displays an image corresponding to a position related to the position where the user input is recognized in the second area 1220, but the position where the user input is recognized is changed in the second area. Thereby, the position where the corresponding image is displayed may be dynamically changed. 12 to 14 show that by changing the position where the user input is recognized, not only the displayed image is changed, but also the position where the image is displayed is changed.

FIG. 15 is a diagram showing an example of transmitting a currently displayed photograph in another embodiment of the present invention. The embodiment of FIG. 15 shows an example in which the third image 1410, which is an image displayed on the messaging interface, is transmitted by the messaging service when the position where the user input is recognized deviates from the second region. .. Further, in the embodiment of FIG. 15, when the third image 1410 is transmitted by the messaging service, the third image 1410 is displayed as a transmitted message in the third area 610 for displaying the messages transmitted and received by the messaging service. The example is shown.

In this way, a single long press touch selects one of the most recently saved preset content before the touch is released, and the selected content is delivered to the messaging service. You will be able to send. Therefore, the process for selecting and transmitting the content can be significantly reduced, and the convenience of the user can be improved.

16 to 20 are views showing an example of a user interface for transmitting additional content in another embodiment of the present invention.

The embodiment of FIG. 16 shows an example in which the user generates user input for the additional function area 1610 for the additional function. Depending on the embodiment, the user input may be a long press touch and the user's general touch to the additional function area 1610 may be utilized to provide conventional additional functions.

The embodiment of FIG. 17 shows an example of providing various additional functions in response to recognition of user input for the additional function area 1610. Such various additional functions may be provided while the user's long press touch is maintained. In FIG. 17, a “Keep” interface, which is a user interface for displaying a preset number of files or media that the user has recently accessed, a preset number of geographical locations that the user has recently used. The "Location" interface, which is a user interface for displaying information, or a preset number of geographic location information that the user has recently visited, and a preset number of network addresses that the user has recently accessed. The "Address" interface, which is a user interface for displaying the above, is shown respectively.

The embodiment of FIG. 18 is an example in which three files recently used by the user are displayed by the user moving the touch position while maintaining the long press touch and selecting the “Keep” interface. Is shown.

The embodiment of FIG. 19 shows an example in which the user selects the "aaa.mp3" file by moving the touch position while maintaining the long press touch. At this time, the "aaa.mp3" file may be selected based on the position where the release of the long press touch is recognized.

The embodiment of FIG. 20 shows an example in which the "aaa.mp3" file is transmitted by the messaging service by selecting the "aaa.mp3" file in the embodiment of FIG. In other words, the embodiment of FIG. 20 shows an example in which the message 2010 for the "aaa.mp3" file is displayed in the third area 610 displaying the messages sent and received by the messaging service.

In this way, the user can select and send the recently accessed file with one long press touch. This may apply not only to files, but also to recently accessed media, recently accessed network addresses, geolocations, and so on. At this time, the geolocation information may include GPS (Global Positioning System) coordinates.

To this end, electronic device 1 (110) provides information about files recently accessed by the user, information about media recently accessed, information about recently used network addresses, geolocation information, and / or. You may monitor, store, and manage your recent visits to geolocation information.

FIG. 21 is a flowchart showing an example of the interaction method in another embodiment of the present invention. The interaction method according to this embodiment may be executed by a computer device such as electronic device 1 (110). For example, the processor 212 of the electronic device 1 (110) may be implemented to execute a control instruction (instruction) by the code of the operating system included in the memory 211 and the code of at least one program. Here, the processor 212 electronically causes the electronic device 1 (110) to perform steps 2110 to 2150 included in the interaction method of FIG. 21 according to a control instruction provided by the code recorded in the electronic device 1 (110). The device 1 (110) may be controlled.

At stage 2110, device 1 (110) provides a messaging interface on the screen of a computer based on an application installed on device 1 (110) and executed on device 1 (110) in connection with a messaging service. May be provided. The application may include, but is not limited to, the messenger application as described in the embodiments of FIGS. 11-20. For example, the application may be one of applications for a variety of messaging services such as SMS (Short Messaging Service), MMS (Multi-media Messaging Service), or email service. The messaging interface may mean a user interface that the application provides to the user for sending and receiving messages.

In step 2120, the electronic device 1 (110) may access the plurality of contents stored in the computer in response to the recognition of the user input in the first area set in the messaging interface. As a specific embodiment, the screen of the electronic device 1 (110) may include a touch screen screen, and the user input may include a touch input to such a touch screen screen. At this time, the electronic device 1 (110) responds to the fact that the touch input is recognized in the first region (for example, the first region 1110 described with reference to FIG. 11) for a preset time or longer, and a plurality of electronic devices 1 (110) respond to the recognition. You may access the contents of. In one embodiment, the plurality of contents is a preset number of images stored recently in connection with an album application installed on the electronic device 1 (110) and executed on the electronic device 1 (110). Or it may include a video.

In step 2130, the electronic device 1 (110) responds to the recognition of the user input in the first region set in the messaging interface, with the second region (as an example, FIGS. 12, 13, and 14). A user interface for visually displaying the second region 1220) described with reference to may be provided by a messaging interface. Such a second area may be set in the messaging interface so as to include at least the first area, and the second area can be provided with additional content by the user changing the position of the user input. Information may be displayed to inform that.

In step 2140, the electronic device 1 (110) displays the content of one of the plurality of contents on the messaging interface based on the fact that the recognition of the user input is maintained in the second area, but in the second area. One content may be selected and displayed from a plurality of contents based on the position where the user input is recognized. For example, the electronic device 1 (110) sequentially associates a preset number of images or videos with a preset number of areas included in the second area, and inputs a user from the preset number of areas. The image or video corresponding to the area containing the recognized location may be displayed on the messaging interface. Further, the electronic device 1 (110) displays one content selected at a position related to the position where the user input is recognized in the second area, but the position where the user input is recognized is changed in the second area. By doing so, the position where one selected content is displayed may be dynamically changed. In other words, the position of the displayed content and the displayed content may be controlled based on the position where the user input is recognized is changed in the second area, which is the displayed content and the display. It may mean that at least a part of the position of the content to be created can be controlled only by the user having a long press touch.

In step 2150, the electronic device 1 (110) transmits the content displayed on the messaging interface among the plurality of contents by the messaging service based on the position where the user input is recognized deviates from the second region. It's okay. Depending on the embodiment, the second region may be configured in the messaging interface to include at least the first region and to be adjacent to a third region 610 displaying messages sent and received by the messaging service on the messaging interface. In this case, the electronic device 1 (110) may transmit the displayed content when the position where the user input is recognized deviates from the second area and moves to the third area.

Depending on the embodiment, the electronic device 1 (110) responds to the recognition of the user input to the fourth region (as an example, the additional functional region 1610 described with reference to FIG. 16) set in the messaging interface, and the user is here. A user interface for displaying a preset number of recently accessed files or media (as an example, the "Keep" interface described with reference to FIGS. 17-19) was displayed and displayed in the user interface. Of the preset number of files or media, the file or media selected by the user may be sent by the messaging service.

As another embodiment, the electronic device 1 (110) responds to the recognition of the user input for the fourth region set in the messaging interface and displays a preset number of network addresses that the user has recently accessed. A user interface for this purpose (as an example, the "Addless" interface described with reference to FIGS. 17-19) is displayed and selected by the user from a preset number of network addresses displayed in the user interface. The network address may be sent by the messaging service.

As another embodiment, the electronic device 1 (110) responds to the recognition of the user input for the fourth region set in the messaging interface, and the user has recently used a preset number of geolocation information. Or display a user interface for displaying a preset number of geolocations that the user has recently visited (as an example, the "Location" interface described with reference to FIGS. 17-19). Of the preset number of geolocation information displayed in the user interface, the geolocation information selected by the user may be transmitted by the messaging service.

In this way, the user can generate one long press touch, select and send the image or video stored in the terminal before releasing the touch, and one long press. Touch will allow you to select and send recently accessed / used files, media, network addresses, geolocation information, and more. Therefore, the process for selecting, generating, and transmitting information can be significantly reduced, and the convenience of the user can be improved.

As described above, according to the embodiment of the present invention, in a messaging service environment provided by a computer including a camera such as a smartphone, a user can easily take a picture with the camera and share it. In addition to the photos stored on the computer, files and media accessed by the user, network addresses, geolocation information, etc. can be easily shared on the messaging service.

The system or device described above may be implemented by a hardware component, a software component, or a combination of a hardware component and a software component. For example, the apparatus and components described in the embodiments include, for example, a processor, a controller, an ALU (arithmetic logic unit), a digital signal processor, a microprocessor, an FPGA (field programgate array), a PLU (programmable log unit), and a micro. It may be implemented utilizing one or more general purpose computers or special purpose computers, such as a processor or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also respond to the execution of the software, access the data, and record, manipulate, process, and generate the data. For convenience of understanding, one processing device may be described as being used, but one of ordinary skill in the art may include a plurality of processing elements and / or a plurality of types of processing elements. You can understand. For example, the processing device may include multiple processors or one processor and one controller. Also, other processing configurations such as parallel processors are possible.

The software may include computer programs, codes, instructions, or a combination of one or more of these, configuring the processing equipment to operate at will, or instructing the processing equipment independently or collectively. You may do it. The software and / or data is embodied in any type of machine, component, physical device, virtual device, computer recording medium or device to be interpreted based on the processing device or to provide instructions or data to the processing device. May be converted. The software is distributed on a computer system connected by a network and may be recorded or executed in a distributed state. The software and data may be recorded on one or more computer-readable recording media.

The method according to the embodiment may be realized in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. Computer-readable media may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on a computer-readable medium may be those specially designed and configured for the embodiment or may be usable as known to those skilled in the art of computer software. Examples of computer-readable recording media include hard disks, floppy disks, magnetic media such as magnetic tapes, optical media such as CD-ROMs and DVDs, and optical magnetic media such as floptic discs. And includes hardware devices specially configured to record and execute program instructions such as ROM, RAM, flash memory, etc. Such a recording medium may be a variety of recording or storage means in the form of a combination of a single piece of hardware or a combination of hardware, and is not limited to a medium directly connected to a computer system, and may be on a network. It may exist in a dispersed manner. Examples of program instructions include machine language code, such as those generated by a compiler, as well as high-level language code, which is executed by a computer using an interpreter or the like.

As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art will be able to make various modifications and modifications from the above description. For example, the techniques described may be performed in a different order than the methods described, and / or components such as the systems, structures, devices, circuits described may be in a different form than the methods described. Appropriate results can be achieved even if they are combined or combined, or replaced or replaced by other components or equivalents.

Therefore, even if the embodiments are different, they belong to the attached claims as long as they are equivalent to the claims.

Claims (18)

A computer program for connecting to a computer and causing the computer to execute an interaction method.
The interaction method is
The stage of providing a messaging interface on the screen of the computer based on an application installed on the computer and running on the computer in connection with the messaging service.
A step of accessing a plurality of contents stored in the computer in response to the recognition of user input in the first area set in the messaging interface.
Based on the fact that the recognition of the user input is maintained in the second area, the content of one of the plurality of contents is displayed on the messaging interface, but the position where the user input is recognized in the second area. Of the plurality of contents, the step of selecting and displaying one of the plurality of contents, and the position where the user input is recognized deviates from the second region. A computer program that includes the step of sending the content displayed on the messaging interface with the messaging service. The plurality of contents include a preset number of images or videos that have been recently stored in connection with an album application installed on the computer and run on the computer.
The computer program according to claim 1. The stage to be displayed is
The preset number of areas included in the second area are associated with the preset number of images or videos in order, and the position in which the user input is recognized is the position of the preset number of areas. Including displaying an image or video corresponding to the included area on the messaging interface.
The computer program according to claim 2. The stage to be displayed is
The selected content is displayed at a position related to the position where the user input is recognized in the second area, but the position where the user input is recognized is changed in the second area. Including dynamically changing the position where the selected content is displayed.
The computer program according to claim 1. The second region includes at least the first region and is set to the messaging interface so as to be adjacent to a third region for displaying messages sent and received by the messaging service on the messaging interface.
The transmission stage is
When the position where the user input is recognized deviates from the second area and moves to the third area, the content being displayed is transmitted.
The computer program according to claim 1. The second region is set in the messaging interface to include at least the first region.
The interaction method is
The first aspect of the messaging interface further comprises the step of providing the messaging interface with a user interface for visually displaying the second area in response to recognizing the user input in the first area set in the messaging interface. The computer program described in. The computer screen includes a touch screen screen.
The user input includes a touch input to the touch screen screen.
The access stage is
In response to the touch input being recognized in the first area for a preset time or longer, the present invention comprises accessing a plurality of contents stored in the computer.
The computer program according to claim 1. The interaction method is
A step of displaying a user interface for displaying a preset number of files or media that the user has recently accessed in response to recognizing user input to a fourth area set in the messaging interface. The computer program according to claim 1, further comprising the step of transmitting the file or media selected by the user among the preset number of files or media displayed on the user interface by the messaging service. The interaction method is
A stage of displaying a user interface for displaying a preset number of network addresses that the user has recently accessed in response to recognizing user input to a fourth region set in the messaging interface, and The computer program according to claim 1, further comprising a step of transmitting a network address selected by the user among a preset number of network addresses displayed on the user interface by the messaging service. The interaction method is
A preset number of geolocations that the user has recently used, or a preset that the user has recently visited, in response to recognizing user input to a fourth area set in the messaging interface. The stage of displaying the user interface for displaying the specified number of geolocation information, and the geolocation information selected by the user among the preset number of geolocation information displayed on the user interface. The computer program according to claim 1, further comprising the step of transmitting the above in the messaging service. The stage of providing a messaging interface on the screen of a computer based on an application installed on the computer and running on the computer in connection with the messaging service.
A step of accessing a plurality of contents stored in the computer in response to recognizing a user input in a first area set in the messaging interface.
Based on the fact that the recognition of the user input is maintained in the second area, the content of one of the plurality of contents is displayed on the messaging interface, but the position where the user input is recognized in the second area. Based on the step of selecting and displaying one content from the plurality of contents, and the position where the user input is recognized deviates from the second region, the said one of the plurality of contents. An interaction method that includes the step of transmitting the content displayed on the messaging interface by the messaging service. The plurality of contents include a preset number of images or videos that have been recently stored in connection with an album application installed on the computer and run on the computer.
The interaction method according to claim 11. The stage to be displayed is
The preset number of areas included in the second area are associated with the preset number of images or videos in order, and the position in which the user input is recognized is the position of the preset number of areas. Including displaying an image or video corresponding to the included area on the messaging interface.
The interaction method according to claim 12. The stage to be displayed is
The selected content is displayed at a position related to the position where the user input is recognized in the second area, but the position where the user input is recognized is changed in the second area. Including dynamically changing the position where the selected content is displayed.
The interaction method according to claim 11. A step of displaying a user interface for displaying a preset number of files or media that the user has recently accessed in response to recognizing user input to a fourth area set in the messaging interface, and 11. The interaction method of claim 11, further comprising the step of transmitting a file or media selected by the user out of a preset number of files or media displayed on the user interface by the messaging service. A stage of displaying a user interface for displaying a preset number of network addresses that the user has recently accessed in response to recognizing user input to a fourth region set in the messaging interface, and 11. The interaction method of claim 11, further comprising the step of transmitting a network address selected by the user out of a preset number of network addresses displayed on the user interface in the messaging service. In response to recognizing user input to a fourth area set in the messaging interface, a preset number of geolocations that the user has recently used, or pre-visited by the user. The stage of displaying the user interface for displaying a set number of geolocation information, and the geolocation selected by the user among the preset number of geolocation information displayed on the user interface. The interaction method according to claim 11, further comprising the step of transmitting information by the messaging service. A computer-readable recording medium in which a program for causing a computer to execute the method according to any one of claims 11 to 17 is recorded.

Images