JP2013198018A - Communication terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication terminal device which allows a terminal device which starts sharing of a browser and an opposite terminal device to share the browser including a mouse pointer image.SOLUTION: The communication terminal device which shares screen information with a communication opposite party comprises: display means which displays the screen information; pointer image selection means which selects the image of a pointer for designating the predetermined position of the screen information displayed by the display means; and control means which, in the case of starting sharing of the screen information with the communication opposite party, performs control to transmit information on the pointer image selected by the pointer selection means, to the communication opposite party.

Description

  The present invention relates to a communication terminal device that is connected to an IP telephone network or the like and transmits and receives audio and video, and in particular, displays the same data with a communication terminal device of a communication partner and displays the same mouse pointer. The present invention relates to a communication terminal device that can be displayed.

  2. Description of the Related Art In recent years, telephone devices that can receive various services such as data communication services by connecting to a wide-area communication network such as an IP telephone network or the Internet in addition to a general telephone line have become widespread. As a service for such a telephone device, a videophone service has been put into practical use. A user of a videophone service can make a voice call while transmitting and receiving a captured video by connecting a videophone device having a camera function and an image transmission function to a communication line.

  Also, various applications such as sharing memos created by each caller, sharing images obtained from other than camera shooting, sharing browsers for Internet resources, etc. A videophone device having a function of sharing data is also provided.

  For example, in the videophone device disclosed in the following Patent Document 1 (Japanese Patent Laid-Open No. 2004-228805), specific image data and the like related to conversation during a videophone call are transmitted simultaneously with the conversation by a multitasking network or the like. And the image data is transmitted to the other station during a call.

  Further, for example, the information processing apparatus disclosed in the following Patent Document 2 (Japanese Patent Laid-Open No. 2010-152772) has a function of a Web screen sharing / integration server, and controls event information on shared screen information shared by a shared terminal device. A script, an event transmission script, and an event reception script are incorporated, and a shared screen (embedded shared screen information) in which these scripts are incorporated is transmitted to each shared terminal device.

JP 2004-228805 A JP 2010-152772 A

  By the way, in the browser sharing function in the conventional videophone device as in the inventions of Patent Documents 1 and 2, when the user of each device customizes the mouse pointer image according to preference, as shown in FIG. In addition, the coordinate positions on the display screens pointed to by the mouse pointers on both terminals may not match, and the contents pointed to may be misaligned, which may prevent accurate sharing of browsers and hinder smooth communication. Is done.

Further, as in the invention of the above-mentioned Patent Document 2, providing an integration server as an information processing apparatus that provides a shared screen to each terminal increases the cost because it is necessary to construct a large-scale system. This service is not always convenient for general users who use home electric appliances such as telephone devices.

  An object of the present invention is to solve the above-described problems. In a terminal device on the browser sharing start side, information on a mouse pointer image is first transmitted to the partner terminal device when the sharing function starts. Accordingly, an object of the present invention is to provide a communication terminal device that can share a browser including a mouse pointer image between both terminal devices.

  In order to solve the above-described problem, a communication terminal device according to the present invention is a communication terminal device that shares screen information with a communication partner, a display unit that displays the screen information, and a display unit that displays the screen information. Pointer image selection means for selecting a pointer image for designating a predetermined position of the displayed screen information, and information regarding the pointer image selected by the pointer image selection means when sharing screen information with the communication partner is started And a control means for controlling to transmit to the communication partner.

  Also, one aspect of the communication terminal device of the present invention is a mode in which the pointer image is shared with the communication partner or a normal mode in which the pointer image can be customized in each communication terminal device. A setting unit configured to set; and when the sharing mode is set by the setting unit, the control unit controls to transmit information on the pointer image selected by the pointer image selecting unit. To do.

  According to another aspect of the communication terminal apparatus of the present invention, when the control unit receives information about the pointer image from the communication partner, the control unit selects a pointer image based on the received information about the pointer image. It controls to do.

  The present invention exhibits the excellent effects described below. That is, the communication terminal device of the present invention transmits the information of the pointer image selected by the communication terminal device on the user side at the start of sharing screen information to the communication terminal device of the call partner. As a result, the same pointer image as that of the communication terminal device on the user side can be reflected in the screen information of the communication terminal device of the communication partner, so that the mouse pointer image is completely matched between the two terminal devices. The operation of the pointer and the content indicated by the mouse pointer can be accurately shared with the communication partner, and smooth communication can be realized.

  Further, according to one aspect of the communication terminal device of the present invention, either a sharing mode in which a pointer image is shared with a communication partner or a normal mode in which the pointer image can be customized in each communication terminal device is set. The setting means is provided, and the control means transmits information related to the pointer image selected by the pointer image selection means when the sharing mode is set by the setting means. Thus, when the sharing mode is selected in the communication terminal device on the user side, the same pointer image as that on the communication terminal device on the user side can be reflected in the screen information of the communication terminal device on the other end of the call. By making the mouse pointer images completely match, it is possible to accurately share the operation of the mouse pointer and the content indicated by the mouse pointer with the communication partner, and provide a communication terminal device that is highly convenient for users in terms of sharing functions It becomes possible to do.

  Further, according to one aspect of the communication terminal device of the present invention, the same pointer image as the screen information of the communication terminal device of the communication partner is reflected in the screen information of the communication terminal device on the user side. This makes it possible to accurately share the operation of the mouse pointer and the content pointed to by the mouse pointer with the communication partner, thereby realizing smooth communication. In addition, it is possible to provide a communication terminal device that is highly convenient for users in terms of sharing functions.

It is a block diagram which shows the structure of the telephone system containing the video telephone apparatus based on the Example of this invention. It is an internal block diagram which shows the structure of the video telephone apparatus based on the Example of this invention. It is the sequence diagram which showed the control which the video telephone apparatuses based on a prior art share a browser. It is the sequence diagram which showed the control in which the video telephone apparatuses based on the Example of this invention perform browser sharing. It is a flowchart which shows operation | movement of the video telephone apparatus 100 by the side of the user in the browser sharing process based on the Example of this invention. It is a flowchart which shows operation | movement of the video telephone apparatus 100 'of a telephone call other party in the browser sharing process based on the Example of this invention.

  Hereinafter, specific examples of the present invention will be described in detail with reference to examples and drawings. However, the embodiment described below exemplifies a videophone device for embodying the technical idea of the present invention, and is not intended to specify the present invention as this videophone device. The present invention can be equally applied to communication terminal devices of other embodiments included in the scope of claims.

  FIG. 1 is a block diagram showing a configuration of a telephone system including a videophone device according to an embodiment of the present invention. This system includes at least a video phone device 100, a wired LAN 101, an IP telephone router 102, a broadband router 103, a gateway 104, an IP telephone network 105, the Internet 106, a PSTN network 107 (= Public Switched Telephone Network), a subscription. Mobile phone device 108 and home gateway 109 (HGW = Home Gateway).

  The videophone device 100 of the present invention is connected to a wired LAN 101 via a home gateway 109, and the wired LAN 101 is connected to an IP communication network 105 via an IP telephone router 102, an internet 106 via a broadband router 103, and a gateway 104. By connecting to the PSTN network 107 via the network, communication is possible. Details of the internal structure of the videophone device 100 will be described later.

  Examples of physical means constituting the wired LAN 101 include 10BASE-T (standardized as IEEE802.3i) and 100BASE-TX (standardized as IEEE802.3u) using a twisted pair cable.

The IP telephone router 102 and the broadband router 103 are network relay devices for interconnecting a plurality of IP networks. Specifically, OSI (Open Systems
Interconnection) Transfer is performed by analyzing a part of the protocol of the network layer (third layer) and the transport layer (fourth layer) in the reference model.

  In this embodiment, the IP telephone router 102 has a role of connecting two IP networks of the wired LAN 101 and the IP telephone network 105 to each other. The broadband router 103 has a role of connecting two IP networks of the wired LAN 101 and the Internet 106 to each other.

The gateway 104 is a protocol converter for interconnecting networks having different protocol systems. The gateway 104 is, for example, a wired LAN 101 and a PSTN.
Communication between both networks is enabled by connecting to the network 107 and performing signal conversion using a signaling protocol such as SIP.

The IP telephone network 105 is a communication network using VoIP (Voice over Internet Protocol) technology for part or all of the telephone network, and FTTH (Fiber To The) is used as a communication line to be used.
A so-called broadband line such as Home) or ADSL (Asymmetric Digital Subscriber Line) is used. Note that a plurality of videophone devices 100 ′ are connected to the IP telephone network 105 via the home gateway 109 ′, but only one unit is shown in FIG. 1 for simplicity.

  Note that VoIP is a technology in which voice is compressed by various encoding methods, divided into packets, and transmitted in real time over an IP network. As a result, the IP telephone network 105 can provide a videophone service for transmitting and receiving images in addition to a voice call service.

  The Internet 106 is a wide area communication network constructed by interconnecting networks based on communication protocols. An international communication network is constructed by interconnecting large and small computer networks. As a communication protocol, TCP / IP is mainly adopted as a standard protocol.

  The PSTN network 107 is a general subscriber telephone line network. A subscriber telephone device 108 is connected to the terminal, and is used to make a voice call by connecting to a communication partner by a circuit switching method. The subscriber telephone device 108 uses the PSTN network 107 to allow the telephone subscriber to make a voice call with another subscriber telephone device connected to the PSTN network or with a videophone device connected to the wired LAN 101 or the IP telephone network 105. Telephone equipment.

  The home gateway 109 is a home device installed between the wired LAN 101 or the IP telephone network 105 and the videophone device 100 or 100 ′, and has a role of connecting to each other.

  Next, the videophone device 100 of the present embodiment will be described with reference to FIG. FIG. 2 is an internal block diagram showing the configuration of the videophone device 100 according to the embodiment of the present invention. The videophone device 100 includes a control unit 110, a communication unit 120, an audio processing unit 130, a video and image processing unit 140, an operation unit 150, a recording unit 160, a clock unit 170, and a power supply unit 180.

  The control unit 110 is a microprocessor that includes a CPU, a RAM, and a ROM. The CPU executes a control program stored in the RAM or ROM, thereby controlling and supervising the operation of each unit described below. .

  The communication unit 120 is for performing communication control when the videophone device 100 communicates with another videophone device (videophone device 100 ′ in FIG. 1). This includes control related to signaling, data transmission / reception, and data sharing processing.

  The signaling includes processing for creating, establishing, and disconnecting a communication session. Specifically, when the user operates the operation unit 150 to input a telephone number or the like, the video telephone device of the other party of the call is connected to a SIP server (not shown) connected to the IP telephone network 105 or the like. 100 'location information is acquired, the other party's videophone device 100' is called, a communication path is established when the other party answers, and a session disconnect message or the like is transmitted when the call ends. To end the session.

For control related to data transmission / reception, IP packetization and IP packet transmission for dividing audio data, video data and image data into packets, packets received via the wired LAN 101 are rearranged in the correct order and actual data Receiving and assembling IP packets that extract and assemble parts.

  When data is transmitted as a packet, a header indicating the transmission source, destination, order, transmission time, and usage (IP phone audio data, video data, image data) is added to each data divided into predetermined data lengths. . The received packet is assembled in the correct order for each of the audio, video, and image by referring to the header portion, and is output to the audio processing unit 130 and the video and image processing unit 140.

  The voice processing unit 130 performs A / D conversion on the voice input from the microphone 131, and then compresses the voice by the voice codec, and outputs the compressed data to the communication unit 120. Also, the voice data assembled in the communication unit 120 is decompressed by a voice codec, then D / A converted and output from the speaker 132.

  The video and image processing unit 140 includes a video codec, compresses video captured by the camera 141, and outputs the compressed data to the communication unit 120. Also, the video data assembled in the communication unit 120 is expanded. The video and image processing unit 140 includes an image codec, expands the image data assembled in the communication unit 120, and stores the RAM 161 of the control unit 110 and the memory 161 or the flash memory 162 constituting the recording unit 160. expand.

  The video and image processing unit 140 has a display control function. The video data output from the camera 141 and the image developed in the RAM 161 of the control unit 110 and the memory 161 constituting the recording unit 160 or the flash memory 162. Data is converted into a predetermined form that can be displayed on the display unit 142 (enlarged, reduced, images are arranged side by side, etc.), developed on a video memory (not shown) of the display unit 142, and displayed on the display unit 142. .

  The sound collected by the microphone 131 is converted into a sound signal and output to the sound processing unit 130. In addition, the audio signal output from the audio processing unit 130 is converted into audio by the speaker 132 and output. The microphone 131 and the speaker 132 may be fixedly provided on the videophone device 100, but may be a headset. In the case of a headset, it is not necessary to hold the microphone 131 by hand, so convenience is enhanced.

  The camera 141 is for photographing a subject in front of the videophone device 100 during a call. Normally, the user is positioned in front of the videophone device 100, so the camera 141 takes a picture of the user as a subject. The captured video is output to the video and image processing unit 140.

  The display unit 142 is a liquid crystal display unit, and displays video and images developed on the video memory of the display unit 142 by the display control function of the video and image processing unit 140. The display unit 142 displays a mouse pointer image that designates a predetermined position of the displayed video or image.

  The operation unit 150 takes the form of a touch panel formed integrally with the display unit 142. The user performs an input operation by touching the part of the input icon displayed on the display unit 142. For example, when making a call, a numeric keypad for inputting a telephone number is displayed on the operation unit 150, and the user can input the number by pressing a corresponding part of the numeric keypad with a finger.

  The operation unit 150 also includes a normal mode in which the user can customize the mouse pointer image displayed on the display unit 142 according to his / her preference, and a sharing mode in which the same mouse pointer image as that of the videophone device 100 ′ of the communication partner is set. A user instruction for setting any of the above is accepted. Note that the operation unit 150 is not limited to the above, and may be a key or a button formed in a part of a casing constituting the videophone device 100.

  The recording unit 160 includes a memory 161 that is built in the videophone device 100 or a memory that can be connected / disconnected, such as a flash memory 162. The recording unit 160 stores data such as image data, text data, browser information, and multiple types of mouse pointer images for customization. When there is an instruction from the user, these data are transmitted as shared data to a videophone device 100 ′ as a communication partner or a server connected to the Internet 106. Further, the shared data transmitted from the videophone device 100 ′ as the communication partner and the shared data acquired from the server connected to the Internet 106 are stored.

  In addition, the recording unit 160 stores mouse data of a mouse pointer image selected by the user as shared data to be transmitted to the videophone device 100 ′ as the communication partner or a server connected to the Internet 106. .

  Further, the recording unit 160 stores an address book in which the telephone numbers and names of a plurality of communication partners are associated with each other. The sharability information may be set in advance by the user via the operation unit 150, or may be sharable once permitted to be shared even if it is registered as a “non-sharable” communication partner. The setting may be changed as an appropriate communication partner.

  Here, data sharing refers to screen information such as image data, text data such as a memo pad, application information such as a browser, and a mouse pointer image that designates a predetermined position on the screen displayed based on the screen information. Transmits the mouse data (hereinafter referred to as shared data) to the other party's videophone device 100 ′, receives the shared data at the videophone device 100 ′, and displays screen information based on the received shared data. Is displayed and the operation for the screen information is executed based on the operation information included in the shared data, or the shared data transmitted from the videophone device 100 ′ of the other party of the call is displayed in the videophone device 100. Receive and display screen information based on the received shared data and share data By displaying the mouse pointer image based on the mouse data included in the video data, the same image data, text data, and application can be obtained on the videophone device 100 used by the user and the videophone device 100 ′ that is the other party of communication. It means a state that can be referred to on the display unit 142 together with the same mouse pointer image.

  Furthermore, in the data sharing, in addition to the transmission / reception of the shared data in the one-to-one communication between the videophone device 100 and the videophone device 100 ′ of the communication partner, the shared data is transmitted via a server connected to the Internet 106. It is also included that transmits / receives or operates. For example, the shared data is transmitted by transmitting the shared data from the videophone device 100 to a server connected to the Internet 106, and the shared data is stored by accessing the above-mentioned server from the videophone device 100 ′ of the call partner. May be received or operated. Furthermore, the shared data transmitted from the videophone device 100 ′ as the call partner to the above-described server may be shared by accessing from the videophone device 100 so that it can be received or operated. .

The sharing start operation is the shared data stored in the storage unit 160 of the videophone device 100,
Alternatively, when the shared data temporarily stored in the RAM or the like of the control unit is transmitted to the videophone device 100 ′ of the call partner, the shared data is received by the videophone device 100 ′ of the call partner. Sending a request. Further, if the shared data is in the videophone device 100 ′ of the call partner, and the videophone device 100 ′ of the call partner wants to transmit this shared data to the videophone device 100 ′ (transmission request). To send to.

  Further, in the sharing start operation, when data is shared via a server (not shown) connected to the Internet 106, the shared data in the videophone device 100 is transmitted to the server, and the other party of the other party is called This includes transmitting a shared data reception request to the videophone device 100 ′.

  Further, in the sharing start operation, the shared data is in the videophone device 100 ′ of the call partner, and the videophone device 100 ′ of the call partner is transmitted so that the shared data is transmitted to a server connected to the Internet 106. Requesting to be included.

  The clock unit 170 is a circuit for measuring the current time, for example, using a crystal resonator that performs oscillation output at a predetermined frequency. The clock unit 170 can also manage not only time information but also calendar information related to the calendar such as the current month and day.

  The power supply unit 180 receives a predetermined DC voltage from the AC adapter 181 and supplies power to each component of the videophone device 100.

  In the control related to data sharing processing by the control unit 110, when the sharing start operation described above is performed, data such as image data, text data, and browser information displayed on the display unit 142 of the videophone device 100 by the user is stored in a memory, Screen information such as address information and URL data used for acquisition from the WEB server is stored in the recording unit 160 as shared data. Furthermore, the user selects via the operation unit 150 in order to customize a mouse pointer image that designates a predetermined position of image data, text data, and browser information (WEB content page) displayed on the display unit 142 of the videophone device 100. The mouse data of the mouse pointer image is stored in the recording unit 160 as shared data.

  Then, as a sharing start operation, a sharing request is notified to the video-phone device 100 ′ that is the call partner based on the user's instruction, that is, when the shared data is to be transmitted to the video-phone device 100 ′ that is the call partner. When a request for receiving shared data is transmitted to the telephone device 100 ′, and the shared data is requested to be transmitted from the videophone device 100 ′ of the other party, transmission of the shared data to the videophone device 100 ′ is performed. Send a request.

  When the sharing permission of the shared data is received from the videophone device 100 ′ of the other party in response to the above reception request, the URL of the WEB content page stored in advance in the recording unit 160 as the shared data The screen information such as data and the mouse data for designating the mouse pointer image are read from the recording unit 160 and transmitted to the videophone device 100 ′ of the other party.

Further, when the shared data is received from the videophone device 100 ′ as the call partner in response to the above transmission request, or a call is made according to the sharing permission of the shared data transmitted from the videophone device 100. When the shared data transmitted from the other party's videophone device 100 ′ is received by the videophone device 100, the display unit 142 is based on the URL data which is the screen information included in the received shared data. The WEB content page of the URL site is displayed on the browser activated above. Further, based on the mouse data included in the received shared data, the mouse pointer image to be displayed on the display unit 142 is recorded on the recording unit 160.
The same WEB content page is referenced on the display units 142 and 142 ′ together with the same mouse pointer image on the videophone device 100 used by the user and the videophone device 100 ′ that is the other party of the call. Make it ready.

  Next, browser sharing processing in the videophone devices 100 and 100 ′ of the present embodiment will be described with reference to FIGS. 3 to 6. FIG. 3 is a sequence diagram showing control for sharing a browser among videophone devices according to the prior art, and FIG. 4 is a control for performing browser sharing between videophone devices according to an embodiment of the present invention. It is the sequence diagram shown. FIG. 5 is a flowchart showing the operation of the videophone device 100 on the user side in the browser sharing process according to the embodiment of the present invention, and FIG. 6 shows the TV of the other party in the browser sharing process according to the embodiment of the present invention. It is a flowchart which shows operation | movement of telephone apparatus 100 '.

  First, referring to FIG. 3, a description will be given of control in which videophone devices according to the prior art share browsers. In step S301, the user operates the operation unit 150 of the videophone device (terminal A) 100 to input the telephone number of the videophone device (terminal B) 100 'of the other party connected to the IP telephone network 105. Alternatively, the user operates the operation unit 150 to call the address book stored in the recording unit 160 and select a call partner. Then, the communication unit 120 searches for the other party on the basis of the input telephone number or the information on the selected other party, calls the video telephone 100 'of the other party, and in step S302, the other party If the response is received, a communication session is established and a call is started. The call may be started from the videophone device 100 on the user side. Conversely, the videophone device 100 ′ on the other end of the call calls the videophone device 100 on the user side, and the user answers the call. A communication session may be established and a call may be started.

  In step S303, audio and video are transmitted and received between the videophone device 100 and the videophone device 100 'of the other party. Specifically, the voice input from the microphone 131 is A / D converted by the voice processing unit 130 and then compressed by the voice codec. The video captured by the camera 141 is displayed on the display unit 142 by the display control function provided in the video and image processing unit 140 and is compressed by the video codec provided in the video and image processing unit 140. Further, the compressed audio data and video data are each divided into IP packets in the communication unit 120 and transmitted to the wired LAN 101, and the transmitted audio data and video data are reproduced and displayed on the video telephone apparatus 100 ′ of the call partner. Is done.

  On the other hand, when voice data and video data transmitted as IP packets from the videophone device 100 ′ of the other party of call are received by the videophone device 100 on the user side, the communication unit 120 receives the IP packets as voice data, video data, etc. Divide by type, extract the actual data part from each divided packet, and assemble in order. Next, the audio data is decompressed by the audio codec of the audio processing unit 130, then D / A converted, output to the speaker 132, and output as audio. Further, the video data is expanded by a video codec included in the video and image processing unit 140, edited in a form that can be displayed on the display unit 142 by the display control function, and displayed on the display unit 142.

  Next, the user activates a WEB browser on the display unit 142 of the videophone device 100, operates the operation unit 150 to input a URL, and accesses a WEB server (not shown) connected to the Internet 106. Make a page request. The videophone device 100 acquires data of a desired WEB page from the WEB server, displays the WEB page on the browser on the display unit 142, and displays the mouse pointer image customized in the user-side videophone device 100 with the coordinate position (X , Y). At this time, the URL data input to display a desired WEB page is stored in the recording unit 160.

  After the normal browser operation as described above is executed, in step S304, when a sharing start operation is performed based on the user's instruction, the videophone device 100 transmits to the videophone device 100 ′ via the home gateway 109. In response to the reception request (UPDATE) of the shared data, the shared data sharing permission (200) is transmitted from the videophone device 100 'as the call partner to the reception request via the home gateway 109' in step S305. OK) is received.

  In step S306, the videophone device 100 reads the URL data of the WEB content page stored in the recording unit 160 and transmits the URL data to the videophone device 100 'of the other party.

  Based on the received URL data, the other party's videophone apparatus 100 'displays the WEB content page of the URL site on the browser activated on the display unit 142', and the other party's videophone apparatus 100 ' The customized mouse pointer image is displayed at the coordinate position (X ′, Y ′). Here, when a customized mouse pointer image is displayed on each of the videophone devices 100 and 100 ′, the coordinate position indicated by each mouse pointer does not match (X ≠ X ′ and / or Y ≠ Y ′). Then, the browser cannot be accurately shared between the user side and the call partner, and smooth communication is hindered.

  Therefore, in the embodiment of the present invention, as shown in FIG. 4, after a call is started in steps S401 to S403 and a normal browser operation is executed as in FIG. 3, in step S404, based on the user's instruction. When the sharing start operation is performed, the videophone device 100 transmits a shared data reception request (UPDATE) to the videophone device 100 ′ via the home gateway 109. In step S405, the videophone device 100 responds to the reception request. Then, the sharing permission (200 OK) of the shared data is received from the videophone device 100 ′ of the call partner via the home gateway 109 ′.

  In step S406, the videophone device 100 reads the mouse data of the mouse pointer image selected by the user stored in the recording unit 160 via the operation unit 150, and transmits it to the videophone device 100 ′ that is the other party of the call. To do.

  In step S407, the videophone device 100 reads the URL data of the WEB content page stored in the recording unit 160 and transmits the URL data to the videophone device 100 'of the other party.

  Based on the received URL data, the other party's videophone device 100 ′ displays the WEB content page of the URL site on the browser activated on the display unit 142 ′, and further displays the 142 page based on the received mouse data. The mouse pointer image to be displayed on 'is selected from the recording unit 160' in the same manner as the videophone device 100 on the user side and displayed at the coordinate position (X, Y). As a result, the same web content page can be displayed on each of the display units 142 and 142 ′ together with the same mouse pointer image in both the videophone device 100 used by the user and the videophone device 100 ′ of the other party. .

  Next, FIG. 5 shows an operation of the videophone device 100 on the user side in the browser sharing process according to the embodiment of the present invention.

First, in step S501, the control unit 110 activates a browser initialized to display a WEB content page based on the operation of the operation unit 150 by the user, and the user operates the operation unit 150 in step S502. It is determined whether or not a URL has been input.

  In step S502, if the control unit 110 determines that a URL has been input, the process proceeds to step S503, and the control unit 110 performs a normal browser operation. That is, a WEB page request is made to the WEB server connected to the Internet 106 based on the input URL information, the desired WEB page data is acquired from the WEB server, and the WEB page is displayed on the browser on the display unit 142. Is displayed. At this time, the control unit 110 stores the URL information input to display a desired WEB page in the recording unit 160.

  Next, in step S <b> 504, the control unit 110 determines whether the user has performed an operation on the WEB page displayed on the browser on the display unit 142 via the operation unit 150. If the control unit 110 determines that the operation has been performed, the process proceeds to step S505. If the control unit 110 determines that the operation has not been performed, the browser sharing process ends.

  In step S505, the control unit 110 determines whether a sharing start operation has been performed based on a user instruction. In step S505, when it is determined that the sharing start operation has been performed, the control unit 110 proceeds to the process of step S506, and when it is determined that the sharing start operation has not been performed, the process returns to the process of step S503.

  In step S506, the control unit 110 transmits a shared data reception request to the videophone device 100 'to attempt a shared session connection. In step S507, the control unit 110 determines whether the shared session connection is successful. As this condition, it is determined that the shared session connection is successful when the sharing permission of the shared data is received from the videophone device 100 'of the other party of the call in response to the transmitted reception request. If it is determined that the shared session connection has failed, the process proceeds to step S508. In step S508, the control unit 110 notifies the shared session connection failure through the display unit 142, and the process returns to step S503.

  If the control unit 110 determines in step S507 that the shared session connection is successful, the process proceeds to step S509, and the mouse data of the mouse pointer image selected by the user stored in the recording unit 160 via the operation unit 150 is obtained. Is read from the recording unit 160 and transmitted to the videophone device 100 ′ of the other party. It should be noted that the condition for transmitting the mouse data is that the operation unit 150 has previously set a sharing mode for displaying the same mouse pointer image in the videophone device 100 on the user side and the videophone device 100 ′ on the communication partner. is there.

  Next, in step S510, the control unit 110 reads the URL data of the WEB content page stored in the recording unit 160 from the recording unit 160 and transmits it to the videophone device 100 'of the other party.

  In step S511, the control unit 110 executes a browser sharing operation. That is, the WEB page is displayed on the browser on the display unit 142, and the mouse pointer image customized in the videophone device 100 on the user side is displayed. If the user operates the operation unit 150 to perform a scroll operation on the WEB page displayed on the browser on the display unit 142, the control unit 110 performs scroll control corresponding to the scroll operation and responds to the scroll operation. The operation data is transmitted to the video-phone device 100 ′ of the call partner.

In step S <b> 512, the control unit 110 determines whether or not the user has operated the WEB page displayed on the browser on the display unit 142 via the operation unit 150. If the control unit 110 determines that the operation has been performed, the process returns to step S511. If the control unit 110 determines that the operation has not been performed, the browser sharing process ends.

  FIG. 5 shows an operation of the videophone device 100 ′ as a call partner in the browser sharing process according to the embodiment of the present invention.

  First, in step S601, the control unit 110 ′ activates a browser initialized to display a WEB content page based on the “operation” of the operation unit 150. In step S602, the user operates the operation unit 150 ′. To determine whether or not a URL has been input.

  In step S602, if the control unit 110 'determines that a URL has been input, the process proceeds to step S603, and the control unit 110' performs a normal browser operation. That is, a WEB page request is made to the WEB server connected to the Internet 106 based on the inputted URL information, the desired WEB page data is acquired from the WEB server, and the WEB is displayed on the browser on the display unit 142 ′. The page is displayed, and a customized mouse pointer image is displayed on the videophone device 100 ′. On the other hand, if it is determined in step S602 that the URL has not been input, the control unit 110 'proceeds to the process of step S605.

  In step S604 during normal browser operation, the control unit 110 ′ determines whether or not the user has operated the WEB page displayed on the browser on the display unit 142 ′ via the operation unit 150 ′. To do. When it is determined that the operation has been performed, the control unit 110 ′ returns to the process of step S <b> 603, and when it is determined that the operation has not been performed, the process proceeds to step S <b> 605.

  In step S <b> 605, the control unit 110 ′ determines whether or not a sharing start operation has been performed from the videophone device 100 of the call partner. As this condition, it is determined that a sharing start operation has been performed when a shared data reception request is received from the videophone device 100 of the other party of the call. When it is determined that the sharing start operation has been performed, sharing permission of shared data is transmitted to the videophone device 100 of the other party of the call, and the process proceeds to step S606. When the control unit 110 ′ determines that the sharing start operation is not performed, the browser sharing process ends.

  In step S606, the control unit 110 'activates the initialized browser again, and in step S607, the control unit 110' determines whether mouse data has been received from the videophone device 100 of the communication partner. If it is determined that the mouse data has not been received, the control unit 110 ′ sets the mouse pointer image customized in the videophone device 100 ′ to be displayed in step S <b> 608. On the other hand, if it is determined in step S607 that the mouse data has been received, the control unit 110 'sets to display the same mouse pointer image as the videophone device 100 on the user side based on the received mouse data.

  In step S610, the control unit 110 'executes a browser sharing operation. That is, the WEB page is displayed on the browser on the display unit 142 ′ based on the received URL data, and the same mouse pointer image as the videophone device 100 on the user side is displayed. Further, when a scroll operation is performed on the WEB page displayed on the browser on the display unit 142 of the videophone device 100 on the user side, the control unit 110 ′ performs scroll control accordingly.

In step S611, the control unit 110 ′ determines whether the user has performed an operation on the WEB page displayed on the browser on the display unit 142 ′. If the control unit 110 ′ determines that the operation has been performed, the process returns to step S610. If the control unit 110 ′ determines that the operation has not been performed, the browser sharing process ends.

  As described above, according to the present invention, when the browser sharing start operation is performed, the data of the mouse pointer image that designates a predetermined position on the browser screen set by the videophone device on the user side is transmitted to the videophone device of the call partner. By transmitting, the same mouse pointer image as that of the videophone device on the user side is displayed on the browser screen of the videophone device of the call partner. Accordingly, the same WEB content page can be displayed on each display unit together with the same mouse pointer image in both the videophone device used by the user and the videophone device of the other party of the call.

  In the above-described embodiment, the same scroll operation for the WEB content page in the video phone device 100 used by the user and the video phone device 100 ′ of the call partner has been described. However, the synchronization control for the screen operations other than the scroll operation is also performed. Good. The screen operation is not limited to the WEB content page, but may be image data or text data.

100 Videophone device 101 Wired LAN
102 IP telephone router 103 Broadband router 104 Gateway 105 IP telephone network 106 Internet 107 PSTN network 108 Subscriber telephone device 109 Home gateway 110 Control unit 120 Communication unit 130 Audio processing unit 131 Microphone 132 Speaker 140 Video and image processing unit 141 Camera 142 Display Unit 150 operation unit 160 recording unit 161 memory 162 flash memory 170 clock unit 180 power supply unit 181 AC adapter

Claims (3)

In a communication terminal device that shares screen information with a communication partner,
Display means for displaying the screen information;
Pointer image selection means for selecting a pointer image for designating a predetermined position of the screen information displayed on the display means;
Control means for controlling to transmit information about the pointer image selected by the pointer image selection means to the communication counterpart when sharing screen information with the communication counterpart;
A communication terminal device comprising: A setting unit configured to set one of a sharing mode for sharing the pointer image with the communication partner and a normal mode for customizing the pointer image in each communication terminal device;
2. The communication according to claim 1, wherein the control unit controls to transmit information related to the pointer image selected by the pointer image selection unit when a sharing mode is set by the setting unit. Terminal device.   2. The control unit according to claim 1, wherein when the information related to the pointer image is received from the communication partner, the control means controls to select a pointer image based on the received information related to the pointer image. Or the communication terminal device of 2.

Images