JP2005244866A - Information communication terminal and terminal control method, and terminal control program as well as record medium recording the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information communication terminal capable of informing which content is shared by a transmitting side and a receiving side, when a common image is displayed and a mark indicating a section, a topic od conversation, is displayed on the image at a respective display screen among a plurality of information communication terminals. <P>SOLUTION: A channel setting portion 203 sets a channel for television broadcasting to be received at a television broadcasting receiving porion 201. In addition, a mark information movement control portion 14 controls movement of a display position of a mark, based on input operation by a user from an input portion 5. Then, a communication control portion 14 transmits mark information indicative of a mark position generated by mark information generating portion 11 and channel information set by the channel setting portion 203 to other information communication terminals. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an information communication terminal and terminal control in which users using information communication terminals having a communication function can communicate with each other by displaying a common screen on the display screen of each information communication terminal. The present invention relates to a method, a terminal control program, and a recording medium on which the program is recorded.

  In recent years, mobile phones have become widespread as personal tools for easily communicating with remote parties, so that voice communication and e-mail communication can be performed on a daily basis regardless of age group. It has become.

  In addition, since it has become common to install camera functions on mobile phones, it is possible to transmit images such as still images and videos taken to the other party through communication using only voice and text, use video phone functions, etc. Communication with visual elements is possible. In addition, the addition of image information has dramatically improved the function as a communication tool, increasing convenience.

  In such communication with visual elements added, a common image is displayed on each other's display screen, such as by sending an image to be talked about to the other party, and a voice call is made on the topic related to that image. It is expected that the number of cases that will be discussed by function will continue to increase with the development of communication technology.

  As such a communication mode in which a common image is displayed on each other's display screen and a voice call is made on a topic related to the image, a videophone system or the like has been conventionally devised.

  In Patent Document 1, in a position designation display device such as a television communication system, a numeric operator (dial button) of a telephone is also used as a cursor moving operator, vector data is assigned to each numeric operator, and a plurality of numeric operations are performed. There has been disclosed a position designation display device that moves a cursor superimposed on an image based on a vector sum of vector data assigned to a numeric operator when the child is turned on.

  Further, in Patent Document 2, in a remote cursor position transmission device such as a video teleconference system using an analog line, mouse cursor information is multiplexed and transmitted by a DTMF signal and transmitted via a single analog telephone line. A remote cursor position transmission device that can simultaneously transmit mouse cursor information and voice is disclosed.

Further, Patent Document 3 discloses an information transmission apparatus that transmits locus data input by voice and coordinates following a facsimile transmission image. A receiving-side apparatus that receives data from the information transmission apparatus displays a trajectory image corresponding to the trajectory data on the screen of the display unit so as to overlap the facsimile image.
Japanese Patent No. 2794586 (issued on September 10, 1998) JP-A-8-179742 (publication date July 12, 1996) JP-A-8-149234 (publication date: June 7, 1996)

  Use an information communication terminal to send a topical image to the other party, display a common image on each other's display screen, and discuss the topic related to that image using the voice call function In such cases, it may be difficult to express in words when explaining the target part of the topic on the image.

  For example, when people who do not know the names of multiple people appear in an unaligned manner, when you want to show a person in the image, or when multiple objects are shown in the image, the name in the image is unknown Or when it is desired to indicate any of a plurality of icons on the display content.

  In addition, there are cases where it is easier to show the target portion on the image directly than to convey it in words, and it is easier to make mistakes, and there are cases where it is desirable to discuss various portions on the image while pointing to each other like a game.

  On the other hand, if the above-described conventional technique is used, it is possible to display the marks on the image shared between the transmission side and the reception side, but the following problems remain. become.

  First, if the images shared by the sender and receiver do not match, even if the landmarks are displayed together, the objects pointed to by the landmarks will be different and meaningless. End up. That is, in the above-described conventional technique, since it is assumed that the image to be shared is obvious, there is no indication on how to deal with which image should be shared in a situation where various images can be shared. There is a problem.

  Also, when the image shared between the transmitting side and the receiving side is moving image data, even if the same moving image data is displayed, if the display timing is different, the object pointed to by the mark is different. It will be. In other words, when sharing moving image data, the problem is how to mark the same object.

  In addition, when the image shared between the transmission side and the reception side is, for example, moving image data, if the display of the mark remains after the mark and the object pointed to the other party disappear from the display screen, May be confused when knowing.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to display a common image on a display screen between a plurality of information communication terminals and to be a topic of interest on the image. An object of the present invention is to provide an information communication terminal, a terminal control method, a terminal control program, and a recording medium on which this is recorded, which can solve a problem that occurs when a mark indicating a part is displayed.

  More specifically, an object of the present invention is to display a common image on a display screen between a plurality of information communication terminals, and to display a mark indicating a topic target portion on the image. It is another object of the present invention to provide an information communication terminal, a terminal control method, a terminal control program, and a recording medium recording the same, which can notify which content is shared between the transmission side and the reception side.

  Another object of the present invention is to display common video data on a display screen between a plurality of information communication terminals, and to display a mark indicating a topical part on the image. An object of the present invention is to provide an information communication terminal, a terminal control method, a terminal control program, and a recording medium on which the same is recorded so that the same object can be accurately pointed on the transmission side and the reception side.

  Still another object of the present invention is to display a common image on a display screen between a plurality of information communication terminals, and to display a mark indicating a topical part on the image. An object of the present invention is to provide an information communication terminal, a terminal control method, a terminal control program, and a recording medium recording the same, which can prevent the above-described adverse effects caused by unneeded marks.

  An information communication terminal according to the present invention, in order to solve the above problems, a display unit for displaying an image based on image information on a display screen, an input receiving unit having an input operator for receiving an input operation by a user, An information communication terminal comprising a communication unit for communicating information with other information communication terminals, content acquisition means for acquiring content data from the outside, content data acquired by the content acquisition means, And a display control means for controlling the display unit to display the mark on the display screen, and a mark for moving the display position of the mark based on input operation information received by the user by the input receiving unit. Information movement control means, mark information indicating the position of the mark, and a container indicating the provider of the content data displayed on the display unit It is characterized by comprising a communication control means for controlling the communication unit to transmit the tool providing source information to the other information communication terminal.

  The terminal control method according to the present invention includes a display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and another information communication terminal. A terminal control method for an information communication terminal comprising a communication unit that communicates information between the contents, a content acquisition step of acquiring content data from the outside, the content data acquired in the content acquisition step, and a landmark A display control step for controlling the display unit to display the mark on the display screen, and mark information movement control for moving the display position of the mark based on input operation information received by the user by the input receiving unit. A step, a mark information indicating the position of the mark, and a content data provider that is displayed on the display unit. It is characterized by having a communication control step of controlling the communication unit to transmit the Ntsu providing source information to the other information communication terminal.

  In the above configuration and method, content data acquired from the outside and a mark that is moved by an input operation by the user are displayed on the display unit. That is, the user can display a mark at an arbitrary position on the screen on which content data acquired from the outside is displayed on the display unit. The mark information indicating the position of the mark and the content provider information indicating the provider of the displayed content data are transmitted to other information communication terminals. In other words, the information communication terminal that has received them can recognize from the content provider information where to obtain the content data to be displayed, and in the state in which the content data is displayed, Can be displayed.

  Therefore, it is possible to transmit / receive the landmark information in the state where the same content data is displayed in both the information communication terminals on the transmission side and the reception side, and display on the reception side accurately in the state intended by the transmission side. It becomes possible to do.

  The information communication terminal according to the present invention further includes a television broadcast receiving unit that receives a television broadcast in the above configuration, and the content acquisition unit is a channel setting unit that sets a channel of the television broadcast to be received. The communication control unit may control the communication unit to transmit the channel information of the channel set by the channel setting unit as the content provider information.

  With such a configuration, it becomes possible for the information communication terminal on the reception side to recognize the channel information of the television broadcast displayed on the information communication terminal on the transmission side. Therefore, it is possible to transmit and receive the landmark information in the state where the television broadcast of the same channel is displayed in both the information communication terminals on the transmission side and the reception side, and in the state intended by the transmission side, it is possible to accurately transmit the information on the reception side. Display can be performed.

  In the information communication terminal according to the present invention, in the configuration described above, the content acquisition unit is a network content reception unit that acquires the content data from an external network via the communication unit, and the communication control unit includes The communication unit may be controlled to transmit, as the content provider information, address information of a network address where content data acquired by the network content receiving unit is provided.

  With this configuration, the information communication terminal on the reception side can recognize the network address where the content data displayed on the information communication terminal on the transmission side is provided. Therefore, the information communication terminals on both the transmission side and the reception side can transmit / receive the landmark information in a state where the same content data provided on the network is displayed. Can be displayed on the receiving side.

  An information communication terminal according to the present invention is an information communication terminal including a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. And communication control means for controlling the communication unit so as to receive landmark information and content provider information from the information communication terminal according to the present invention, and content data from the outside based on the received content provider information Content acquisition means for acquiring the content, and controlling the display unit to display the landmark on the display screen based on the received landmark information, and displaying the content data acquired by the content acquisition means And a display control means for controlling the display unit.

  The terminal control method according to the present invention is an information communication terminal comprising a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. A terminal control method, based on the communication control step for controlling the communication unit to receive landmark information and content provider information from the information communication terminal according to the present invention, and the received content provider information, A content acquisition step of acquiring content data from the outside, and the display unit is controlled to display a mark on the display screen based on the received mark information, and the content data acquired in the content acquisition step is And a display control step for controlling the display unit to display.

  In the above configuration and method, content data is acquired from the outside based on the content provider information received from the information communication terminal on the transmission side, and is displayed. The mark is displayed based on the mark information received from the information communication terminal on the transmission side. That is, the information communication terminal on the receiving side can recognize which content data should be displayed in a state where the mark is to be displayed.

  Therefore, it is possible to transmit / receive the landmark information in the state where the same content data is displayed in both the information communication terminals on the transmission side and the reception side, and display on the reception side accurately in the state intended by the transmission side. It becomes possible to do.

  In addition, an information communication terminal according to the present invention includes a display unit that displays an image based on image information on a display screen, a communication unit that communicates information with other information communication terminals, and a television that receives a television broadcast. An information communication terminal comprising a broadcast receiving unit, a communication control means for controlling the communication unit to receive landmark information and channel information from the information communication terminal according to the present invention, and a received channel information Channel setting means for setting a corresponding channel as a television broadcast channel to be received, and controlling the display unit to display a mark on the display screen based on the received mark information, and the channel setting means Display control means for controlling the display unit so as to display a television image of the channel set by

  In the above configuration, the television broadcast is received based on the channel information received from the information communication terminal on the transmission side and displayed. The mark is displayed based on the mark information received from the information communication terminal on the transmission side. That is, the information communication terminal on the receiving side can recognize which channel of the television broadcast should be displayed in the state in which the television broadcast is displayed.

  Therefore, it is possible to transmit and receive the landmark information in the state where the television broadcast of the same channel is displayed in both the information communication terminals on the transmission side and the reception side, and in the state intended by the transmission side, it is possible to accurately transmit and receive the landmark information Display can be performed.

  An information communication terminal according to the present invention is an information communication terminal including a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. And communication control means for controlling the communication unit to receive the landmark information and the address information from the information communication terminal according to the present invention, and the communication unit from the external network based on the received address information. Network content receiving means for acquiring the content data provided at the corresponding address, and controlling the display unit to display the landmark on the display screen based on the received landmark information, and receiving the network content Display control means for controlling the display unit so as to display the content data acquired by the means. It is a symptom.

  In the above configuration, the content data is acquired from the network based on the address information received from the information communication terminal on the transmission side, and is displayed. The mark is displayed based on the mark information received from the information communication terminal on the transmission side. That is, the information communication terminal on the receiving side can recognize at which network address the content data provided is displayed and the mark should be displayed.

  Therefore, the information communication terminals on both the transmission side and the reception side can transmit / receive the landmark information in a state where the same content data provided on the network is displayed. Can be displayed on the receiving side.

  In order to solve the above-described problem, an information communication terminal according to the present invention includes a display unit that displays an image based on image information on a display screen, and an input reception unit that includes an input operator that receives an input operation by a user. And a communication unit that communicates information with other information communication terminals, wherein the display unit is configured to display specific video data and a mark on the display screen. Display control means for controlling, mark information movement control means for moving the display position of the mark based on input operation information received by the user received by the input receiving part, and reproduction of the moving image data on the display part When started, the communication unit is controlled to transmit reproduction command information for instructing the reproduction start of the video data to other information communication terminals, and the reproduction command information is transmitted. After, and the mark information indicating the position of the landmark is characterized in that a communication control means for controlling the communication unit to transmit to said other information communication terminal.

  The terminal control method according to the present invention includes a display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and another information communication terminal. A display control step for controlling the display unit to display specific moving image data and a mark on the display screen. And a mark information movement control step for moving the display position of the mark based on the input operation information received by the user received by the input receiving unit, and when the reproduction of the moving image data is started on the display unit, The communication unit is controlled to transmit reproduction command information for instructing the start of reproduction of the moving image data to another information communication terminal, and the reproduction command information is transmitted. In, and a mark information indicating the position of the landmark is characterized by having a communication control step of controlling the communication unit to transmit to said other information communication terminal.

  In the above configuration and method, specific data and a mark that is moved by an input operation by the user are displayed on the display unit. That is, the user can display a mark at an arbitrary position on the screen on which specific moving image data is displayed on the display unit. When the reproduction of the specific moving image data is started, the reproduction command information of the moving image data is transmitted to another information communication terminal, and then the mark information is transmitted.

  That is, in both the information communication terminals on the transmission side and the reception side, the landmark information is transmitted and received in a state where the reproduction of the specific moving image data is started at almost the same timing. Therefore, in both the information communication terminals on the transmission side and the reception side, it is possible to substantially match the objects to be marked in the image of the moving image data.

  The information communication terminal according to the present invention may further include network content receiving means for acquiring the moving image data from an external network via the communication unit in the configuration described above, wherein the display control means includes the specific moving image. As the data, the display unit is controlled to display the moving image data acquired by the network content receiving unit on the display screen, and the communication control unit provides the moving image data acquired by the network content receiving unit. The communication unit may be controlled to transmit the address information of the network address to be transmitted to the other information communication terminal.

  According to this configuration, the information communication terminal on the receiving side can recognize the network address where the moving image data to be shared is provided. Therefore, it is possible to share the same moving image data provided on the network in both the information communication terminals on the transmission side and the receiving side, and to substantially match the object to which the mark in the image of the moving image data is attached. It becomes.

  The information communication terminal according to the present invention further includes an image information storage unit that stores the moving image data in the above configuration, and the display control unit stores the specific moving image data as the specific moving image data in the image information storage unit. The display unit is controlled to display the moving image data displayed on the display screen, and the communication control unit transmits the moving image data stored in the image information storage unit to the other information communication terminal. It is good also as a structure which controls the said communication part so that it may transmit.

  According to this configuration, in both the information communication terminals on the transmission side and the reception side, the moving image data stored in the information communication terminal on the transmission side is shared, and the mark in the image of the moving image data is attached Can be substantially matched.

  An information communication terminal according to the present invention is an information communication terminal including a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. The communication control means for controlling the communication unit to receive the reproduction command information and the landmark information of the moving image data from the information communication terminal according to the present invention, and when the reproduction command is received, the moving image And a display control means for controlling the display unit to start reproduction of data and display the moving image data, and to control the display unit to display a mark based on the received mark information. It is characterized by being.

  The terminal control method according to the present invention is an information communication terminal comprising a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. A terminal control method, comprising: a communication control step for controlling the communication unit to receive reproduction instruction information and landmark information of the moving image data from the information communication terminal according to the present invention; and when the reproduction instruction is received In addition, the display control step for controlling the display unit to start displaying the moving image data by starting the reproduction of the moving image data and to control the display unit to display the mark based on the received mark information. It is characterized by having.

  In the above configuration and method, specific moving image data to be shared is displayed according to the playback command information received from the transmitting information communication terminal, and the mark is displayed based on the mark information received from the transmitting information communication terminal. It is supposed to be.

  That is, in both the information communication terminals on the transmission side and the reception side, the landmark information is transmitted and received in a state where the reproduction of the specific moving image data is started at almost the same timing. Therefore, in both the information communication terminals on the transmission side and the reception side, it is possible to substantially match the objects to be marked in the image of the moving image data.

  An information communication terminal according to the present invention is an information communication terminal including a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. Based on the received address information, communication control means for controlling the communication unit so as to receive the reproduction instruction information of the moving image data, the address information, and the landmark information from the information communication terminal according to the present invention. Network content receiving means for obtaining moving image data provided at the corresponding address from the external network via the communication unit, and the network content receiving means that receives the playback command when the playback command is received. The display unit is controlled to start reproducing the moving image data and display the moving image data, and based on the received landmark information. Te is characterized by comprising a display control means for controlling the display unit to display the mark.

  In the above configuration, the video data provided at the address indicated by the address information similarly received from the information communication terminal on the transmission side is displayed according to the reproduction command information received from the information communication terminal on the transmission side, and the information on the transmission side is displayed. A landmark is displayed based on the landmark information received from the communication terminal.

  That is, in both the information communication terminals on the transmission side and the reception side, the landmark information is transmitted and received in a state where the reproduction of the moving image data provided on the network is started at almost the same timing. Therefore, even when the moving image data provided on the network is shared, it is possible to substantially match the object to which the mark in the image of the moving image data is attached in both the transmitting and receiving information communication terminals. It becomes possible.

  An information communication terminal according to the present invention is an information communication terminal including a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. The communication control means for controlling the communication unit to receive the reproduction instruction information of the moving image data, the moving image data, and the landmark information from the information communication terminal according to the present invention, and the reproduction instruction In this case, the display unit is controlled to display the moving image data by starting the reproduction of the moving image data received via the communication unit, and to display the mark based on the received mark information. And a display control means for controlling the display unit.

  In the above configuration, the moving image data received from the transmitting information communication terminal is displayed according to the reproduction command information received from the transmitting information communication terminal, and based on the landmark information received from the transmitting information communication terminal. A placemark is displayed.

  That is, in both the information communication terminals on the transmission side and the reception side, the landmark information is transmitted and received in a state where the reproduction of the moving image data stored in the information communication terminal on the transmission side is started at almost the same timing. . Therefore, even when the moving image data stored in the information communication terminal on the transmission side is shared, the object to which the mark in the image of the moving image data is attached in both the information communication terminals on the transmission side and the reception side. It is possible to make almost the same.

  In the information communication terminal according to the present invention, in the above configuration, when the display control unit receives the mark information, the information communication terminal recognizes and recognizes the object indicated by the mark information. A configuration in which the display position of the mark is moved following the movement of the object may be performed.

  According to this configuration, it is possible to recognize an object to be marked by image recognition, and to move the mark as the object moves. Therefore, the transmitting side only needs to transmit the mark information first, and can eliminate the need to transmit the mark information for moving the mark when the object in the image of the moving image data moves with time. Further, it is possible to solve the problem that the display timing shift between the moving image reproduction timing and the landmark information on the transmission side and the reception side occurs.

  In order to solve the above-described problem, an information communication terminal according to the present invention includes a display unit that displays an image based on image information on a display screen, and an input reception unit that includes an input operator that receives an input operation by a user. And a communication unit that communicates information with other information communication terminals, and displays a mark based on the user's input operation information received by the input reception unit Mark information creating means for creating mark information for designating a position, and communication control means for controlling the communication section so as to transmit the mark information and the mark deletion command to another information communication terminal. It is characterized by having.

  The terminal control method according to the present invention includes a display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and another information communication terminal. A terminal control method for an information communication terminal including a communication unit that communicates information between them, and a mark that specifies a display position of a mark based on input operation information received by the user by the input receiving unit A mark information creating step for creating information; and a communication control step for controlling the communication unit so as to transmit the mark information and an erase command for the mark to another information communication terminal. It is characterized by.

  For example, when using moving image data as shared content, it is important to delete the landmark information. For example, if you mark a specific object in a shared video and point it to the other party, the partner knows the object if the mark remains displayed after the object disappears from the display screen. It can be confusing. To avoid this situation, landmarks that are no longer needed should be deleted.

  On the other hand, in the above configuration and method, the mark information for designating the display position of the mark based on the input operation information by the user and the delete command for the mark are transmitted to other information communication terminals. It has become so. That is, the information communication terminal on the receiving side displays the mark according to the received mark information, and deletes the displayed mark when receiving the mark deletion command. Therefore, in the information communication terminal on the transmission side, when it is determined that the mark should be deleted, in the information communication terminal on the reception side, an instruction to delete the mark is explicitly given to the reception side. It is possible to prevent the above-described adverse effects caused by the mark remaining unnecessarily.

  The information communication terminal according to the present invention controls the display unit to display a mark based on the input operation information by the user received by the input receiving unit in the above configuration, and It is good also as a structure further provided with the display control means which controls the said display part so that the mark currently displayed with the erase | elimination command may be erase | eliminated.

  In this case, since the mark is displayed also on the information communication terminal on the transmitting side, it is possible to confirm on the transmitting side how the mark display and mark erasure instructions are performed.

  The information communication terminal according to the present invention may be configured such that, in the above configuration, an instruction to delete the mark is generated when an input operation indicating a delete instruction by a user is received by the input receiving unit. .

  According to this configuration, since a mark erasure command is generated based on a user's instruction, the mark is erased on the receiving side when the user determines that the mark should be erased. Therefore, it is possible to perform display control of the mark more in line with the user's intention.

  Further, in the information communication terminal according to the present invention, in the above configuration, when the input receiving unit has not received an input operation by a user for designating a display position of a mark for a predetermined period, the communication control unit However, the communication unit may be controlled to transmit an instruction for deleting the mark to another information communication terminal.

  According to this configuration, the mark erasure command is transmitted when the user's input operation regarding designation of the mark display position is not performed for a predetermined period. Here, the fact that the user's input operation regarding designation of the display position of the mark is not performed for a predetermined period of time is expected that the user no longer feels the necessity of displaying the mark. That is, when the user no longer feels the necessity of displaying the mark, it is possible to transmit the mark erasing command without requiring any operation by the user.

  An information communication terminal according to the present invention is an information communication terminal including a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. And a communication control means for controlling the communication unit to receive mark information and a mark erasure command from the information communication terminal according to the present invention, and a mark on the display screen based on the received mark information. And a display control means for controlling the display unit so as to erase the displayed mark when a mark erasing command is received. It is said.

  The terminal control method according to the present invention is an information communication terminal comprising a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. A terminal control method comprising: a communication control step for controlling the communication unit to receive mark information and a mark erasure command from the information communication terminal according to the present invention; and the received mark information on the display screen. And a display control step for controlling the display unit so as to erase the displayed mark when a mark erasing command is received. It is characterized by having.

  According to the above configuration and method, when the mark information is received from the information communication terminal on the transmission side, the mark is displayed based on the mark information, and when the mark deletion command is received, the mark displayed based on the mark is displayed. It is supposed to be erased. Therefore, it is possible to display and delete the mark as intended by the information communication terminal on the transmission side.

  An information communication terminal according to the present invention is an information communication terminal including a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. And a communication control means for controlling the communication unit to receive the mark information from another information communication terminal, and the display unit to display the mark on the display screen based on the received mark information. Display control means for controlling the display unit so as to erase the displayed mark when the communication control means does not receive the mark information for a predetermined period. It is a feature.

  The terminal control method according to the present invention is an information communication terminal comprising a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. A terminal control method for controlling the communication unit to receive landmark information from another information communication terminal, and displaying a landmark on the display screen based on the received landmark information. A display control step for controlling the display unit so as to erase the displayed mark when the communication control means does not receive the mark information for a predetermined period. It is characterized by that.

  According to the above configuration and method, first, when landmark information is received from the information communication terminal on the transmission side, the landmark is displayed based on the received landmark information. When the mark information is not received from the information communication terminal on the transmission side for a predetermined period, the mark is erased. Here, if the landmark information is not received from the information communication terminal on the transmission side for a predetermined period, it is expected that the user on the transmission side no longer feels the necessity of displaying the landmark. That is, when the user on the transmission side no longer feels the necessity of displaying the mark, the mark on the reception side can be deleted without requiring any operation by the user on the transmission side.

  A terminal control program of the present invention is a terminal control program for operating the information communication terminal in order to solve the above-described problem, and is characterized by causing a computer to realize the above means.

  According to said structure, the said information communication terminal is realizable with the said terminal control program.

  The recording medium of the present invention is characterized in that the terminal control program is recorded in order to solve the above problems.

  According to said structure, the said information communication terminal is realizable with the terminal control program read from the recording medium of this invention.

  As described above, the information communication terminal according to the present invention provides mark information indicating the position of the mark and content provider information indicating the provider of the content data displayed on the display unit to other information communication terminals. To send to. As a result, it is possible to transmit and receive landmark information in the state where the same content data is displayed in both the information communication terminals on the transmission side and the reception side, and display on the reception side accurately in the state intended by the transmission side. There is an effect that it is possible to perform.

  In addition, as described above, when the information communication terminal according to the present invention starts the reproduction of the moving image data, the information communication terminal transmits reproduction instruction information for instructing the reproduction start of the moving image data to another information communication terminal. After the reproduction command information is transmitted, the mark information indicating the position of the mark is transmitted to the other information communication terminal. As a result, the mark information is transmitted and received in a state in which the reproduction of the specific moving image data is started at almost the same timing. Therefore, in the information communication terminals on both the transmitting side and the receiving side, There is an effect that it is possible to substantially match the object to be marked.

  Further, as described above, the information communication terminal according to the present invention transmits the mark information and the mark deletion command to the other information communication terminals. As a result, when it is determined in the information communication terminal on the transmission side that the mark should be deleted, an instruction to delete the mark is explicitly given to the reception side, whereby the information communication terminal on the reception side Thus, it is possible to prevent the above-described adverse effects due to the mark remaining unnecessarily.

[Embodiment 1 as a premise of the present invention]
With reference to FIG. 1 to FIG. 14 (d), an embodiment as a premise regarding the information communication terminal, the terminal control method, the terminal control program, and the recording medium storing the information communication terminal according to the present invention will be described as follows. is there.

  As shown in FIG. 2, the mobile phone (information communication terminal) 10 of the present embodiment includes a display unit 4 having an effective display area 4a, an input unit 5 having a dial button 5a, a receiving unit 6a, and a transmitting unit 6b. Has the appearance.

  As shown in FIG. 1, the mobile phone 10 includes a control unit 1, a ROM (Read Only Memory) 2, a RAM (Random Access Memory) 3, a display unit 4, and an input unit (input reception unit) 5. The voice processing unit 6 and the communication unit 7 are provided.

  The control unit 1 includes a microcomputer, and operates according to an input operation from the input unit 5 and a control signal from the communication unit 7 in accordance with a computer program read from the ROM 2. The display unit 4, the communication unit 7, and the sound processing unit 6 is controlled. The functional blocks provided in the control unit 1 will be described in detail later.

  The ROM 2 is configured by a non-volatile memory such as a flash ROM, for example, and stores a computer program which is a terminal control program of the present invention executed by the control unit 1 and various data used by the control unit 1. Display contents such as photographic image data shared with the mobile phone 10 on the receiving side are also stored in the ROM 2.

  The computer program stored in the ROM 2 is not limited to that stored in the ROM 2 at the manufacturing / shipping stage in advance, and a storage medium such as a memory card is inserted into a storage medium reading unit (not shown). Thus, the program in the storage medium may be written in the ROM 2 or the storage medium itself may be a readable program medium. In addition, since the mobile phone 10 according to the present embodiment includes the communication unit 7 that can be connected to a communication network including the Internet, a program may be downloaded from the communication network and stored in the ROM 2.

  The RAM 3 is composed of a volatile memory such as SRAM or DRAM, for example, and is used as a work memory when the control unit 1 executes a computer program read from the ROM 2.

  The display unit 4 includes an FPD (flat panel display) such as a liquid crystal display or an organic EL display, and provides display information such as characters and images to the user by being controlled by the control unit 1. .

  The input unit 5 includes a plurality of input buttons for operating the mobile phone, including a dial button (key input operator) 5a for inputting a telephone number, characters, and the like.

  The voice processing unit 6 is connected to the receiver unit 6a and the transmitter unit 6b, outputs the voice signal input from the control unit 1 from the receiver unit 6a, and outputs the voice signal input from the transmitter unit 6b to the control unit 1 Process to output to.

  The communication unit 7 is a circuit that is connected to the antenna 7a and performs communication processing via a communication line by being controlled by the control unit 1. The communication unit 7 modulates a voice signal, data, a control signal, and the like with a high frequency, and the antenna 7a. The voice signal, data, and control signal received from the antenna 7a are demodulated and output to the control unit 1.

  In addition, when the communication unit 7 transmits / receives mark information (described later) to / from the mobile phone 10 on the receiving side, the transmission form of the mark information is digital data such as characters or a PB signal (DTMF). Are transmitted and received in a manner that can coexist with voice data for calls.

  Specifically, voice data for a call and digital data or PB signal (DTMF) are multiplexed and transmitted / received. When the transmission mode of the mark information is voice data, the voice data for the call and the voice data of the mark information are transmitted / received together.

  In this way, when digital data is used as the landmark information, the landmark information can be transmitted and received together with the voice data using a portable telephone capable of displaying an image. However, it is possible to talk about the object pointed by the mark displayed on the display screen.

  In addition, when a DTMF signal is used as the mark information, in particular, the transmission side uses a push button signal (PB signal) output function that is generally installed in a fixed telephone or the like, and the transmitting side makes a DTMF while making a call. A signal can be transmitted.

  Further, when the DTMF signal is used as the mark information, the mark information can be transmitted and received even when the communication line is used in the call mode instead of the data communication mode.

  In addition, when data consisting of voice is used as the landmark information, while communicating between communication lines and information communication terminals that cannot use data communication and voice call at the same time, and information communication terminals that cannot transmit and receive DTMF signals, The landmark information can be transmitted and received.

  In this case, when the input button is pressed by the user, the mobile phone 10 on the transmission side has voice data (for example, “1” when 1 is input and “ni” when 2 is input). Etc.) may be combined and transmitted to the mobile phone 10 on the receiving side. Alternatively, the mobile phone 10 on the transmission side stores voice data in a storage unit such as a ROM in advance, and when the user presses an input button, reads out the corresponding voice data, and receives the mobile phone 10 on the reception side. May be sent to. Alternatively, the voices such as the users “1” and “ni” may be transmitted as they are to the mobile phone 10 on the receiving side as data consisting of voice.

  Note that the voice data for the call and the landmark information can co-exist in order to point to the display screen while talking with the other party. Of course, if there is no need for a call, only the landmark information is transmitted and received. May be.

  Further, as shown in FIG. 2, the mobile phone 10 has an appearance in which the display unit 4 and the input unit 5 are arranged on the user side to operate.

  A fixed display area for displaying the remaining battery level and the radio wave state is displayed on the upper end side of the display unit 4, and operation guidance indicating functions that can be used by specific button operations is displayed on the lower end side of the display unit 4. A fixed display area is displayed. In addition, the display area normally used except these fixed display areas is defined as the effective display area 4a. However, when the entire display area is used without displaying the fixed display area, the effective display area 4 a is the entire display area of the display unit 4.

  In the mobile phone 10 of the present embodiment, the effective display area 4a is managed as nine divided areas (vertical 3 × horizontal 3), and nine buttons 1 to 9 (3 × vertical) of the dial buttons 5a. This corresponds to the arrangement 3).

  Thus, when any one of the buttons 1 to 9 of the dial button 5a is pressed, the center position of one area among the nine divided areas of the effective display area 4a corresponding to the position is pointed as an absolute position. The In the present embodiment, information indicating an area including the absolute position is area specifying information indicating an area for displaying a mark.

  For example, when pointing to the lower left area of the divided area of the effective display area 4a, among the buttons 1 to 9 of the dial button 5a, the "7" button which is also arranged at the lower left is input. Thus, it is possible to point to a desired divided area.

  Further, as shown in FIG. 1, the control unit 1 provided in the mobile phone 10 of the present embodiment displays a CPU by executing various terminal control programs (application programs) stored in the ROM 2 by a CPU (not shown). As a functional block for realizing various functions by controlling hardware such as the unit 4, the input unit 5, the communication unit 7, and the voice processing unit 6, a landmark information creation unit (marking information creation unit) 11, a display control unit A (display control means) 12, a communication control section (communication control means) 13, and a mark information movement control section (mark information movement control means) 14 are formed as functional blocks.

  When the dial button 5a is pressed by the user, the mark information creating unit 11 creates mark information according to the terminal control program stored in the ROM 2. In this embodiment, the landmark information creation unit 11 creates landmark designation information indicating the landmark display mode and area designation information indicating the area where the landmark is displayed, as the landmark information. However, the present invention is not limited to this. Instead, only the area designation information may be created.

  The display control unit 12 controls the display unit 4 in accordance with the terminal control program, and the mark information created by the mark information creating unit 11 is divided into divided areas on the display screen corresponding to the dial button 5a pressed by the user. Display. The display control unit 12 can display a predetermined mark in a divided area on the display screen corresponding to the dial button 5a pressed by the user without using the mark information. It doesn't matter.

  The communication control unit 13 controls the communication unit 7 according to the terminal control program, and transmits the mark information, image information, and the like to other information communication terminals that are communication partners.

  The mark information movement control unit 14 moves and finely adjusts the display position of the mark displayed on the display screen by pressing the dial button 5a. In the present embodiment, information indicating the movement of the display position of the mark is the mark movement information.

  In the mobile phone 10 of the present embodiment, with the configuration as described above, input operation information that is region designation information or coordinate information on the effective display area is used as mark information with another mobile phone 10; Communicates input operation information or mark attribute information that is information related to the display mode of the mark, such as type, shape, size, line type, color, etc., which constitutes the mark information, and other necessary command information, etc. Thus, pointing, that is, a mark can be displayed on the images displayed on the display screens of each other.

  Further, in the mobile phone 10 of the present embodiment, since the arrangement of the divided areas of the effective display area 4a and the arrangement of the dial buttons 5a match, the user can easily display the mark in the desired divided area. be able to.

  Further, the dial button 5a provided in the conventional portable telephone is assigned to the divided area of the display unit 4 without adding a pointing device such as a mouse. Can be directly pointed to.

  Note that the landmark information, which is the format for displaying the landmark on the screen, is, for example, the type of position designation, such as whether the landmark position is designated by a point or an area, whether the shape is an arrow or a + shape, etc. The shape of the mark, the display size of the mark, and the display mode indicated by the line type such as the solid line and the broken line forming the mark, the color, and the like.

  The mark information is graphic information for pointing to a specific part on the display screen. “Arrow” or “cross” indicating one point (pinpoint) and “O” or “pointing” indicating a certain range (area). A figure having a shape such as “□” is superimposed and displayed on a display content such as a photographic image.

  Next, the plurality of portable telephones 10 to which the present invention is applied transmit the mark information formed by the input operation to the input unit 5 to the other portable telephones 10, and the other portable telephones 10 The flow of processing up to display on the display screen will be described below with reference to FIGS. 3 (a) and 3 (b).

  Note that the reception-side mobile phone 10 is not limited to one, and when there are a plurality of mobile phones 10, the transmission-side mobile phone 10 is similar to the plurality of reception-side mobile phones 10. Perform the process.

  First, processing in the transmitting-side mobile phone 10 will be described with reference to FIG.

  In step S <b> 1001, display content (image information) such as photographic image data that is a subject of a topic shared with the mobile phone 10 on the reception side (reception side) is displayed in the effective display area 4 a of the display unit 4. The display content that has been transmitted to the receiving side in advance or received from the receiving side may be read out from the ROM 2 by an operation from the input unit 5 and displayed, or at the point when pointing is started, You may transmit / receive with the type | mold telephone 10.

  Further, this step may be performed by independent operation irrespective of the mobile phone 10 on the reception side, or performed in synchronization by communicating with the mobile phone 10 on the reception side via the communication unit 7. May be.

  However, it is necessary to send the mark information for the effective display area 4a of the mobile phone 10 on the transmitting side to the receiving side and point the same part of the display content displayed in the effective display area 4a.

  Therefore, in the mobile phone 10 of the present embodiment, the display is performed such that the aspect ratio of the effective display area 4a and the display range of the display content are the same. Further, if necessary, display control is performed so that the aspect ratio of the effective display area 4a and the display range of the display content are the same by communicating with the receiving side via the communication unit 7, or, for example, For example, “display the entire photo of XX in full screen vertically” may be used so that the users can confirm each other using voice call or the like and perform appropriate pointing.

  Next, in S1002, the pointing start state (transmission side) is set by an operation from the input unit 5. Further, if necessary, information indicating the start of pointing may be transmitted to the mobile phone 10 on the receiving side via the communication unit 7, and the receiving side indicates that the pointing operation is started in a voice call or the like. You may tell.

  In S1003, a pointing operation is performed by an operation from the input unit 5, and the mark information is transmitted to the mobile phone 10 on the receiving side. The processing content of S1003 will be described in detail later.

  This step is finished when the pointing is completed, but this step may be repeatedly executed as necessary to continuously perform the pointing operation.

  Subsequently, processing on the receiving side will be described with reference to FIG.

  In S1004, display content such as photographic image data to be talked about which is shared with the mobile phone 10 on the transmission side (transmission side) is displayed in the effective display area 4a of the display unit 4.

  The display content may be shared image information that has been transmitted and received in advance with the transmission side, read out from the ROM 2 by an operation from the input unit 5, and displayed at the time of starting pointing. You may send and receive.

  The processing in this step may be performed by a single operation regardless of the transmission side, or may be performed in synchronization by communicating with the transmission side via the communication unit 7.

  However, the mobile phone 10 on the receiving side receives the mark information displayed in the effective display area 4a of the mobile phone 10 on the transmitting side, and displays the same portion of the display content displayed in the effective display area 4a. Need to point.

  Therefore, in the mobile phone 10 of the present embodiment, the display is performed such that the aspect ratio of the effective display area 4a and the display range of the display content are the same. If necessary, display control is performed so that the aspect ratio of the effective display area 4a and the display range of the display content are the same by communicating with the transmission side via the communication unit 7, or, for example, For example, “display the entire photo of XX in full screen vertically” may be used so that the users can confirm each other using voice call or the like and perform appropriate pointing.

  In step S <b> 1005, the pointing start state is set by an operation from the input unit 5 or information indicating the pointing start received from the transmission side via the communication unit 7.

  Here, if necessary, the mobile phone (sender) 10 on the transmission side may be informed that the pointing operation can be started by voice call or the like.

  In S1006, a pointing operation is performed based on the landmark information received from the transmission side via the communication unit 7. If the received mark information does not include mark mode information, a mark having a predetermined shape may be displayed on the display screen. The processing content in this step will be described later.

  This step is completed when the pointing is completed, but this step may be repeatedly executed as necessary to continuously perform the pointing operation.

  The above is the outline of the overall processing by the mobile phone 10 of the present embodiment.

  Next, the case where the input operation information of the input unit 5 on the transmission side is used as the mark information transmitted / received between the mobile phones 10 will be described with reference to the flowcharts shown in FIGS. 4 and 5.

  The input operation information is information indicating the type of the input button. Among the dial buttons 5a, “1” is input when one button is input, “*” is input when the * button is input, characters, etc. It is generated by digital data expressed by, PB signal (DTMF) corresponding to the input button, voice data (such as “1”, “ni”, “asterisk” in Japanese).

  First, in S1, a setting for starting pointing control is performed.

  Specifically, the structure of the divided area of the effective display area 4a for designating the absolute position, the correspondence of the dial button 5a for designating the divided area, the transmission mode of the input operation information to be transmitted as the mark information, and the transmission mode Perform settings required for pointing operations, such as settings.

  Note that the mobile phone 10 of the present embodiment, as the transmission mode, every time the input operation information is recognized, that is, every time the dial button 5a is pressed, the mobile phone 10 that is the transmission partner with the input operation information as mark information. It has a “sequential transmission mode” for transmitting to the telephone 10 and a “confirmed information transmission mode” for transmitting input operation information after the landmark information is confirmed.

  Here, when the mobile phone 10 is set to the “determined information transmission mode”, all the buffer areas (not shown) of the RAM 3 for storing the input operation information are cleared.

  The “sequential transmission mode” can be arbitrarily set according to the user's preference, and the mode setting screen is displayed in the effective display area 4a every time pointing is started, and the user can set it. Alternatively, the user's favorite mode may be stored in advance in the ROM 2 as setting data, and this may be set as a default setting.

  As described above, the mobile phone 10 according to the present embodiment includes the effective display area 4a including the nine divided areas (3 × 3) shown in FIG. 2, and the dial button 5a for designating the divided area. Nine buttons (vertical 3 × horizontal 3) from 1 to 9 correspond to the input.

  In addition, when the mobile phone 10 on the transmission side and the mobile phone 10 on the reception side are information communication terminals having different types and specifications, the mobile phone 10 on the transmission side and the mobile phone 10 on the reception side In the meantime, if the information necessary for the pointing operation is not clear, the information necessary for the pointing operation is transmitted to the mobile phone 10 on the receiving side via the communication unit 7.

  In addition, when the information required for the pointing operation is clear, such as when the model and specification of the mobile phone 10 on the transmission side and the mobile phone 10 on the reception side are the same, the information required for the pointing operation is It is not necessary to transmit to the mobile phone 10 on the receiving side.

  Here, an example of information necessary for the pointing operation will be described.

  As definition information of the effective display area 4a set in the mobile phone 10 on the transmission side, as shown in FIG. 6A, the vertical and horizontal division numbers of the effective display area 4a are set.

  The button used for pointing operation and the definition of the function assigned to each button are set in a format as shown in FIG.

  The code for identifying the type and shape of the mark pointed by the pointing operation, the mark applied to the code, and the definition of the size change step are set in a format as shown in FIG.

  The definition of the change step of the relative movement amount in the relative position designation mode is set in a format as shown in FIG.

  The definition of the transmission form of the input operation information to be transmitted as the mark information is set in a format as shown in FIG. 6E, and any one of the defined transmission forms is selected.

  Subsequently, in S2, the pointing mode is set to the absolute position designation mode, and the divided grid lines and the mark information created by the mark information creating unit 11 are displayed as default marks.

  Note that the mark displayed based on the divided grid lines and the default mark information is not necessarily displayed, and may not be displayed if it is not necessary.

  Here, the divided grid lines and the default mark information will be described.

  As shown in FIG. 7A, the display unit 4 of the mobile phone 10 on the transmission side includes a divided grid line 72a for indicating a divided area of the effective display area 70a, a default mark, and the effective display area 70a. 71a is displayed.

  Here, the default mark information created by the mark information creating unit 11 displays an arrow defined by the identification code “type = 1, shape = 1”. Further, in order to indicate the absolute position designation mode, the display mode of the mark is displayed with a double line type and a light display density.

  Thus, by indicating the divided areas using grid lines, the user can easily recognize in which area the target object to be pointed is included.

  The expression method for indicating the absolute position designation mode may be other methods. For example, the mark display color may be a specific color to indicate the absolute position designation mode.

  In S3, the input of the dial button 5a used for the pointing operation is detected. When the input of the button is detected, the process proceeds to S4.

  In S4, input operation information is generated based on the button whose input is detected in S3.

  Since the input operation information only needs to indicate the type of the input button, digital data represented by a character or the like indicating “1” when one button is input and “*” when the * button is input is generated. .

  In S5, it is determined whether or not the input operation information generated in S4 is a button input indicating an absolute position input. The buttons indicating the input of the absolute position are nine dial buttons 1 to 9 as shown in FIG.

  If the determination is YES, the process proceeds to S6, and if the determination is NO, the process proceeds to S10.

  In S6, since the button indicating the input of the absolute position is pressed, a mark is displayed in the effective display area 4a of the mobile phone 10 on the transmission side based on the input operation information. Specifically, a mark is displayed as an absolute position in the divided area of the effective display area 4a corresponding to the dial button 5a pressed by the user. Here, the mark is displayed based on the mark information indicating the display mode of the type / shape / size currently selected.

  When the mark type points to one point (pinpoint), use “arrow” or “cross” as the mark, and place it so as to point to the center of the designated divided area. If you want to indicate a range (area), use mark information such as “○ (circle)” or “□ (square)” to set the center of the specified divided area as the center position or The smaller one of the horizontal sizes is placed as the outline size.

  When the absolute position designation is completed, a mark is displayed in a state where, for example, the line type is a broken line and the display density is normal to indicate that the relative position designation mode has been switched next.

  In S7, every time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted as mark information to the mobile phone 10 on the receiving side is set.

  If the determination is YES, the process proceeds to S8, and if the determination is NO, the process proceeds to S9.

  In S8, since the sequential transmission mode is set, input operation information, which is area designation information input by the user, is transmitted from the communication unit 7 to the mobile phone 10 on the receiving side as landmark information. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above.

  Subsequently, in order to shift to the relative position designation mode for finely adjusting the display position of the mark, the process proceeds to S20 of the flowchart shown in FIG.

  On the other hand, in S9, the input operation information is stored in a buffer area (not shown) of the RAM 3, and the process proceeds to S20 shown in the flowchart of FIG.

  In S <b> 10, it is determined whether or not the input operation information generated in S <b> 4 is a button input indicating a change in the mark type. Here, the button input indicating the change in the type of the mark is a * button defined as a key input operator for changing the type of the mark as shown in FIG.

  If the determination is YES, the process proceeds to S11, and if the determination is NO, the process proceeds to S15.

  In S11, since the type change of the mark is input, the type of the mark displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  Specifically, as shown in FIG. 10, the type of the mark indicates a certain range (area) from the type = 1 group such as “arrow 31” or “cross 32” indicating one point (pinpoint). The type is changed to the group of type = 2 such as “◯ (circle) 33” or “□ (square) 34”, or from the group of type = 2 to the group of type = 1.

  In this embodiment, when the type of the mark is changed, the shape is also changed to the changed shape = 1.

  In S12, each time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted as mark information to the mobile phone 10 on the receiving side is set.

  If the determination is YES, the process proceeds to S13, and if the determination is NO, the process proceeds to S14.

  In S13, since the sequential transmission mode is set, the input operation information that is the mark mode information is transmitted from the communication unit 7 to the mobile phone 10 on the receiving side as the mark information. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above. Subsequently, the process returns to S3.

  In S14, since the sequential transmission mode is not set, the input operation information is stored in the buffer area (not shown) of the RAM 3, and the process returns to S3.

  In S15, it is determined whether or not the input operation information generated in S4 is a button input indicating a mark shape change. Here, the button input indicating the change in the shape of the mark is the 0 button as shown in FIG.

  If the determination is YES, the process proceeds to S16, and if the determination is NO, the process proceeds to S17.

  In S16, since the mark shape change has been input, the mark shape displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  Specifically, as shown in FIG. 10, the shape of the mark is changed from shape = 1 to shape = 2 or from shape = 2 to shape = 1 in each type group.

  In S17, it is determined whether or not the input operation information generated in S4 is a button input indicating confirmation of the landmark information. Here, the button input indicating the confirmation of the landmark information is the # button as shown in FIG.

  In this step, if the absolute position has not been designated yet, the center position of the central divided area of the effective display area 4a where the mark is displayed based on the default mark information is the mark position. Recognized as a pointing position.

  If the determination is YES, the process proceeds to S37 in the flowchart of FIG. 5, and if NO, the process returns to S3.

  Subsequently, according to the flowchart shown in FIG. 5, in S20, the pointing mode is set to the relative position designation mode.

  Here, the relative movement amount at the time of relative movement is set to the default “1/2”.

  In S21, the input operation of the dial button 5a used for the pointing operation is detected. If the input of the button is detected, the process proceeds to S22.

  In S22, input operation information is generated based on the button whose input is detected in S21.

  Since the input operation information only needs to indicate the type of the input button, digital data represented by a character or the like indicating “1” when one button is input and “*” when the * button is input is generated. .

  Subsequently, in S23, it is determined whether or not the input operation information generated in S22 is a button input indicating an input of a relative position. In the present embodiment, the button inputs indicating the input of relative positions are eight dial buttons 5a from 1 to 9, excluding 5, as shown in FIG.

  If the determination is YES, the process proceeds to S24, and if the determination is NO, the process proceeds to S25.

  In S24, since the relative position has been input, the mark displayed in the effective display area 4a of the transmitting-side mobile phone 10 is currently set based on the input operation information that is the mark movement information. Based on the relative movement amount, the relative movement is performed in the input direction.

  In S29, each time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted to the mobile phone 10 on the reception side as the mark information is set.

  Here, if the determination is YES, the process proceeds to S30, and if the determination is NO, the process proceeds to S31.

  In S30, since the sequential transmission mode is set, the input operation information is transmitted as mark information from the communication unit 7 to the mobile phone 10 on the receiving side. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above. Then, it returns to S21.

  In S31, since the sequential transmission mode is not set, the input operation information is stored in a buffer area (not shown) of the RAM 3 until the mark information is determined, and the process returns to S21.

  In S25, it is determined whether or not the input operation information generated in S22 is a button input indicating a size change of the mark. Here, the button input indicating the size change of the mark is the 0 button as shown in FIG.

  If the determination is YES, the process proceeds to S26, and if the determination is NO, the process proceeds to S27.

  In S26, since the size change of the mark is input, the size of the mark displayed in the effective display area 4a of the mobile phone 10 on the transmission side is changed based on the input operation information that is the mark mode information.

  Here, as shown in FIG. 6C, the size of the mark is set to “medium” as the default size for each kind and shape mark, and “small” and “large” each time a size change is input. The size is changed repeatedly in order in the “medium” step.

  Then, it progresses to S29. The processing after S29 is as described above.

  In S27, it is determined whether or not the input operation information generated in S22 is a button input indicating a change in the relative movement amount. Here, the button input indicating the change of the relative movement amount is the * button as shown in FIG.

  If the determination is YES, the process proceeds to S28, and if the determination is NO, the process proceeds to S32.

  In S28, since the change of the relative movement amount is input, the relative movement amount is changed based on the input operation information.

  Here, as shown in FIG. 6D, the default relative movement amount is set to “1/2” of the size of the divided area in both the vertical direction and the horizontal direction, and the relative movement amount is changed. Each time it is input, it is changed repeatedly in order of "1/4", "minimum", and "1/2" steps.

  For “minimum”, an appropriate value may be applied according to the resolution of the effective display area 4a and the size of the divided area, such as “1/10” in both the vertical and horizontal directions.

  Then, it progresses to S29 and the process after S29 is as above-mentioned.

  In S32, it is determined whether or not the input operation information generated in S22 is a button input instructing to “redo” pointing from the beginning. In the present embodiment, the button input indicating “redo” is five buttons as shown in FIG.

  If the determination is YES, the process proceeds to S33, and if the determination is NO, the process proceeds to S36.

  In S33, since “redo” is input, whether or not the “sequential transmission mode” is set in which the input operation information is transmitted to the mobile phone 10 on the receiving side as the mark information every time the input operation information is recognized. Determine whether.

  If the determination is YES, the process proceeds to S34, and if the determination is NO, the process proceeds to S35.

  In S34, since the sequential transmission mode is set, the input operation information is transmitted as mark information from the communication unit 7 to the mobile phone 10 on the receiving side. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above.

  In S35, all input operation information stored in the buffer area (not shown) of the RAM 3 is cleared. Then, it returns to S2 of the flowchart shown in FIG.

  In S36, it is determined whether or not the input operation information generated in S22 is a button input indicating confirmation of the landmark information. In the present embodiment, the button input indicating the confirmation of the landmark information is the # button as shown in FIG.

  If the determination is YES, the process proceeds to S37, and if the determination is NO, the process returns to S21.

  In S37, since the confirmation of the landmark information is input, the landmark information displayed in the effective display area 4a of the mobile phone 10 on the transmission side is confirmed in the current state based on the input operation information.

  Further, in order to indicate that the mark information has been determined, the display mode of the mark is displayed by changing the line type from a broken line to a solid line, for example.

  Further, the divided grid lines displayed in the effective display area 4a are also deleted. Here, the division grid lines are erased at the time of determination, but may be erased when the absolute position is designated, for example.

  In S38, it is determined whether or not input operation information is stored in a buffer area (not shown) of the RAM 3 and the buffer is empty.

  If the determination is YES, the process proceeds to S41, and if the determination is NO, the process proceeds to S39.

  In S39, since the input operation information is stored in the RAM 3, the stored input operation information is read one by one in the stored order, and the read input operation information is used as landmark information from the communication unit 7 on the receiving side. The data is sequentially transmitted to the mobile phone 10. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above. This step is repeated until all input operation information stored in the buffer area (not shown) of the RAM 3 is transmitted.

  In S40, since all mark information has been transmitted to the mobile phone 10 on the receiving side, all input operation information stored in the buffer area of the RAM 3 is cleared.

  In S41, the input operation information indicating the confirmation generated in S22 is transmitted as mark information from the communication unit 7 to the mobile phone 10 on the receiving side. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above.

  This completes the pointing process on the transmission side.

  In the mobile phone 10 of the present embodiment, as described above, the display control unit 12 controls the display unit 4 and presses the dial button 5a of the mobile phone 10 for the image displayed on the display screen. By doing so, the mark can be easily displayed at a desired position based on the mark information created by the mark information creating unit 11.

  Similarly, by pressing the dial button 5a for the mark pointed on the display screen, the mark information movement control unit 14 easily fine-tunes the display position of the mark, and the display control unit 12 controls the display unit 4. By doing so, the mark can be displayed at the position desired by the user.

  Further, by pressing a specific button of the dial button 5a, the mark information creating unit 11 can change the display mode of the mark or confirm the mark information.

  Next, processing on the receiving side in the mobile phone 10 of the present embodiment will be described as follows using the flowcharts shown in FIGS. 11 and 12. Note that the basic conditions for processing in the mobile phone 10 on the receiving side are the same as those in the mobile phone 10 on the transmitting side.

  First, in the mobile phone 10 on the receiving side, pointing processing is performed according to the flowchart shown in FIG.

  First, in S50, a setting for starting pointing control is performed.

  Specifically, the configuration of the divided area of the effective display area 4a for designating the absolute position, the correspondence of the dial button 5a indicated by the input operation information for designating the divided area, and the input operation information received as the mark information Make settings necessary for pointing operation, such as transmission mode.

  Information necessary for the pointing operation is the same as the example shown in FIGS. 6A to 6E described above.

  In S51, the pointing mode is set to the absolute position designation mode, and a default mark is displayed. Note that the default mark information is not necessarily displayed, and may not be displayed.

  On the display screen shown in FIG. 7A, an arrow 71b is displayed in the effective display area 70b on the reception side based on the default landmark information. Here, the default mark information is an arrow defined by the identification code “type = 1, shape = 1”. Further, in order to show that the mode is the absolute position designation mode, the mark display mode is a double line type and a light display density.

  In S52, the communication unit 7 waits to receive input operation information indicating the type of button input on the transmission side. The input operation information is received in a form selected in the input operation information transmission form.

  Here, if input operation information is received, it will progress to S53.

  In S53, it is determined whether or not the input operation information received in S52 is a button input indicating a change in the mark type.

  If the determination is YES, the process proceeds to S58, and if the determination is NO, the process proceeds to S54.

  In S58, since the type change of the mark is input, the type of the mark displayed in the effective display area 4a is changed based on the input operation information. When the type of the mark is changed, the type = 1 group is changed to the type = 2 group, or the type = 2 group is changed to the type = 1 group.

  In the present embodiment, when the type is changed, the shape is also changed to the changed type group shape = 1. Subsequently, the process returns to S52.

  In S54, it is determined whether or not the input operation information received in S52 is a button input indicating a change in the shape of the mark.

  If the determination is YES, the process proceeds to S59, and if the determination is NO, the process proceeds to S55.

  In S59, since the mark shape change has been input, the mark shape displayed in the effective display area 4a is changed based on the input operation information. When the shape of the mark is changed, the shape = 1 is changed to the shape = 2 or the shape = 2 is changed to the shape = 1 in each type of group. Subsequently, the process returns to S52.

  In S55, it is determined whether or not the input operation information received in S52 is a button input indicating confirmation of the landmark information.

  In this step, although the absolute position is not yet designated, the center position of the divided area at the center of the effective display area 4a pointed based on the default mark information is recognized as the pointing position.

  If the determination is YES, the process proceeds to S67 in the flowchart shown in FIG. 12, and if the determination is NO, the process proceeds to S56.

  In S56, it is determined whether or not the input operation information received in S52 is a button input indicating an absolute position input.

  If the determination is YES, the process proceeds to S57, and if the determination is NO, the process returns to S52.

  In S57, since the absolute position is input, the mark is displayed in the valid display area 4a with the mark information indicating the display mode of the currently selected type, shape, and size based on the input operation information. indicate.

  When the type of the mark is “arrow” or “cross” indicating one point (pinpoint), the mark is displayed so as to indicate the center of the designated divided area. On the other hand, when the mark type is “○” or “□” indicating a certain range (area), the center of the specified divided area is set as the center position, whichever is smaller, vertical or horizontal. The mark is displayed with the size as the outline size.

  In addition, in order to indicate that the absolute position designation is completed and the relative position designation mode is set next, the display mode of the mark is, for example, the line type is a broken line and the display density is normal.

  Subsequently, in order to shift to a relative position designation mode for finely adjusting the display position of the mark, the process proceeds to S60 of the flowchart shown in FIG.

  In S60, the pointing mode is set to the relative position designation mode, and the relative movement amount at the time of relative movement is set to the default “1/2”.

  In S <b> 61, the communication unit 7 waits for reception of input operation information indicating the type of button input on the transmitting-side mobile phone 10. The input operation information is received in a form selected in the input operation information transmission form. If input operation information is received, it will progress to S62.

  In S62, it is determined whether or not the input operation information received in S61 is a button input indicating a size change of the mark.

  If the determination is YES, the process proceeds to S68, and if the determination is NO, the process proceeds to S63.

  In S68, since the mark size change has been input, the size of the mark displayed in the effective display area 4a is changed based on the input operation information. Subsequently, the process returns to S61.

  In S63, it is determined whether or not the input operation information received in S61 is a button input indicating a change in the relative movement amount of the mark.

  If the determination is YES, the process proceeds to S69, and if the determination is NO, the process proceeds to S64.

  In S69, since the change of the relative movement amount of the mark is input, the relative movement amount is changed based on the input operation information. Subsequently, the process returns to S61.

  In S64, it is determined whether or not the input operation information received in S61 is a button input instructing to “redo” pointing from the beginning.

  Here, if the determination is YES, the process returns to S51, and if the determination is NO, the process proceeds to S65.

  In S65, it is determined whether or not the input operation information received in S61 is a button input indicating input of a relative position.

  If the determination is YES, the process proceeds to S70, and if the determination is NO, the process proceeds to S66.

  In S70, based on the input operation information, the mark displayed in the effective display area 4a of the mobile phone 10 on the receiving side is relatively moved in the designated direction based on the currently set relative movement amount. Subsequently, the process returns to S61.

  In S66, it is determined whether or not the input operation information received in S61 is a button input indicating confirmation of the landmark information.

  If the determination is YES, the process proceeds to S67, and if the determination is NO, the process returns to S61.

  In S67, the mark information displayed in the effective display area 4a of the mobile phone 10 on the receiving side is determined in the current state based on the input operation information.

  Further, in order to indicate that the mark information has been confirmed, the display mode of the mark is displayed by changing the line type to a solid line, for example.

  This completes the pointing-side pointing process.

  In the mobile phone 10 of the present embodiment, as described above, the display control unit 12 controls the display unit 4 based on the landmark information received from the transmission side, even in the mobile phone 10 on the reception side. The same display as that displayed on the transmitting-side mobile phone 10 can be performed.

  Thereby, it is possible to display on the display screen in a state where a mark is added to a common image in a plurality of mobile phones 10 that perform transmission and reception. Therefore, the user can exchange information about the object pointed by the mark using a call or text information.

  Furthermore, in the mobile phone 10 of the present embodiment, specific display states on the transmitting-side and receiving-side mobile phones 10 when the sequential transmission mode is set will be described.

  7 (a) to 7 (d) and FIGS. 8 (a) to 8 (d), two portable telephones 10 share "images showing a desktop personal computer" and display them on each other's screens. In this example, a mark is superimposed on each other's screen by a pointing operation from one mobile phone 10.

  At the time of starting communication, as shown in FIG. 7A, the effective display area 70a of the mobile phone 10 on the transmission side and the effective display area 70b of the mobile phone 10 on the reception side are shared “desktops”. An image showing a computer "is displayed.

  Further, as shown in FIG. 7A, the effective display area 70a of the mobile phone 10 on the transmission side is based on divided grid lines 72a for indicating divided areas of the effective display area 70a and default mark information. A mark 71a is displayed. Here, the default mark 71a is an arrow defined by the identification code “type = 1, shape = 1”, and in order to indicate the absolute position designation mode, the display mode of the mark 71a is a double line. And the display density is lightly displayed (hereinafter, the same display is performed in the absolute position designation mode).

  Further, in the effective display area 70b of the mobile phone 10 on the receiving side, a default mark 71b is displayed in the same display manner as the mobile phone 10 on the transmitting side.

  Next, when the shape of the mark is changed in the absolute position designation mode, the mark information changes to a cross as shown in FIG.

  That is, in the mobile phone 10 on the transmission side, as shown in FIG. 7B, the shape of the mark 71a displayed on the mobile phone 10 on the transmission side is reduced by pressing the 0 button of the dial button 5a. , The arrow defined by “shape = 1” is changed to a cross defined by “shape = 2”.

  Further, the transmitting-side mobile phone 10 transmits input operation information “0” indicating the type of the input button as mark information to the receiving-side mobile phone 10. Based on the received input operation information, the mobile phone 10 on the reception side changes the shape of the mark 71b displayed in the effective display area 70b on the reception side from the arrow defined as “shape = 1” to “shape”. = 2 ”.

  Next, when an absolute position is designated, as shown in FIG. 7C, a mark is displayed in the divided area of the display screen corresponding to the dial button 5a.

  That is, when one button of the dial button 5a is input in the mobile phone 10 on the transmission side, as shown in FIG. 7C, 9 shown in the effective display area 70a of the mobile phone 10 on the transmission side. Of the two divided areas, a mark 71a of the currently selected type, shape, and size is displayed in the upper left divided area that is the absolute position corresponding to one button. It should be noted that the display mode of the mark 71a is a broken line and the display density is normally displayed in order to indicate that the relative position designation mode has been switched after the absolute position of the mark is set (hereinafter referred to as the relative position). It shall be displayed in the same way in the designated mode).

  Furthermore, the mobile phone 10 on the transmission side transmits input operation information “1” indicating the type of the input button as mark information to the mobile phone 10 on the reception side. Based on the received input operation information, the mobile phone 10 on the receiving side is divided into an upper left divided area that is an absolute position corresponding to one button among the nine divided areas shown on the mobile phone 10 on the receiving side. A mark 71b of the type / shape / size currently selected is displayed.

  Next, when the size of the mark is changed, the size of the mark is changed as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, as shown in FIG. 7 (d), the mark 71a displayed on the mobile phone 10 on the transmission side is displayed. The size is changed from the default “medium” to “small”.

  Further, the transmitting-side mobile phone 10 transmits input operation information “0” indicating the type of the input button as mark information to the receiving-side mobile phone 10. The mobile phone 10 on the receiving side changes the size of the mark 71b displayed in the effective display area 70b on the receiving side from the default “medium” to “small” based on the received input operation information.

  Next, when the relative position is designated in the relative position designation mode, the position of the mark is changed as shown in FIG.

  That is, when 6 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, the mark 71a displayed on the mobile phone 10 on the transmission side is displayed as shown in FIG. , 6 moves relative to the right, which is the relative direction corresponding to the 6 button, by the amount of relative movement currently selected. In this case, the relative movement amount is “1/2” as a default, and thus is ½ of the horizontal size of the divided area.

  Furthermore, the mobile phone 10 on the transmission side transmits input operation information “6” indicating the type of the input button as mark information to the mobile phone 10 on the reception side. Based on the received input operation information, the mobile phone 10 on the receiving side selects the mark 71b displayed in the effective display area 70b on the receiving side at the present time in the right direction that is the relative direction corresponding to the 6 buttons. The relative movement is performed by the amount of relative movement. The relative movement amount is the same as described above.

  Next, when the relative movement amount in the relative position designation is changed, the * button is pressed as shown in FIG.

  That is, in the mobile phone 10 on the transmission side, when the * button of the dial button 5a is pressed, as shown in FIG. 8 (b), the relative movement amount when the relative movement of the mark 71a on the transmission side is performed. The default “1/2” is changed to “1/4”.

  Further, the transmitting-side mobile phone 10 transmits input operation information “*” indicating the type of the input button as mark information to the receiving-side mobile phone 10. Based on the received input operation information, the mobile phone 10 on the receiving side changes the relative movement amount when the relative mark 71b on the receiving side is moved from the default “1/2” to “¼”. To do.

  Next, when the relative position is further changed in the relative position designation mode, the mark moves as shown in FIG.

  That is, when two buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, the mark 71a displayed on the mobile phone 10 on the transmission side is displayed as shown in FIG. The relative movement is made in the upward direction, which is the relative direction corresponding to the two buttons, by the amount of relative movement currently selected. Since the relative movement amount is “¼”, it is ¼ of the vertical size of the divided area.

  Furthermore, the mobile phone 10 on the transmission side transmits input operation information “2” indicating the type of the input button as mark information to the mobile phone 10 on the reception side. Based on the received input operation information, the mobile phone 10 on the reception side selects the mark 71b displayed in the effective display area 70b on the reception side in the upward direction, which is a relative direction corresponding to the two buttons, at the present time. The relative movement is performed by the amount of relative movement. The relative movement amount is the same as described above.

  Next, when the landmark information is confirmed, the display mode of the landmark changes as shown in FIG.

  That is, when the # button of the dial button 5a is input in the mobile phone 10 on the transmission side, the mark 71a displayed on the mobile phone 10 on the transmission side is displayed as shown in FIG. In order to indicate that the display state of the mark 71a has been determined in the current state, it is displayed with a solid line and a display density of normal.

  Further, the transmitting-side mobile phone 10 transmits input operation information “#” indicating the type of the input button to the receiving-side mobile phone 10 as the mark information. Based on the received input operation information, the mobile phone 10 on the receiving side determines the mark 71b displayed in the effective display area 70b of the mobile phone 10 on the receiving side in the current state, and sets the mark 71b. In order to indicate that the display mode has been determined, the display mode is displayed with a solid line and a display density of normal.

  When the mobile phone 10 of the present embodiment is set to the sequential transmission mode, as described above, when the input is made via the dial button 5a on the transmission side, the communication control unit 13 controls the communication unit 7. For each input, the input information is transmitted to the mobile phone 10 on the receiving side.

  On the other hand, in the mobile phone 10 on the receiving side, the display control unit 12 controls the display unit 4 to display a mark on the display screen based on the received mark information, A similar screen can be displayed.

  In the sequential transmission mode, the input operation information is transmitted for each input operation of the transmitting-side mobile phone 10, and the receiving-side mobile phone 10 receives the input operation information and performs a pointing process. For this reason, the content of the operation until the landmark information is confirmed by the mobile phone 10 on the transmission side can be confirmed on the screen also by the mobile phone 10 on the reception side. Therefore, compared with the case where the mark is displayed at some point on the display screen, the follower of the user on the receiving side to the pointing position of the mark can be improved. Furthermore, it can be expected that a feeling of pointing with the user of the mobile phone 10 on the transmission side can be obtained.

  On the other hand, in the mobile phone 10 of the present embodiment, specific display examples when the fixed information transmission mode is set instead of the sequential transmission mode are shown in FIGS. 13 (a) to 13 (d) and FIG. It will be as follows if it demonstrates using (a)-FIG.14 (d).

  Here, in the same manner as described above, the two portable telephones 10 share the “desktop personal computer image” and display them on the screens of each other, and the pointing operation from one portable telephone 10 allows the mutual screens to be displayed. The operation for displaying the mark in a superimposed manner will be described.

  Note that the same conditions as those described with reference to FIGS. 7A to 7D and FIGS. 8A to 8D are omitted here.

  At the start of communication, as shown in FIG. 13A, the effective display area 80a of the mobile phone 10 on the transmission side and the effective display area 80b of the mobile phone 10 on the reception side are shared. “Desktop computer image” is displayed.

  Next, when the type of the mark is changed, as shown in FIG. 13B, the display mode of the mark changes from an arrow to a circle.

  That is, when the * button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. The type of the mark 81a is changed from “type = 1” group indicating one point (pinpoint) to “◯” defined by “shape = 1” of “type = 2” group indicating a certain range (area). To do.

  Further, the transmitting-side mobile phone 10 stores input operation information “*” indicating the type of the input button as mark information in the buffer area of the RAM 3.

  Next, when the absolute position is designated, a mark is displayed in the user designated area as shown in FIG.

  That is, when 6 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, nine divided areas in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. Among them, a mark 81a of the type / shape / size currently selected is displayed in the right center divided area, which is the absolute position corresponding to 6 buttons.

  Further, in the mobile phone 10 on the transmitting side, input operation information “6” indicating the type of the input button is stored as mark information in the buffer area of the RAM 3.

  Next, when it is instructed to “redo” the pointing of the mark from the beginning, as shown in FIG. 13D, the state returns to the state shown in FIG.

  That is, when 5 buttons of the dial button 5a are input to the mobile phone 10 on the transmission side, the mobile phone 10 on the transmission side stores them in the buffer area of the RAM 3 as shown in FIG. Clear all input operation information and return to the absolute position designation mode start state.

  Next, when the type of the mark is changed again, as shown in FIG. 14A, the display mode of the mark changes from an arrow to a circle.

  That is, when the * button of the dial button 5a is input in the mobile phone 10 on the transmission side, the mark displayed in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. The type of 81a is changed from a “type = 1” group indicating one point (pinpoint) to a circle defined by “shape = 1” of a “type = 2” group indicating a certain range (area). .

  Further, the transmitting-side mobile phone 10 stores input operation information “*” indicating the type of the input button as mark information in the buffer area of the RAM 3.

  Next, when the absolute position is designated again, the mark is displayed in the user designated area as shown in FIG.

  That is, when 9 buttons of the dial button 5a are input to the mobile phone 10 on the transmission side, as shown in FIG. 14B, the nine divided areas in the effective display area 80a of the mobile phone 10 on the transmission side are shown. Among them, a mark 81a of the type / shape / size currently selected is displayed in the lower right divided area, which is the absolute position corresponding to the 9 button.

  Further, the transmitting-side mobile phone 10 stores input operation information “9” indicating the type of the input button as mark information in the buffer area of the RAM 3.

  Next, after the absolute position of the mark is determined, the process proceeds to the relative position designation mode. When the relative position is designated, the mark display position is moved as shown in FIG.

  In other words, when the “1” button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. The mark 81a is relatively moved in the upper left direction, which is the relative direction corresponding to the “1” button, by the relative movement amount currently selected. Since the relative movement amount is “1/2” by default, it is ½ each of the vertical and horizontal sizes of the divided areas.

  Further, the transmission side stores input operation information “1” indicating the type of the input button as mark information in the buffer area of the RAM 3.

  Next, when the landmark information is confirmed, the display mode of the landmark changes as shown in FIG.

  That is, when the # button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. In order to indicate that the mark 81a is confirmed in the current state and the display mode of the mark 81a is confirmed, the display density is normally displayed as a solid line.

  Further, the mobile phone 10 on the transmitting side sequentially transmits the input operation information “*”, “9”, “1” stored in the buffer area of the RAM 3 as the mark information, and finally indicates confirmation. Input operation information “#” is transmitted.

  The mobile phone 10 on the reception side sequentially performs the pointing process of the mark 81b displayed in the effective display area 80b on the reception side based on the received input operation information.

  In other words, the mobile phone 10 on the receiving side receives “*”, “9”, “1”, “#” as input operation information, thereby indicating the type of the mark 81b as one point (pinpoint). Change the display type of the mark 81b from the group of “type = 1” to the circle defined by “shape = 1” of the group of “type = 2” pointing to a certain range (area). In order to indicate the mode, a double line and a light display density are displayed.

  Next, of the nine divided areas in the effective display area 80b, the mobile phone 10 on the receiving side has the type, shape, and shape currently selected in the lower right divided area that is the absolute position corresponding to the nine buttons. A size mark 81b is displayed. Note that the display mode of the mark 81b is displayed with a broken line and a normal display density in order to indicate the next relative position designation mode.

  Next, in the mobile phone 10 on the receiving side, the mark 81b displayed in the effective display area 80b is relative to the upper left direction, which is the relative direction corresponding to one button, by the relative movement amount currently selected. Move. Note that the relative movement amount is the default “½”, as described above, and thus is ½ each of the vertical and horizontal sizes of the divided area.

  Next, in the mobile phone 10 on the receiving side, the mark 81b displayed in the effective display area 80b is confirmed in the current state, and the display mode of the mark 81b is indicated by a solid line to indicate that it has been confirmed. And the display density is displayed normally.

  When the mobile phone 10 according to the present embodiment is set to the fixed information transmission mode instead of the sequential transmission mode, the communication control unit 13 sets the landmark information setting input as described above and then the communication control unit 13 By controlling the communication unit 7 and sequentially transmitting the confirmed mark information to the mobile phone 10 on the receiving side, the mobile phone 10 on the receiving side is displayed at the same position as the mobile phone 10 on the transmitting side. A landmark can be displayed.

  Further, since it is only necessary to transmit a minimum amount of information to indicate the determined state, it is possible to reduce the amount of data communication as compared with the case where the sequential transmission mode is set.

  Further, the display control unit 12 controls the display unit 4 to process and display the processing in the mobile phone 10 on the receiving side for one input operation information in a time of about several hundred ms that can be confirmed by human eyes. Also good. Thereby, it becomes possible to confirm the operation steps until the landmark information is confirmed also on the mobile phone 10 on the receiving side, and the same effect as in the sequential transmission mode can be obtained. Of course, it may be important to make the processing time on the receiving side for one piece of input operation information as fast as possible and to point quickly.

  The receiving-side mobile phone 10 stores the received input operation information in the buffer of the RAM 3 on the receiving side until receiving the input operation information indicating confirmation, and at the time of receiving the input operation information indicating confirmation. The pointing processing based on the input operation information in the buffer of the RAM 3 may be sequentially processed without being displayed on the display screen, and the mark may be displayed on the display screen after the processing up to the confirmation is completed.

  Thereby, the mobile phone 10 on the receiving side can delete this display when it does not want to see an extra operation step until it is confirmed.

  Here, the processing when the display conditions of the mobile phones 10 that perform communication in the mobile phone 10 of the present embodiment are different will be described as follows.

  In other words, when the display screen resolution differs between the mobile phone 10 on the transmission side and the reception side, the following processing is performed.

  For example, as shown in FIG. 9, the effective display area 21a of the display unit 20a of the mobile phone 10 on the transmission side is 128 × 120 pixels wide and is divided into nine areas (3 × 3 horizontal). The effective display area 21b of the display unit 20b of the mobile phone 10 on the receiving side is 256 × 240 pixels wide, and, similarly to the mobile phone 10 on the transmitting side, 9 areas (3 × vertical) It is assumed that it is divided into 3).

  If the original image is 128 pixels long by 120 pixels wide, the mobile phone 10 on the transmission side has the same number of pixels as the effective display area 21a, so the image displayed on the screen is displayed as it is. To do.

  On the other hand, since the mobile phone 10 on the receiving side has a difference of twice the number of pixels in the effective display area 21b in both the vertical and horizontal directions, the image is displayed in a size twice as large in both the vertical and horizontal directions.

  For this reason, even when the display screens of the mobile phones 10 on the transmission side and the reception side have different resolutions, pointing can be performed only with the input operation information of the buttons indicating the same area.

  That is, when the three buttons of the dial button 22 of the mobile phone 10 on the transmission side are input, the marks 23a and 23b are pointed to the upper right area in both the mobile phone 10 on the transmission side and the reception side.

  Also, since the relative position is specified based on “1 / n” of the size of the divided area, similarly, pointing can be performed only with the input operation information of the direction button.

  As described above, in the mobile phone 10 of the present embodiment, the display control unit 12 controls the display unit 4 and receives the received input even when the display screen resolutions of the mobile phone 10 on the transmission side and the reception side are different. By displaying based on the operation information, it is possible to point to the same position on each other's display screen.

  In the present embodiment, the input unit 5 is premised on an input function as a telephone. However, for example, when the present invention is applied to a television equipped with a communication function, 1 to 0 (or 12 or the like). A remote controller having a plurality of input buttons such as a channel button on which the number is marked may be used as the input unit 5.

  In the present embodiment, it is assumed that the communication unit 7 has a wireless communication function as a mobile phone, but the present invention is not limited to this. For example, if the communication function of wired analog telephone line or digital telephone line, wired or wireless LAN, Bluetooth (registered trademark), UWB (Ultra Wide Band), etc., that can communicate voice and data, apply Is possible.

  In the present embodiment, the display unit 4 has nine divided areas (vertical 3 × horizontal 3). For example, the display unit 4 may have 12 divided areas (vertical 4 × horizontal 3) or four divided areas ( An appropriate number of divisions may be set in accordance with the size of the effective display area, the arrangement of buttons, and the number of buttons, such as 2 × 2).

  In the present embodiment, the mark size change and the relative movement amount change are described as three steps. However, the present invention is not limited to this, and any number of steps may be used as long as the number of steps is two or more. If there is no need to change the size or change the relative movement amount, the change may not be necessary.

  In this embodiment, as an expression method for indicating the absolute position designation mode, an example of displaying the line type as a double line and a light display density, an expression for indicating the relative position designation mode. An example of displaying the line type as a broken line and the display density as a normal method, and an example of displaying the line type as a solid line and a normal display density as an expression method for indicating that the mark has been confirmed However, the present invention is not limited to this. For example, even when a method of changing the display color of the mark to a specific color is adopted, the same effect as described above can be obtained.

  In the present embodiment, an example in which digital data is generated as input operation information has been described. However, the present invention is not limited to this, and may be generated as a PB signal (DTMF) or audio data.

  Further, the voice data may be generated by voice synthesis, or voice data corresponding to each button may be stored in advance in the ROM 2 and read out for use.

[Embodiment 2 as a premise of the present invention]
With respect to the information communication terminal, the terminal control method, the terminal control program, and the recording medium on which the information communication terminal according to the present invention is described, another embodiment as a premise will be described with reference to FIGS.

  For convenience of explanation, components having the same functions as those described in the first embodiment are denoted by the same reference numerals and description thereof is omitted. Further, the description based on the flowchart in the present embodiment is basically the same as the processing content described in the first embodiment, and therefore, the description of the conditions overlapping with those in the first embodiment is omitted.

  In the present embodiment, coordinate information on the effective display area, mark attribute information indicating a mark state (type, shape, size, line type, color, etc.), and the like are used as the mark information.

  That is, in the mobile phone 10 of the present embodiment, the mark information creating unit 11 shown in FIG. 1 creates coordinate information and mark attribute information related to mark information in response to an input from the user. It is different from 1.

  Further, the display control unit 12 controls the display unit 4 to display a mark shown in a user-designated display mode at a desired position on the display unit 4 based on the coordinate information and the mark attribute information.

  Furthermore, the communication control unit 13 transmits the coordinate information and the mark attribute information to the mobile phone 10 on the receiving side, so that the mobile phone 10 on the receiving side can receive the received coordinate information and the mark attribute information. Based on this, it is possible to perform a display similar to the display on the mobile phone 10 on the transmission side.

  In the present embodiment, the processing by the mobile phone 10 on the transmission side is performed according to the flowcharts shown in FIGS.

  That is, as shown in FIG. 15, in S80, a setting for starting pointing control is performed.

  Specifically, the setting contents are the same as those in the flowchart shown in FIG. 4 described in the first embodiment.

  Also in this embodiment, as in the mobile phone 10 shown in FIG. 2 described in the first embodiment, the effective display area 4a is configured as nine divided areas (vertical 3 × horizontal 3), and the divided areas are designated. The dial button 5a corresponds to nine buttons (vertical 3 × horizontal 3) 1 to 9, and the transmission mode of the mark information is digital data (characters, etc.).

  Regarding the information necessary for the pointing operation, four pieces of information shown in FIGS. 17 (a) to 17 (d) are information that needs to be recognized by the mobile phone 10 on the reception side. To the mobile phone 10.

  As shown in FIG. 17A, the effective display area 4a of the mobile phone 10 on the transmission side is defined by the number of pixels (resolution) in the vertical and horizontal directions of the effective display area 4a.

  The command of the coordinate information on the effective display area 4a is identified by “command code = 01” and defined by the X coordinate and the Y coordinate as shown in FIG.

  The command of the mark attribute information is identified by “command code = 02” as shown in FIG. 17C, and is defined by a code for identifying the type and shape, and the pixel size of the mark information.

  As shown in FIG. 17D, other commands are defined by “redo” identified by “command code = 03” and “confirmed” identified by “command code = 04”.

  Further, the function of the use button is defined by a button used for pointing operation and a function assigned to each button, as shown in FIG.

  As shown in FIG. 17F, the mark information is defined by a code for identifying the type and shape of the mark pointed by the pointing operation, a mark applied to the code, and a size change step.

  As shown in FIG. 17G, the relative movement amount is defined by a change step of the relative movement amount in the relative position designation mode.

  Subsequently, in S81 to S84, processing similar to S2 to S5 of the first embodiment is performed.

  In s84, if the determination is YES, the process proceeds to S85, and if the determination is NO, the process proceeds to S89.

  In S85, coordinate information in the effective display area 4a of the transmitting-side mobile phone 10 is generated based on the input operation information.

  Specifically, coordinates indicating the absolute position of the effective display area 4a corresponding to the dial button 5a are calculated, and the calculated coordinates are used as coordinate information on the effective display area 4a.

  In the present embodiment, as in the first embodiment, the absolute position of the effective display area 4a corresponding to each dial button is designated by the input to the nine dial buttons 1 to 9 of the dial button 5a. Therefore, in this embodiment, the coordinate which shows the center position of the designated division | segmentation area is made into coordinate information.

  Subsequently, in S86, a mark is displayed in the effective display area 4a of the mobile phone 10 on the transmission side based on the coordinate information in the effective display area 4a generated in S85.

  Specifically, the mark is displayed based on the mark information indicating the display mode of the currently selected type, shape, and size with the position indicated by the coordinate information on the effective display area 4a as the center.

  In addition, in order to indicate that the absolute position display for displaying the mark is completed and the relative position specifying mode is set next, the display mode of the mark is displayed in a state where the line type is a broken line and the display density is normal. The

  In S87, every time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted as mark information to the mobile phone 10 on the receiving side is set.

  If the determination is YES, the process proceeds to S88. If the determination is NO, the process proceeds to S100 of the flowchart shown in FIG. 16 in order to shift to the relative position designation mode.

  In S88, since the sequential transmission mode is set, the coordinate information on the effective display area 4a is used as the mark information which is the area designation information, and the coordinate information command on the effective display area defined in FIG. The data is transmitted in the form by the communication unit 7 to the mobile phone 10 on the receiving side.

  Subsequently, in order to shift to the relative position designation mode, the process proceeds to S100 of the flowchart shown in FIG.

  In S89, it is determined whether or not the input operation information generated in S83 is a button input indicating a change in the mark type.

  If the determination is YES, the process proceeds to S90, and if the determination is NO, the process proceeds to S93.

  In S90, since the change of the mark type is input, the type of the mark displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  In S91, each time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted as mark information to the mobile phone 10 on the receiving side is set.

  If the determination is YES, the process proceeds to S92. If the determination is NO, the process returns to S82.

  In S92, since the sequential transmission mode is set, information indicating the type, shape, and size of the mark is used as the mark information that is the mark mode information in the mark attribute information command format defined in FIG. Then, the communication unit 7 transmits the data to the mobile phone 10 on the receiving side. Subsequently, the process returns to S82.

  In S93, it is determined whether or not the input operation information generated in S83 is a button input indicating a change in the shape of the mark.

  If the determination is YES, the process proceeds to S94, and if the determination is NO, the process proceeds to S95.

  In S94, since the mark shape change has been input, the mark shape displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  Then, it progresses to S91. The processing after S91 is as described above.

  In S95, it is determined whether or not the input operation information generated in S83 is a button input indicating confirmation of landmark information.

  Here, if the determination is YES, the process proceeds to S118 of the flowchart shown in FIG. 16, and if the determination is NO, the process returns to S82.

  The processing in S100 to S103 is the same as S20 to S23 in the flowchart shown in FIG.

  In S104, coordinate information on the effective display area 4a of the mobile phone 10 on the transmission side is generated based on the input operation information.

  Specifically, a coordinate indicating a position where the mark displayed in the effective display area 4a of the mobile phone 10 on the transmission side is relatively moved in the designated direction based on the relative movement amount is calculated and calculated. These coordinates are used as coordinate information on the effective display area 4a.

  In S105, the mark displayed in the effective display area 4a of the mobile phone 10 on the transmission side is relatively moved based on the coordinate information on the effective display area 4a generated in S104.

  In S106, it is determined whether or not the “sequential transmission mode” is set.

  If the determination is YES, the process proceeds to S107, and if the determination is NO, the process returns to S101.

  In S107, since the sequential transmission mode is set, the coordinate information on the effective display area 4a is used as the mark information that is the mark movement information, and the coordinate information command on the effective display area defined in FIG. The data is transmitted in the form by the communication unit 7 to the mobile phone 10 on the receiving side. Subsequently, the process returns to S101.

  In S108, it is determined whether or not the input operation information generated in S102 is a button input indicating the size change of the mark.

  If the determination is YES, the process proceeds to S109, and if the determination is NO, the process proceeds to S112.

  In S109, since the mark size change has been input, the size of the mark displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  In S110, it is determined whether or not the “sequential transmission mode” is set.

  If the determination is YES, the process proceeds to S111. If the determination is NO, the process returns to S101.

  In S111, since the sequential transmission mode is set, information indicating the type, shape, and size of the mark is used as the mark information that is the mark mode information in the mark attribute information command format defined in FIG. Then, the communication unit 7 transmits the data to the mobile phone 10 on the receiving side. Subsequently, the process returns to S101.

  In S112, it is determined whether or not the input operation information generated in S102 is a button input indicating a change in the relative movement amount.

  If the determination is YES, the process proceeds to S113, and if the determination is NO, the process proceeds to S114.

  In S113, since the change of the relative movement amount is input, the relative movement amount is changed based on the input operation information. Subsequently, the process returns to S101.

  In S <b> 114, it is determined whether or not the input operation information generated in S <b> 102 is a button input instructing to “redo” the mark pointing from the beginning.

  If the determination is YES, the process proceeds to S115, and if the determination is NO, the process proceeds to S117.

  In S115, since a redo instruction has been input, it is determined whether or not the “sequential transmission mode” is set.

  If the determination is YES, the process proceeds to S116, and if the determination is NO, the process returns to S81.

  In S116, since the sequential transmission mode is set, the redo command defined in FIG. 17D is transmitted from the communication unit 7 to the mobile phone 10 on the receiving side as landmark information. Subsequently, the process returns to S81 in FIG.

  In S117, it is determined whether or not the input operation information generated in S102 is a button input indicating confirmation of landmark information.

  If the determination is YES, the process proceeds to S118. If the determination is NO, the process returns to S101.

  In S118, since the confirmation of the landmark information is input, the landmark information displayed in the effective display area 4a of the transmitting-side mobile phone 10 is confirmed in the current state based on the input operation information.

  Further, in order to indicate that the mark information has been confirmed, the display mode of the mark is displayed by changing the line type to a solid line, for example.

  Further, the divided grid lines displayed in the effective display area 4a are also deleted.

  In S119, it is determined whether or not the “sequential transmission mode” is set.

  If the determination is YES, the process proceeds to S122, and if the determination is NO, the process proceeds to S120.

  In S120, since the sequential transmission mode is not set, the coordinate information on the valid display area 4a determined as the mark information is in the format of the coordinate information command on the valid display area defined in FIG. The data is transmitted from the communication unit 7 to the mobile phone 10 on the receiving side. Then, it progresses to S121.

  In S121, as the mark information, information indicating the type, shape, and size of the determined mark is set in the mark attribute information command format defined in FIG. Send to.

  In S122, a confirmation command defined in FIG. 17D is transmitted as mark information from the communication unit 7 to the mobile phone 10 on the receiving side.

  This completes the pointing process on the transmission side.

  In the mobile phone 10 of the present embodiment, as described above, the display control unit 12 controls the display unit 4 and presses the dial button 5a of the mobile phone 10 for the image displayed on the display screen. Thus, the mark can be easily displayed at a desired position based on the mark attribute information and the coordinate information input as described above.

  In addition, with respect to the mark pointed to the display screen, the mark information movement control unit 14 changes the mark attribute information and the coordinate information by pressing the dial button 5a, thereby easily changing the display mode and the display position of the mark. can do.

  On the other hand, processing in the mobile phone 10 on the receiving side is performed according to the flowchart shown in FIG.

  First, in S130, a setting for starting pointing control is performed.

  Specifically, calculation of a multiplier for absorbing the difference between the resolution of the effective display area 4a of the mobile phone 10 on the transmission side and the resolution of the effective display area 4a of the terminal itself, command definition of the received landmark information, Settings necessary for pointing operation, such as the transmission form of each command received as mark information, are made.

  The multiplier for absorbing the difference in resolution is calculated from the following relational expression (1) for each of the vertical direction and the horizontal direction, and used when multiplying the received coordinates and landmark information.

Number of pixels on the transmitting side / number of pixels on the receiving side = multiplier (1)
Note that the transmission mode of the mark information is digital data (characters, etc.), similar to the mobile phone 10 on the transmission side.

  Information necessary for the pointing operation is the same as the information shown in FIGS. 17 (a) to 17 (g).

  Subsequently, in S131, a default mark is displayed.

  Note that the mark based on the default mark information may have a display form indicated by an arrow as shown in FIG.

  In S132, the communication unit 7 waits for reception of the mark information. When the mark information is received, the process proceeds to S133.

  In S133, it is determined whether or not the landmark information received in S132 is a coordinate information command on the effective display area.

  If the determination is YES, the process proceeds to S138, and if the determination is NO, the process proceeds to S134.

  In S138, since the received mark information is a coordinate information command in the effective display area, the mark is displayed in the effective display area 4a of the mobile phone 10 on the receiving side based on the received coordinate information command.

  Specifically, each of Px, which is the X coordinate and Py, which is the Y coordinate of the mobile phone 10 on the transmission side indicated by the received coordinate information command on the effective display area, is expressed by Equation (1) in S130. Multiply the calculated multipliers to calculate the coordinates on the effective display area 4a of the mobile phone 10 on the receiving side, and display the mark of the type / shape / size currently selected with the calculated position as the center. .

  When the type of the mark is “arrow” or “cross” indicating one point (pinpoint), the mark is displayed so as to indicate the coordinates on the designated effective display area 4a. In the case of “◯” or “□” indicating a range (area), the coordinate on the specified effective display area 4a is set as the center position, and the smaller one of the vertical and horizontal sizes of the divided area is set as the outline size. Display placemarks.

  In order to indicate that coordinates are being specified, the display mode of the mark is displayed, for example, with the line type being a broken line and the display density being normal. Note that other methods may be used as an expression method for indicating that coordinates are being specified. For example, a display color of a mark may be a specific color to indicate that coordinates are being specified. .

  In S134, it is determined whether or not the landmark information received in S132 is a landmark attribute information command.

  If the determination is YES, the process proceeds to S139, and if the determination is NO, the process proceeds to S135.

  In S139, since the received landmark information is a landmark attribute information command, the type, shape, and size of the landmark displayed in the effective display area 4a are changed based on the landmark attribute information.

  For example, regarding the size, each of Mx which is the X-direction size on the transmission side and My which is the Y-direction size indicated by the received landmark attribute information command is multiplied by the multiplier calculated by Expression (1) in S130. After calculating the size of the mobile phone 10 on the receiving side and displaying the mark with the calculated size, the process returns to S132.

  In S135, it is determined whether or not the landmark information received in S132 is a redo command.

  Here, if the determination is YES, the process returns to S131, and if the determination is NO, the process proceeds to S136.

  In S136, since it is not a redo command, it is determined whether or not the landmark information received in S132 is a confirmation command.

  If the determination is YES, the process proceeds to S137, and if the determination is NO, the process returns to S132.

  In S137, since the confirmation command is received, the mark information displayed in the effective display area 4a of the receiving-side mobile phone 10 is confirmed in the current state based on the confirmation command.

  Further, in order to indicate that the mark information has been confirmed, the display mode of the mark is displayed by changing the line type to a solid line, for example. It should be noted that the expression method for indicating that the mark has been confirmed may be other methods. For example, the mark may be displayed in a specific color in order to indicate that the mark has been confirmed.

  This completes the pointing process in the mobile phone 10 on the receiving side.

  In the mobile phone 10 of the present embodiment, as described above, also in the mobile phone 10 on the receiving side, the display control unit 12 controls the display unit 4, and based on the received landmark attribute information and coordinate information, The same display as that displayed on the transmitting-side mobile phone 10 can be performed.

  As a result, in the plurality of mobile phones 10 that perform transmission / reception, the image can be displayed on the display screen with a mark added to a common image. Therefore, the user can select the object indicated by the mark. Can be exchanged through telephone calls or text information.

  Next, a display example when the mobile phone 10 of this embodiment is set to the sequential transmission mode will be described.

  At the start of communication, as shown in FIG. 18 (a), the transmitting-side mobile phone 10 and the receiving-side mobile phone 10 have “camera images” based on the shared image information. It is displayed.

  Here, the mobile phone 10 on the transmission side displays a divided grid line 122a for indicating a divided area of the effective display area 120a and a default mark 121a.

  The default mark 121a is an arrow defined by the identification code “type = 1, shape = 1”, and the display mode of the mark 121a is a double line to indicate the absolute position designation mode. And the display density is displayed lightly. In addition, in the effective display area 120b of the mobile phone 10 on the receiving side, a default mark 121b is displayed in the same display mode as the mobile phone 10 on the transmitting side in order to indicate the state before the coordinate designation.

  Next, when the shape of the mark is changed in the absolute position designation mode, the mark is changed to a cross mark as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. The shape of the mark 121a is changed from an arrow defined by “shape = 1” to a cross defined by “shape = 2”. Further, the mobile phone 10 on the transmission side transmits a mark attribute information command as the mark information.

  Based on the received mark attribute information command, the mobile phone 10 on the receiving side changes the shape of the mark 121b displayed in the effective display area 120b on the receiving side from the arrow defined as “shape = 1” to “shape”. = 2 ”.

  Note that the display mode of the mark 121b is a double line and the display density is lightly displayed to indicate that the coordinate is not specified.

  Next, when the absolute position is designated in the absolute position designation mode, a mark is displayed in the user designated area as shown in FIG.

  That is, when one button of the dial button 5a is input in the mobile phone 10 on the transmission side, nine divided areas in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. Among them, a mark 121a of the type, shape, and size currently selected is displayed in the upper left divided area that is an absolute position corresponding to one button. Further, the mobile phone 10 on the transmission side transmits a coordinate information command on the effective display area as the mark information.

  Based on the received coordinate information command on the effective display area, the mobile phone 10 on the receiving side has a mark 121b of the type / shape / size currently selected in the effective display area 120b of the mobile phone 10 on the receiving side. Is displayed. The display mode of the mark 121b is displayed with a broken line and a normal display density in order to indicate that coordinates are being specified.

  Next, when it is instructed to “redo” the pointing of the mark from the beginning, the mark returns to the arrow as shown in FIG.

  That is, when 5 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, the mobile phone 10 on the transmission side returns to the start state of the absolute position designation mode in FIG. Further, the transmission side transmits a redo command as the mark information.

  The mobile phone 10 on the receiving side returns to the pre-coordinate designation state based on the received redo command.

  Next, when an absolute position is designated again in the absolute position designation mode, a mark is displayed in the user designated area as shown in FIG.

  That is, when one button of the dial button 5a is input in the mobile phone 10 on the transmission side, as shown in FIG. 19A, nine divided areas in the effective display area 120a of the mobile phone 10 on the transmission side. Among them, a mark 121a of the type, shape, and size currently selected is displayed in the upper left divided area that is an absolute position corresponding to one button. Further, the mobile phone 10 on the transmission side transmits a coordinate information command on the effective display area as the mark information.

  Based on the received coordinate information command on the effective display area, the mobile phone 10 on the receiving side has the type, shape, and size currently selected on the effective display area 120b of the mobile phone 10 on the receiving side. A mark 121b is displayed.

  Next, when the size of the mark is changed in the relative position designation mode, the size of the mark is changed as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. The size of the mark 121a is changed from the default “medium” to “small”. Further, the mobile phone 10 on the transmission side transmits a mark attribute information command as the mark information.

  The mobile phone 10 on the receiving side changes the size of the mark 121b displayed in the effective display area 120b on the receiving side based on the received mark attribute information command.

  Next, if the relative position is designated after the relative position designation mode, the mark display position is finely adjusted as shown in FIG.

  That is, when 8 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, they are displayed in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. The mark 121a is relatively moved in the downward direction, which is a relative direction corresponding to the 8 buttons, by the amount of relative movement currently selected. Since the relative movement amount is “1/2” by default, it is ½ of the vertical size of the divided area. Further, the mobile phone 10 on the transmission side transmits a coordinate information command on the effective display area as the mark information.

  Based on the received coordinate information command on the effective display area, the mobile phone 10 on the receiving side uses the mark of the type, shape, and size currently selected in the effective display area 120b of the mobile phone 10 on the receiving side. 121b is displayed.

  Next, when the landmark information is confirmed, the grid lines are erased and the landmark information is confirmed as shown in FIG.

  That is, when the # button of the dial button 5a is inputted in the mobile phone 10 on the transmission side, it is displayed in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. The mark 121a is confirmed in the current state. Here, in order to indicate that the display mode of the mark 121a is confirmed, the display density is normally displayed as a solid line. Further, the mobile phone 10 on the transmission side transmits a confirmation command as the mark information.

  The mobile phone 10 on the reception side determines the mark 121b displayed in the effective display area 120b on the reception side in the current state based on the received confirmation command.

  As described above, even when the sequential transmission mode is set in the present embodiment, the display control unit 12 controls the display unit 4 based on the mark attribute information and the coordinate information as the mark information. 1 can be obtained.

  On the other hand, a display example when the mobile phone 10 according to the present embodiment is set to the fixed information transmission mode instead of the sequential transmission mode will be described.

  When two mobile phones 10 share the “camera image” and display them on each other's screen, and when a mark is superimposed on each other's screen by a pointing operation from one mobile phone 10 21 (a) to 21 (d) and FIGS. 22 (a) to 22 (c) are displayed.

  That is, when the absolute position designation mode is started, as shown in FIG. 21A, the effective display area 130a of the transmitting-side mobile phone 10 and the effective display area 130b of the receiving-side mobile phone 10 are not displayed. The shared “camera image” is displayed.

  Here, in the effective display area 130a of the mobile phone 10 on the transmission side, a divided grid line 132a and a default mark 131a for displaying a divided area of the effective display area 130a are displayed.

  Further, in the effective display area 130b of the mobile phone 10 on the receiving side, a default mark 131b is displayed in the same display manner as the mobile phone 10 on the transmitting side.

  Next, when the type of the mark is changed, the mark display mode is changed from an arrow to a circle as shown in FIG.

  That is, when the * button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The type of the mark 131a is changed from a “type = 1” group indicating one point (pinpoint) to a circle defined by “shape = 1” of a “type = 2” group indicating a certain range (area). Is done.

  Next, when the shape of the mark is changed in the absolute position designation mode, the mark is changed from ○ to □ as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The shape of the mark 131a is changed from ◯ defined by “shape = 1” to □ defined by “shape = 2”. Note that the display mode of the mark 131a is a double line and the display density is light to indicate that it is the absolute position designation mode.

  Next, when the absolute position for displaying the mark is designated, the mark is displayed in the user designated area as shown in FIG.

  That is, when one button of the dial button 5a is input in the mobile phone 10 on the transmission side, as shown in FIG. 21 (d), nine divided areas in the effective display area 130a of the mobile phone 10 on the transmission side. Among them, a mark 131a of the type / shape / size currently selected is displayed in the upper left divided area, which is the absolute position corresponding to one button.

  Next, when the relative position of the mark is designated, the display position of the mark is finely adjusted as shown in FIG.

  That is, when 8 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, they are displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The mark 131a relatively moves in the downward direction, which is a relative direction corresponding to the 8 buttons, by the amount of relative movement currently selected.

  Next, when the size of the mark is changed in the relative position designation mode, the size of the mark is changed as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The size of the mark 131a is changed from the default “medium” to “small”.

  Next, when the landmark information is confirmed, the grid lines are deleted and the landmark information is confirmed as shown in FIG.

  That is, when the # button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The mark 131a is confirmed in the current state. Here, in order to indicate that the display mode of the mark 131a has been determined, the display density is normally displayed with a solid line.

  Here, since the mark information has been confirmed, the mobile phone 10 on the transmission side sequentially transmits the coordinate information command, mark attribute information command, and confirm command on the effective display area as the mark information.

  The mobile phone 10 on the receiving side performs pointing processing based on the received landmark information.

  Specifically, the mobile phone 10 on the receiving side places a mark 121b of type, shape, and size based on the mark attribute information command at a position on the effective display area 120b based on the coordinate information command on the effective display area. Based on the confirmation command, a solid line is displayed in a display mode in which the display density is normal.

  As described above, even when the fixed information transmission mode is set in the present embodiment, the display control unit 12 controls the display unit 4 based on the mark attribute information and the coordinate information as the mark information, thereby implementing the above-described implementation. The same effect as in the first mode can be obtained.

  Furthermore, as shown in FIG. 23, processing when the resolution is different between the mobile phone 10 on the transmission side and the mobile phone 10 on the reception side will be described.

  In this case, if necessary, the number of pixels (120 × 128) in the vertical and horizontal directions, which is information indicating the resolution of the effective display area on the transmission side, is transmitted to the mobile phone 10 on the reception side. .

  On the other hand, the mobile phone 10 on the receiving side calculates a multiplier for absorbing the difference in resolution based on the relational expression (1) of S130 shown in the flowchart of FIG. The resolution difference may be absorbed by multiplying the coordinates on the area or the size of the mark by the calculated multiplier.

  Therefore, even when the display-side mobile phone 10 and the receiving-side mobile phone 10 have different display screen resolutions, the coordinates in the effective display area of the transmitting-side mobile phone 10 and the size of the mark are used. Thus, the same position of the image of the mobile phone 10 on the receiving side can be pointed.

  That is, when three buttons of the dial button 22 of the mobile phone 10 on the transmission side are input, the marks 23a and 23b are pointed to the upper right area on both the mobile phone 10 on the transmission side and the reception side.

  The relative position is also specified by multiplying a multiplier for absorbing the difference in resolution by the mobile phone 10 on the reception side with reference to the coordinates in the effective display area of the mobile phone 10 on the transmission side, Therefore, pointing can be performed with the coordinate information after the relative position is designated in the effective display area of the mobile phone 10 on the transmission side.

  As described above, in the mobile phone 10 of this embodiment, even when the display screen resolution differs between the transmission side and the reception side, coordinate information in the effective display area at the resolution of the mobile phone 10 on the transmission side is received. Thus, also in the mobile phone 10 on the receiving side, the display control unit 12 can control the display unit 4 to point to the same position on the screen.

  In the above example, the mobile phone 10 is used as the information communication terminal, but the present invention is not limited to this. That is, the technique of pointing to the same position on the screen when the display screen has different resolutions on the transmission side and the reception side is also effective when the information communication terminal is not the mobile phone 10. For example, the information communication terminal may be a television receiver (hereinafter simply referred to as a television) equipped with a communication function.

  Televisions are classified according to the shape of the display screen into standard televisions with a ratio of 4: 3 in the horizontal and vertical directions of the screen and wide televisions with a ratio of 16: 9. In other words, there may be a case where the aspect ratio of the display screen is different between the transmission-side television and the reception-side television.

  On the other hand, by applying the technique shown in the second embodiment, the display screen on the standard television and the display screen on the wide television can be pointed at the same position on the screen. In addition, even when a TV equipped with a communication function and the mobile phone 10 communicate with each other, a large display screen of the TV and a small display screen of the mobile phone 10 can be obtained by applying the technique described in the second embodiment. Can point to the same position on the screen.

  In addition, since the mobile phone 10 on the receiving side multiplies a multiplier for absorbing the difference in resolution to absorb the difference in resolution, for example, information displayed on the main screen of a television equipped with a communication function Even when the icon is displayed again on the child screen, the mark can be displayed on the child screen at the same position as the mark displayed on the parent screen.

[Embodiment 3]
Embodiments relating to an information communication terminal, a terminal control method, a terminal control program, and a recording medium recording the same according to the present invention will be described below.

  For convenience of explanation, components having the same functions as those described in the first and second embodiments are denoted by the same reference numerals and description thereof is omitted. Furthermore, the description based on the flowchart in the present embodiment is basically the same as the processing content described in the first embodiment, and therefore, the description of the conditions overlapping those in the first and second embodiments is omitted.

  In the present embodiment, a multi-function television 10T equipped with a communication function is assumed as an information communication terminal. FIG. 24 is a block diagram showing a schematic configuration of the multi-function TV 10T according to the present embodiment. As shown in the figure, the multi-function television 10T includes a control unit 1, a ROM 2, a RAM 3, a display unit 4, an input unit 5, an audio processing unit 6, a communication unit 7, a television broadcast receiving unit 201, and a camera 202. Yes. The control unit 1, the ROM 2, the RAM 3, the display unit 4, the input unit 5, the voice processing unit 6, and the communication unit 7 are the same as those described in the first embodiment, and thus description thereof is omitted here. .

  The TV broadcast receiving unit 201 is a tuner that receives an RF signal as a TV broadcast signal received by a TV antenna (not shown). Examples of television broadcasting include terrestrial analog broadcasting, terrestrial digital broadcasting, analog satellite broadcasting, and digital satellite broadcasting. Moreover, the form which receives a broadcast signal from a cable television may be sufficient.

  The camera 202 is photographing means for photographing the user side of the multi-function TV 10T when the multi-function TV 10T is used as a videophone. The camera 202 is realized by a CCD camera, for example.

  In the first embodiment, the communication unit 7 performs communication via the antenna 7a. However, in the present embodiment, the communication unit 7 may perform communication by wired connection. Examples of the wired connection include an ISDN (integrated services digital network) communication network, an ADSL (asymmetric digital subscriber line) communication network, and an optical fiber communication network. In the present embodiment, the input unit 5 is implemented as a remote controller that performs instruction input wirelessly such as infrared rays.

  In addition, the control unit 1 includes a landmark information creation unit 11, a display control unit 12, a communication control unit 13, a landmark information movement control unit 14, a channel setting unit (channel setting unit) 203, and a network content receiving unit (network content receiving unit). 204, an image information holding unit 205, and an image information storage unit 206 are formed as functional blocks. Since the mark information creating unit 11, the display control unit 12, the communication control unit 13, and the mark information movement control unit 14 are the same as those described in the first embodiment, the description thereof is omitted here.

  The channel setting unit 203 sets a TV broadcast channel to be received by the TV broadcast receiving unit 201. The network content receiving unit 204 performs processing for acquiring content on the network from the network via the communication unit 7. Examples of the content on the network include, but are not limited to, web page data including image data, moving image data, audio data, and the like.

  The image information holding unit 205 stores information on content to be shared, for example, information about a network address such as moving image data, from the communication target multifunction TV 10T, for example. The image information storage unit 206 stores and stores content to be shared, for example, moving image data itself. The image information holding unit 205 may be configured by a temporary storage unit such as a RAM, and the image information storage unit 206 may be configured by a non-volatile storage unit such as a hard disk drive. It is not limited to these.

  FIG. 25A shows the appearance of the multi-function TV 10T. As shown in the figure, the multi-function TV 10T basically has the same appearance as a normal TV, and a display unit 4 as a TV screen display means is provided on the front surface. The transmitter 6b used when using the videophone function is provided as an upper part of the multi-function TV 10T as a microphone.

  The receiver 6a used when using the videophone function is provided as a speaker on the front surface of the multi-function TV 10T. The speaker as the receiver 6a is configured to output various sounds output from the multi-function TV 10T, for example, TV sound when receiving a TV broadcast.

  The camera 202 used when using the videophone function is provided on the top of the multi-function TV 10T. Note that the configuration illustrated in FIG. 25A is merely an example, and the arrangement positions of the transmission unit 6b, the reception unit 6a, the camera 202, and the like are not limited thereto.

  FIG. 25B shows the appearance of the input unit 5 as a remote controller of the multifunction TV 10T. As shown in the figure, the input unit 5 includes a display content switching button 211, a content sharing button 212, a mark moving button 213, an utterance button 214, an end button 215, a cancel button 216, a numeric input button 217, and a video reproduction control. A button 218 and a mark determination button 219 are provided.

  The display content switching button 211 is a button for switching input of a signal to be displayed on the display unit 4. For example, every time the display content switching button 211 is pressed, a signal to be displayed on the display unit 4 is switched to a television broadcast signal, a videophone signal, a video signal, or the like.

  The content sharing button 212 is used when instructing to start sharing or end sharing of some information (content) with the terminal device of the call destination when using the videophone function. Button. Examples of the content include television programs, Web pages, moving image data on the network, moving image data stored in the information communication terminal on the transmission side or the reception side, and the like.

  The utterance button 214 is a button for inputting an instruction to start a call when the videophone function is used. The call end button 215 is a button for inputting an instruction to end a call when the videophone function is used. The cancel button 216 is a button for issuing a cancel instruction for some operation.

  The numeric input button 217 is a button used when some numeric input is performed. For example, the numeric input button 217 is used as a channel selection button when watching TV, while the numeric input button 217 is used as a telephone number input button when the videophone function is used. It is done.

  The moving image reproduction control button 218 is a button for performing reproduction control such as reproduction / pause, stop, rewind, and fast forward of moving image data when reproducing moving image data. Examples of the moving image data controlled by the moving image reproduction control button 218 include moving image data stored in the image information storage unit 206.

  The mark moving button 213 is a button used when moving the mark displayed on the display unit 4, and is represented as a donut-shaped button in FIG. The mark moving button 213 can be tilted with respect to all directions such as up, down, left and right, and the mark moves in the direction in which the mark moving button 213 is tilted. A mark determination button 219 is used to determine the position of the mark.

  As with the dial button 5a in the above-described embodiment, the mark can be moved using the buttons 1 to 9 in the number input button 217, but the mark is also moved by the mark moving button 213. It is possible. Although the details of moving the mark with the mark moving button 213 will be described later, when moving images are displayed, the mark is gradually moved as the object to be pointed is moved. This is suitable for a simple pointing operation.

  In the present embodiment, as described above, an example in which the multi-function TV 10T is used as an information communication terminal is described. However, the information communication terminal is not limited to this, and for example, a mobile phone having an equivalent function. It may be a type communication terminal (including a mobile phone).

(Pointing operation example)
In the first and second embodiments described above, pointing on a relatively small display screen of the mobile phone 10 is assumed. On the other hand, when the multi-function television 10T having a relatively large display screen is used as in the present embodiment, it is necessary to devise a pointing process. That is, when specifying a mark using the absolute position mode, the area of the divided area is large if only one divided area is specified among the nine divided areas as shown in FIG. Cannot be accurately pointed to. In addition, even when the mark is moved using the relative position mode in order to point the object more accurately, the dial screen 5a must be operated many times to move the mark because the display screen is large. .

  In order to solve such a problem, in the present embodiment, as shown below, absolute position designation is performed in two stages. FIG. 26A to FIG. 26C are display screen diagrams for explaining the pointing processing in the present embodiment.

  First, at the start of communication, as shown in FIG. 26 (a), image information shared with the information communication terminal on the reception side is displayed in the effective display area 4Ta of the multifunction TV 10T on the transmission side. . In the effective display area 4Ta, divided grid lines for dividing the effective display area 4Ta into nine divided areas (length 3 × width 3) are displayed.

  When the absolute position is designated in the absolute position mode, a mark 221a is displayed in the divided area of the display screen corresponding to the input number input button 217 as shown in FIG. That is, in the multi-function TV 10T, when the “1” button of the numeric input button 217 is input, as shown in FIG. 26B, among the nine divided areas shown in the effective display area 4Ta, “ A mark 221a is displayed in the upper left divided area, which is the absolute position corresponding to the 1 "button. The shape of the mark 221a may be, for example, a circle inscribed in the selected divided area, but the shape is not particularly limited.

  Thereafter, the divided area whose absolute position is designated for the first time is further divided into a plurality of small divided areas. That is, in the divided area designated for the absolute position for the first time, a divided grid line for dividing the divided area into nine small divided areas (vertical 3 × horizontal 3) is displayed.

  In the state of FIG. 26B, when the “9” button of the numeric input button 217 is further input on the multi-function TV 10T, as shown in FIG. The mark 221b is displayed in the lower right subdivision area that is the absolute position corresponding to the button “9” among the nine subdivision areas. The shape of the mark 221b may be, for example, a circular shape that is inscribed in the selected subdivision area, but the shape is not particularly limited.

  As a result, when the input operation is performed twice on the dial button 5a, it is possible to specify one of the subdivided areas obtained by dividing the display screen into 81 pieces.

  Note that, from the state shown in FIG. 26C, the subdivision area may be further divided into nine so that one of them can be designated and selected at an absolute position. That is, by repeating the absolute position specification a plurality of times, it is possible to accurately perform pointing processing even for a relatively small position on the display screen. The mark information set as described above is transmitted to the multi-function TV 10T on the receiving side in the above-described sequential transmission mode or fixed information transmission mode.

  The process for selecting one of the divided area and the small divided area is not limited to the method using the buttons 1 to 9 in the number input buttons 217, and various methods are conceivable. . For example, a selection switching button is provided in the input unit 5, and each time the selection switching button is pressed, the mark 221a or the mark 221b sequentially moves in a divided area (small divided area), and a desired divided area (small divided area) is selected. The position may be determined by pressing the mark determination button 219 after moving to the (division area). In addition, a four-way movement button is provided in the input unit 5, and the mark 221a or the mark 221b is moved to a desired divided area (small divided area) by using the four-way movement button, and the mark determination button 219 is pressed. Thus, the position may be determined.

  Further, the position may be determined by moving the mark 221a or the mark 221b to a desired divided area (small divided area) using the mark moving button 213 and pressing the mark determining button 219. Further, by using the cancel button 216, it may be possible to cancel the divided area (small divided area) once determined and re-designate it. In other words, you can redesignate one of the subdivision areas within the subdivision area, cancel the subdivision area specification, set the target to be the subdivision area that is the parent, cancel the subdivision area and subdivision area specification, etc. May be possible.

(Sharing TV programs)
Next, in this embodiment, an information communication terminal on both the transmission side and the reception side is the multi-function television 10T, and an image shared between the transmission side and the reception side is an example of an image of a television broadcast. In this embodiment, it is assumed that the transmitting side and the receiving side display the same TV program and have a conversation through a videophone while performing a pointing operation. According to such a usage mode, for example, as shown in FIG. 27, among members of a singer group appearing in a certain TV program, a certain member is marked with a mark 221 and pointed to the other party. You can enjoy conversations like “I like you”.

  At this time, a problem arises when the channel selected on the multi-function TV 10T on the transmission side is different from the channel selected on the multi-function TV 10T on the reception side. In this case, even if the mark information is transmitted / received, the information indicated by the mark is different between the transmission side and the reception side, and therefore the transmission / reception of the mark information is meaningless.

  In order to prevent such a situation, the multi-function TV 10T on the transmission side transmits the currently selected channel information to the multi-function TV 10T on the reception side prior to the transmission of the landmark information. The multi-function TV 10T on the receiving side receives the channel information from the multi-function TV 10T on the transmission side prior to receiving the landmark information, and sets the channel according to the received channel information.

  Here, the flow of processing in the multifunction TV 10T on the transmission side and the multifunction TV 10T on the reception side will be described below with reference to FIGS. 28 (a) and 28 (b). FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, processing in the multi-function TV 10T on the transmission side will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function.

  In step S2001, when the user presses the content sharing button 212 in the input unit 5, a content sharing start instruction is transmitted to the multi-function TV 10T on the receiving side. More specifically, when the content sharing button 212 is pressed, a content sharing instruction signal is transmitted to the communication control unit 13 in the control unit 1, and the content sharing instruction signal is received from the communication unit 7 based on the control of the communication control unit 13. To the multi-function TV 10T. As a result, the multi-function TV 10T on the receiving side shifts to a content sharing standby state.

  Next, in S2002, the channel setting unit 203 acquires the channel setting of the television program that is currently receiving the television broadcast in the device itself. Here, it is assumed that the user is simultaneously viewing the television while using the videophone function. In this case, a videophone video and a television video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  In step S2003, the channel information acquired by the channel setting unit 203 is transmitted to the communication control unit 13, and a channel information signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. Is done. Thereby, the multi-function TV 10T on the receiving side can recognize which channel the TV program should be displayed.

  After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creation unit 11 generates landmark information (S2004). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  In addition, when the video by the videophone and the video of the TV are displayed on the display unit 4 in the multi-screen format, the position information of the mark is the relative position information in the area where the TV video is displayed. Are transmitted to the multi-function television 10T on the receiving side.

  In step S2005, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Next, in S2006, it is confirmed whether or not the content sharing is to be terminated. Specifically, it is determined whether or not it has been detected that the content sharing button 212 in the input unit 5 has been pressed. Unless the content sharing button 212 has been pressed (NO in S2006), the processing in S2004 and S2005 is performed. Will be repeated.

  On the other hand, if YES in S2006, that is, if it is detected that the content sharing button 212 is pressed, a content sharing end signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. (S2007). As a result, the multi-function TV 10T on the receiving side can recognize the end of content sharing.

  Next, processing in the multi-function TV 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state of being.

  In S2008, the content sharing instruction signal transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. When the communication control unit 13 is notified that the content sharing instruction signal has been received, the communication control unit 13 shifts to a content sharing standby state.

  Next, in S2009, the channel information signal transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. The received channel information signal is transmitted from the communication control unit 13 to the channel setting unit 203. Then, the channel setting unit 203 starts receiving the television program of the channel corresponding to the received channel information signal, and instructs the display control unit 12 to display the television program of the corresponding channel (S2010). ). Here, it is assumed that the user is simultaneously viewing the television while using the videophone function. In this case, a videophone video and a television video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  In step S <b> 2011, when the mark information transmitted from the transmission-side multifunction TV 10 </ b> T is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2012).

  In addition, when the video by the videophone and the video of the TV are displayed on the display unit 4 in the multi-screen format, the position information of the mark included in the received mark information is an area where the TV video is displayed. Is displayed on the display unit 4 as a relative position.

  Next, in S2013, the communication control unit 13 confirms whether or not a content sharing end signal indicating a content sharing end instruction is received from the multi-function TV 10T on the transmission side. In S2013, NO, that is, unless the content sharing end signal has been received, the processes in S2011 and S2012 are repeated.

  On the other hand, if YES in S2013, that is, if a content sharing end signal is received, content sharing ends.

  In addition, when receiving the channel information from the multi-function TV 10T on the transmission side in the multi-function TV 10T on the reception side, the channel currently being viewed is not changed suddenly, but the channel information is received from the other party. May be displayed, and a confirmation process may be performed such that the channel change is approved by the user.

(Sharing web pages)
Next, in this embodiment, the multi-function TV 10T on both the transmitting side and the receiving side can be connected to the Internet and has a Web (World Wide Web) browser function. An example in which an image shared on the receiving side is an image of a Web page will be described. In this embodiment, it is assumed that the transmitting side and the receiving side display the same Web page, and a conversation is performed by a videophone while performing a pointing operation. According to such a form of use, for example, as shown in FIG. 29, a Web page of a toy shop site on the network is displayed, and a mark 221 is displayed for a toy among the displayed toy images. You can enjoy the conversation "I want this stuffed animal".

  At this time, a problem arises when the Web page displayed on the transmission-side multifunction TV 10T is different from the displayed Web page selected on the reception-side multifunction TV 10T. In this case, even if the mark information is transmitted / received, the information indicated by the mark is different between the transmission side and the reception side, and therefore the transmission / reception of the mark information is meaningless.

  In order to prevent such a situation, the multi-function TV 10T on the transmission side transmits address information designating the currently displayed Web page to the multi-function TV 10T on the reception side prior to the transmission of the landmark information. The reception-side multifunction TV 10T receives address information from the transmission-side multifunction TV 10T prior to receiving the landmark information, accesses the network by the received address, and displays the acquired Web page.

  Here, the flow of processing in the multifunction TV 10T on the transmission side and the multifunction TV 10T on the reception side will be described below with reference to FIGS. 30 (a) and 30 (b). FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, processing in the multi-function TV 10T on the transmission side will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function.

  In S2021, when the user presses the content sharing button 212 in the input unit 5, a content sharing start instruction is transmitted to the multi-function TV 10T on the receiving side. As a result, the multi-function TV 10T on the receiving side shifts to a content sharing standby state.

  Next, in S2022, the network content receiving unit 204 acquires the address (URL (Uniform Resource Locator)) of the Web page currently displayed by the Web browsing function of the network content receiving unit 204 in its own device. Here, it is assumed that the Web page is being browsed at the same time while using the videophone function. In this case, a videophone video and a web page video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  Next, in S2023, the URL information acquired by the network content receiving unit 204 is transmitted to the communication control unit 13, and the URL information is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. Is done. Thereby, the multi-function TV 10T on the receiving side can recognize the address of the Web page to be displayed.

  After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creating unit 11 generates landmark information (S2024). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  When the video by the videophone and the video of the Web page are displayed on the display unit 4 in the multi-screen format, the position information of the mark is the relative position within the area where the video of the Web page is displayed. Information is transmitted to the multi-function TV 10T on the receiving side.

  In step S <b> 2025, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Further, when a scroll operation is performed by a user while a Web page is displayed, operation information indicating the scroll amount may be transmitted to the multi-function TV 10T on the receiving side. . In this way, if the size (number of pixels) of the display area of the Web page in both the multifunction TV 10T on both the transmission side and the reception side is the same, it is possible to synchronize the scrolling state. It is possible to make them completely match.

  Further, display size information regarding the size (number of pixels) of the display area of the Web page in the transmission-side multifunction TV 10T may be transmitted to the reception-side multifunction TV 10T. In this way, in the multi-function TV 10T on the reception side, the display state of the Web page is received from the transmission side by setting the Web page display area to the same size as the Web page display area size on the transmission side. It is possible to completely match with the side.

  Alternatively, even if the size of the display area of the Web page is different between the transmission side and the reception side, the reception side analyzes the size of the display area of the Web page on the transmission side and the position information of the mark on the reception side. It is also possible to calculate at which position in the display area of the Web page the mark should be displayed. As a result, even if the display state (arrangement positions of characters and images) of the Web page is different between the transmission side and the reception side, the pointing object can be matched between the transmission side and the reception side.

  Next, in S2026, it is confirmed whether or not the content sharing is to be terminated. Specifically, it is determined whether or not it has been detected that the content sharing button 212 in the input unit 5 has been pressed. Unless the content sharing button 212 has been pressed (NO in S2026), the processing in S2024 and S2025 is performed. Will be repeated.

  On the other hand, if YES in S2026, that is, it is detected that the content sharing button 212 has been pressed, a content sharing end signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. (S2027). As a result, the multi-function TV 10T on the receiving side can recognize the end of content sharing.

  Next, processing in the multi-function television 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state of being.

  In step S2028, the content sharing instruction signal transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. When the communication control unit 13 is notified that the content sharing instruction signal has been received, the communication control unit 13 shifts to a content sharing standby state.

  In step S2029, the URL information transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. The received URL information is transmitted from the communication control unit 13 to the network content receiving unit 204. Then, the network content receiving unit 204 acquires a Web page having an address corresponding to the received URL information from the network, and instructs the display control unit 12 to display the corresponding Web page (S2030). Here, it is assumed that the Web page is being browsed at the same time while using the videophone function. In this case, a videophone video and a web page video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  Next, in S2031, when the mark information transmitted from the multi-function TV 10T on the transmission side is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2032).

  In addition, when the video by the videophone and the video of the Web page are displayed on the display unit 4 in the multi-screen format, the video of the Web page is displayed as the position information of the mark included in the received mark information. It is displayed on the display unit 4 as a relative position within the area.

  Next, in S2033, the communication control unit 13 confirms whether or not the content sharing end signal indicating the content sharing end instruction is received from the multi-function TV 10T on the transmission side. As long as NO in S2033, that is, unless a content sharing end signal is received, the processing in S2031 and S2032 is repeated.

  On the other hand, if YES in S2033, that is, if a content sharing end signal is received, content sharing ends.

  When receiving the URL information from the transmitting multifunction TV 10T, the receiving multifunction TV 10T received the URL information from the other party instead of suddenly changing the currently viewed web page. May be displayed, and a confirmation process may be performed such that the change of the Web page is approved by the user.

(Video sharing)
Next, in the present embodiment, an example in which the image shared between the transmission side and the reception side is moving image data on the network or moving image data stored in the information communication terminal on the transmission side will be described. In this embodiment, it is assumed that the transmitting side and the receiving side display the same moving image and have a conversation through a videophone while performing a pointing operation. According to such a form of use, for example, as shown in FIG. 31, a motion picture of an athletic meet is played on the multi-function TV 10T on both the transmission side and the reception side, and the person shown in the motion picture You can enjoy the conversation "This is my child".

  The problem at this time is that the timing of moving image playback on the transmission-side multifunction TV 10T and the timing of moving image playback on the reception-side multifunction TV 10T are shifted. If the displayed timing is different, the object pointed to on the transmitting side and the object pointed to on the receiving side will be different, and transmission / reception of landmark information will be meaningless. .

  In order to prevent such a situation, the transmission-side multi-function TV 10T transmits a moving image reproduction start command to the reception-side multi-function TV 10T prior to the transmission of the landmark information, and also reproduces the moving image on the display screen. To start. Prior to the reception of the landmark information, the receiving-side multifunction TV 10T receives a moving image playback command from the transmitting-side multifunction TV 10T, and starts playing the moving image. In other words, the above-described problem can be solved by transmitting and receiving the landmark information in a state where the reproduction start timing of the moving image is matched between the transmission side and the reception side.

  In the following, two video sharing methods will be described as methods for reproducing the same video on the multi-function TV 10T on the transmission side and the multi-function TV 10T on the reception side.

  The first moving image sharing method is a method of using moving image data on the network as described with reference to FIGS. 30 (a) and 30 (b). In this case, in the multi-function TV 10T on the transmission side, after a moving image reproduction start command is transmitted to the multi-function TV 10T on the reception side, the moving image data on the Web is accessed using the network address to reproduce the moving image data. . The multi-function TV 10T on the receiving side accesses the moving image data on the Web using the designated network address after receiving the moving image reproduction start command, and reproduces the moving image data.

  The second moving image sharing method is a method in which the receiving multifunction TV 10T receives and reproduces the moving image data held by the transmitting multifunction TV 10T. In this case, after the moving image data to be shared is first transmitted from the multi-function TV 10T on the transmission side to the multi-function TV 10T on the reception side, a reproduction start command is issued from the multi-function TV 10T on the transmission side. As a result, the multi-function TV 10T on the transmission side and the reception side simultaneously reproduces the moving image data.

  First, the flow of processing in the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T in the first moving image sharing method will be described below with reference to FIGS. 32 (a) and 32 (b). To do. FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, processing in the transmission-side multifunction TV 10T will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function.

  In step S2041, the network content receiving unit 204 acquires an address (URL information) on the Internet where the moving image data to be shared is placed. Here, for example, the user selects a hyperlink indicating the corresponding moving image data and inputs an instruction to set the selected hyperlink as moving image data in the Web browser. In this case, when the instruction input input by the user from the input unit 5 is recognized by the network content receiving unit 204, the network content receiving unit 204 acquires the URL information of the corresponding moving image data.

  In step S <b> 2042, the URL information acquired by the network content receiving unit 204 is transmitted to the communication control unit 13, and the URL information is transmitted from the communication unit 7 to the multi-function television 10 </ b> T on the receiving side based on control of the communication control unit 13. Is done. Thereby, the multi-function television 10T on the receiving side can recognize the address on the Internet of the moving image data to be displayed.

  In step S <b> 2043, when the user presses the content sharing button 212 in the input unit 5, a content sharing start instruction is transmitted from the communication unit 7 to the multi-function TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. Sent. In addition, when transmitting the content sharing start instruction, a moving image data reproduction command corresponding to the URL information transmitted in S2042 is also transmitted at the same time. This process can be realized by, for example, displaying an item of a moving image reproduction start instruction as an option when the content sharing button 212 is pressed and selecting it by the user. As a result, the multi-function TV 10T on the receiving side shifts to a content sharing standby state and starts to reproduce moving image data corresponding to the already notified URL information.

  At the same time as the reproduction instruction of the moving image data shared in S2043 is transmitted, in S2044, the network content receiving unit 204 accesses the moving image data corresponding to the URL information and reproduces the acquired moving image data. The moving image reproduced by the network content receiving unit 204 is displayed on the display unit 4 under the control of the display control unit 13. Here, it is assumed that a video is displayed simultaneously while using the videophone function. In this case, a videophone video and a video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creation unit 11 generates landmark information (S2045). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  When the videophone video and the video image are displayed on the display unit 4 in the multi-screen format, the position information of the mark is the relative position information in the area where the video image is displayed. Are transmitted to the multi-function television 10T on the receiving side.

  In step S <b> 2046, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Next, in S2047, it is confirmed whether or not to end the content sharing. Specifically, it is determined whether or not it has been detected that the content sharing button 212 in the input unit 5 has been pressed. Unless the content sharing button 212 has been pressed (NO in S2047), the processing in S2045 and S2046 is performed. Will be repeated.

  On the other hand, if YES in S2047, that is, it is detected that the content sharing button 212 has been pressed, a content sharing end signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. (S2048). As a result, the multi-function TV 10T on the receiving side can recognize the end of content sharing.

  Next, processing in the multi-function television 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state of being.

  In S2049, the URL information transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. The received URL information is temporarily stored in the image information holding unit 205 so that it can be called later when a reproduction instruction is issued.

  In step S2050, a content sharing start instruction and a moving image data reproduction command are received via the communication unit 7. When the communication control unit 13 is notified that the content sharing instruction signal has been received, the communication control unit 13 shifts to a content sharing standby state. In addition, when a moving image data playback command is transmitted to the communication control unit 13, this is transmitted to the network content receiving unit 204. Then, the network content receiving unit 204 reads out the URL information temporarily stored in the image information holding unit 205, accesses the moving image data corresponding to the URL information, and reproduces the acquired moving image data (S2051).

  Here, it is assumed that the video data is being played back simultaneously while using the videophone function. In this case, a videophone video and video data may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  In step S <b> 2052, when the mark information transmitted from the transmission-side multifunction TV 10 </ b> T is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2053).

  Note that when the videophone video and the video data are displayed on the display unit 4 in a multi-screen format, the video position data included in the received landmark information is displayed as video data. It is displayed on the display unit 4 as a relative position within the area.

  Next, in S2054, the communication control unit 13 confirms whether or not a content sharing end signal indicating a content sharing end instruction is received from the multi-function TV 10T on the transmission side. As long as NO in S2054, that is, unless a content sharing end signal is received, the processes in S2052 and S2053 are repeated.

  On the other hand, if YES in S2054, that is, if a content sharing end signal is received, content sharing ends.

  Note that when the multi-function TV 10T on the receiving side receives a video data playback command from the multi-function TV 10T on the transmitting side, the video data is not played back suddenly, but the video data playback command is sent from the other party. A confirmation process may be performed such that the reception is displayed and the reproduction of the moving image data is approved by the user.

  Next, the flow of processing in the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T in the second moving image sharing method will be described below with reference to FIGS. 33 (a) and 33 (b). explain. FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, processing in the multi-function TV 10T on the transmission side will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function.

  In S2061, the communication control unit 13 reads the moving image data to be shared from the image information storage unit 206, and transmits the moving image data to the receiving-side multifunction TV 10T via the communication unit 7. Here, for example, the user inputs an instruction to transmit the moving image data stored in the image information storage unit 206 to the communication destination. When the transmission of the moving image data is completed, the process proceeds to S2062. If the receiving-side multi-function TV 10T is implemented to transmit a moving image data reception completion notification, the process proceeds to S2062 after receiving the moving image data reception completion notification.

  Next, in step S2062, when the user presses the content sharing button 212 in the input unit 5, based on the control of the communication control unit 13, an instruction to start content sharing is sent from the communication unit 7 to the multifunction TV 10T on the receiving side. Sent. Further, when transmitting the content sharing start instruction, the moving image data reproduction command transmitted in S2061 is also transmitted at the same time. This process can be realized by, for example, displaying an item of a moving image reproduction start instruction as an option when the content sharing button 212 is pressed and selecting it by the user. As a result, the multi-function TV 10T on the receiving side shifts to a content sharing standby state and starts to reproduce the already received video data.

  At the same time as the reproduction command of the moving image data to be shared in S2062, the corresponding moving image data stored in the image information storage unit 206 is reproduced in S2063. The video of the moving image data is displayed on the display unit 4 based on the control of the display control unit 13. Here, it is assumed that a video is displayed simultaneously while using the videophone function. In this case, a videophone video and a video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type designation operation, the shape designation operation and the like are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creation unit 11 generates landmark information (S2064). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  When the videophone video and the video image are displayed on the display unit 4 in the multi-screen format, the position information of the mark is the relative position information in the area where the video image is displayed. Are transmitted to the multi-function television 10T on the receiving side.

  In step S <b> 2065, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Next, in S2066, it is confirmed whether or not to end the content sharing. Specifically, it is determined whether or not it has been detected that the content sharing button 212 in the input unit 5 has been pressed. Unless the content sharing button 212 has been pressed (NO in S2066), the processing of S2064 and S2065 is performed. Will be repeated.

  On the other hand, if YES in S2066, that is, it is detected that the content sharing button 212 has been pressed, a content sharing end signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. (S2067). As a result, the multi-function TV 10T on the receiving side can recognize the end of content sharing.

  Next, processing in the multi-function TV 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state of being.

  In step S <b> 2068, the moving image data transmitted from the transmission-side multifunction TV 10 </ b> T is received via the communication unit 7. The received moving image data is stored in the image information storage unit 206 so that it can be called later when a reproduction instruction is given (S2069). When the reception of the moving image data is completed, the process proceeds to S2070. Note that the video data reception completion notification may be transmitted to the multi-function TV 10T on the transmission side. If the multi-function TV 10T on the transmission side receives a video data reception completion notification and transmits a content sharing start instruction and a video data playback command, the video data playback command has received video data. You will receive it only after

  Next, in S 2070, a content sharing start instruction and a moving image data playback command are received via the communication unit 7. When the communication control unit 13 is notified that the content sharing instruction signal has been received, the communication control unit 13 shifts to a content sharing standby state. In addition, the moving image data reproduction command is transmitted to the communication control unit 13, whereby the corresponding moving image data stored in the image information storage unit 206 is reproduced. The video of the moving image data is displayed on the display unit 4 based on the control of the display control unit 13. (S2071).

  Here, it is assumed that the video data is being played back simultaneously while using the videophone function. In this case, a videophone video and video data may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  In step S <b> 2072, when the mark information transmitted from the transmission-side multifunction TV 10 </ b> T is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2073).

  Note that when the videophone video and the video data are displayed on the display unit 4 in a multi-screen format, the video position data included in the received landmark information is displayed as video data. It is displayed on the display unit 4 as a relative position within the area.

  Next, in S2074, the communication control unit 13 confirms whether or not a content sharing end signal indicating a content sharing end instruction is received from the multi-function TV 10T on the transmission side. In S2074, NO, that is, unless the content sharing end signal is received, the processing of S2072 and S2073 is repeated.

  On the other hand, if YES in S2074, that is, if a content sharing end signal is received, content sharing ends.

  Note that when the multi-function TV 10T on the receiving side receives a video data playback command from the multi-function TV 10T on the transmitting side, the video data is not played back suddenly, but the video data playback command is sent from the other party. A confirmation process may be performed such that the reception is displayed and the reproduction of the moving image data is approved by the user.

  In the second moving image sharing method, the receiving multi-function TV 10T receives all moving image data from the transmitting multi-function TV 10T and stores it in the image information storage unit 206, and then playback is started. However, in this case, the moving image data cannot be reproduced while the reception of the moving image data is not completed. On the other hand, a method may be used in which moving image data is reproduced on the transmission-side multifunction TV 10T and the reproduced moving image information is transmitted as stream data to the reception-side multifunction TV 10T. According to such a method, it is possible to eliminate the need to wait for the time required for transmission / reception of moving image data.

  Also, according to such a method, the playback timing on the transmission-side multifunction TV 10T and the playback timing on the reception-side multifunction TV 10T are almost the same. The display timing shift from the mark information is not a big problem.

  However, it is also conceivable that the reproduction quality of moving image data in the multi-function television 10T on the receiving side is reduced due to network congestion or the like. For such a problem, as in the second moving image sharing method described above, a method in which moving image data possessed by the transmitting-side multifunction TV 10T is transmitted in advance to the receiving-side multifunction TV 10T. Is preferred.

  Also, in the streaming playback method described above, if the buffer size when streaming playback is performed in the multi-function TV 10T on the receiving side is large due to network congestion or the like, the video on the transmitting side and the receiving side It is conceivable that the display timing shift between the reproduction timing and the landmark information becomes large. In order to cope with this, the following landmark transmission method may be performed.

  As a first mark transmission method, in the method of transmitting the mark information in the sequential transmission mode, the multi-function TV 10T on the transmission side transmits the mark information in the header of each packet of the moving image data to be transmitted. Can be mentioned. According to this method, the multi-function television 10T on the receiving side displays the landmark information included in the header of the packet of the received streaming moving image data in synchronization with the display timing of the data included in the packet. The display timing difference between the reproduction timing and the mark information can be eliminated. For example, in RTP (Real-time Transport Protocol), which is a video and audio transmission protocol, the 4th byte from the beginning of the header of the RTP packet is an extension bit, and the header is set by setting the extension bit. Can be extended. Using the expanded header area, the coordinate position of the mark can be transmitted.

  As a second mark transmission method, a method of including information indicating at which timing of corresponding moving image data each mark included in the mark information is displayed in the mark information transmitted from the multi-function TV 10T on the transmission side. Is mentioned. This method can also be applied to the first moving image sharing method. In the first moving image sharing method, moving image data on the network is acquired and reproduced on the transmitting side and the receiving side, but it is conceivable that streaming reproduction is also performed here. Also in this case, moving image reproduction can be performed by including, in the mark information transmitted from the multi-function TV 10T on the transmission side, information indicating at which timing of the corresponding moving image data each mark included in the mark information is to be displayed. The display timing difference between the timing and the landmark information can be eliminated.

  As a third method, in the multi-function TV 10T on the receiving side, the object indicated by the mark information first instructed from the transmitting side is image-recognized, and then the mark is followed based on the image recognition result. There is a method of making it. The processing of the receiving-side multifunction TV 10T will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function. Further, it is assumed that content such as moving image data is shared in the multifunction TV 10T on the transmission side and the reception side.

  In S <b> 2121, the shared content is displayed on the screen of the display unit 4. In S2122, when the mark information transmitted from the multi-function TV 10T on the transmission side is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display the mark based on the received mark information, and the mark is displayed on the display unit 4 (S2123). Then, the display position of the mark information and the pattern near the display position are temporarily stored. The pattern to be stored may identify a person or a car by image recognition, or may be a simple color pattern storage.

  After a predetermined time (for example, 1 second) has elapsed in S2125, it is checked whether a pattern similar to the pattern stored in S2124 is found near the display position stored in S2124 (S2126). That is, within a certain distance from the display position stored in S2124, a pattern that can be regarded as having the same pattern as S2124, a change in size within a certain range, or rotation or deformation within a certain range is found. Check to see if.

  If a similar pattern is found, the process proceeds to step S2127, the mark is moved to the position of the found similar pattern, and the process returns to step S2124. If a similar pattern is not found, the process proceeds to S2128, the mark is deleted, and the process ends.

(Example of mark movement control)
As described above, when moving image data is used as shared content, it is important to move mark information following the moving image. For example, as shown in FIG. 34 (a) to FIG. 34 (e), or FIG. 43 (a) to FIG. 43 (e), the athletic meet video is played on the transmission-side and reception-side multifunction TV 10T, When a person is marked and pointed to the other person in the video, the person moves in accordance with the reproduction of the video. Therefore, the mark must be moved in accordance with the movement of the person. The sequential transmission mode described above can be used as such a technique for moving the mark. Note that in FIGS. 34 (a) to 34 (e), a circle is used as the mode of the mark information, and in FIGS. 43 (a) to 43 (e), a balloon is used as the mode of the mark information. The information “Hanako-chan” is displayed in the balloon.

  That is, as described in FIG. 32 (a) or 33 (a), after reproduction of moving image data is started on the transmission-side multifunction TV 10T, a mark is placed on a person appearing in the moving image, The mark information is transmitted to the multifunction TV 10T on the receiving side. When the person on the display screen moves, the transmission-side multifunction TV 10T remarks the person appearing in the moving image, and transmits information regarding the movement of the mark to the reception-side multifunction TV 10T.

  On the other hand, as described with reference to FIG. 32B or FIG. 33B, the multi-function TV 10T on the receiving side starts displaying the moving image and then displays the mark on the display screen every time the mark information is received. Move to display. Since the timing for starting the reproduction of moving picture information on the multi-function TV 10T on the transmission side matches the timing for starting the reproduction of moving picture information on the multi-function TV 10T on the receiving side, the target is set on the multi-function TV 10T on the receiving side. There will be no deviation from the landmark.

(Example of mark deletion control)
As described above, when moving image data is used as shared content, it is important to delete the landmark information. For example, when an athletic meet video is played on the multi-function TV 10T on the transmission side and on the reception side, and a person shown in the video is marked and pointed to the other party, the target person disappears from the display screen. If the display of the mark remains after it is closed, it may be confused when the partner knows the target person. To avoid this situation, landmarks that are no longer needed should be deleted.

  Two methods are conceivable for deleting the mark from the display screen in the multi-function TV 10T on the transmission side. One mark erasing method is a method of associating mark erasure with a specific key input operator. When the user operates the key input operator, the mark disappears from the display screen on the multi-function TV 10T on the transmission side. The other mark erasing method is a method of erasing a mark when an operation of a key input operator related to the mark display is not performed for a certain period of time. If the user does not perform an operation related to the display of the mark for a certain period of time, the mark disappears from the display screen on the multi-function TV 10T on the transmission side. Note that, as a method for enabling an erasure instruction, a key corresponding to the erasure instruction may be provided in the input unit 5, or a menu is displayed by pressing any key, and the erasure instruction included in this menu is displayed. It may be selected.

  In any case, when the mark disappears from the display screen on the multi-function TV 10T on the transmission side, an instruction to delete the mark is sent from the multi-function TV 10T on the transmission side to the multi-function TV 10T on the reception side. In the multi-function TV 10T on the receiving side, when the mark deletion command is received, the mark is deleted from the display screen.

  Here, with reference to FIG. 35 (a) and FIG. 35 (b), the flow of processing in the multi-function television 10T on the transmission side and the multi-function television 10T on the reception side in the above-described mark erasing method will be described. . FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, the processing in the multifunction TV 10T on the transmission side will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function. Further, it is assumed that content such as moving image data is shared in the multifunction TV 10T on the transmission side and the reception side.

  In S2081, the shared content is displayed on the screen of the display unit 4. After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creation unit 11 generates landmark information (S2082). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  In step S <b> 2083, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Next, in step S <b> 2084, the mark information movement control unit 204 determines whether or not deletion of the mark is instructed by a key input from the input unit 5. If NO in S2084, that is, if no deletion of the mark is instructed, in S2085, the mark information movement control unit 204 determines whether or not a key input related to the display of the mark has not been made for a certain period of time. If NO in S2085, that is, if a key input related to the display of the mark is made within a certain time, the process returns to S2082.

  On the other hand, if YES in S2085, that is, if the key input related to the display of the mark has not been made for a certain period of time, in S2086, the communication control unit 13 causes the multifunction TV 10T on the receiving side to be received via the communication unit 7. A mark erasure command is transmitted. In S2087, the display control unit 13 erases the mark displayed on the display unit 4. Although not shown, it may be configured to wait for input operation information again after erasing the mark in S2087, and return to S2082 when the display of the mark is instructed by the input operation information.

  Next, processing in the multi-function TV 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state of being. Further, it is assumed that content such as moving image data is shared in the multifunction TV 10T on the transmission side and the reception side.

  In S2088, the shared content is displayed on the screen of the display unit 4. In S2089, when the mark information transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2090).

  In step S <b> 2091, the communication control unit 13 determines whether a mark deletion command is received from the transmission-side multifunction TV 10 </ b> T via the communication unit 7. If NO in S2091, that is, if no mark erasure command has been received, the processing in S2089 and S2090 is repeated.

  On the other hand, if YES in S2091, that is, if a mark deletion command is received, the display control unit 13 deletes the mark displayed on the display unit 4 in S2092. Although not shown, it may be configured to return to S2089 after erasing the mark in S2092 and wait for the mark information to be received again, and to display the mark again when the mark information is received.

(Example of mark deletion control 2)
As a modification of the above-described mark erasure control example, a method for erasing a mark from the display screen on both the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T without communicating a mark erasure command will be described. To do.

  In the multi-function TV 10T on the transmission side, as described above, the mark is deleted using a method of deleting the mark when the operation of the key input operator related to the display of the mark is not performed for a certain period of time. The mark deletion command is not transmitted to the multi-function television 10T on the receiving side. Instead, in the multi-function TV 10T on the reception side, the mark is deleted when communication related to the display of the mark is not performed for a certain period of time from the multi-function TV 10T on the transmission side. If a communication related to the movement of the mark or other mark display is not received from the multi-function TV 10T on the transmission side for a certain period of time, the mark disappears from the display screen on the multi-function TV 10T on the receiving side.

  A certain time for detecting that the operation of the key input operator for determining whether or not to delete the mark in the multi-function TV 10T on the transmission side is detected, and whether the mark is deleted in the multi-function TV 10T on the reception side If the fixed time for detecting that the communication related to the display for determining whether or not to receive is the same interval, at the same time as the mark is erased in the multi-function TV 10T on the transmission side, The mark is erased from the multi-function TV 10T.

  FIG. 36A shows the flow of processing in the multifunction TV 10T on the transmission side in this example of mark erasure control, and FIG. 36B shows the flow of processing in the multifunction TV 10T on the reception side.

  First, the flow of processing in the multifunction TV 10T on the transmission side will be described. In FIG. 36A, the processing of S2101 to S2105 is the same as the processing of S2081 to S2083, S2085, and S2087 in FIG. That is, the processing shown in FIG. 36 (a) is different only in that there is no mark erasure instruction detection processing in S2084 of S35 (a) and no mark erasure instruction transmission processing in S2086. Is the same. Although not shown, it may be configured to wait for input operation information again after erasing the mark in S2105, and return to S2102 when the display of the mark is instructed by the input operation information.

  Next, the flow of processing in the multi-function TV 10T on the receiving side will be described. In FIG. 36B, the processing in S2106 to S2108 and S2110 is the same as the processing in S2088 to S2090 and S2092 in FIG. In the process of FIG. 36 (b), in place of the mark deletion command reception confirmation process in S2091 in FIG. 35 (b), has the mark information been received from the multi-function TV 10T on the transmission side for a certain time in S2109? The communication control unit 13 determines whether or not. If NO in S2109, that is, if landmark information is received within a certain time, the process returns to S2107. On the other hand, if YES in S2109, that is, if the landmark information has not been received for a certain time, the process proceeds to S2110. Although not shown, it may be configured to return to S2107 after erasing the mark in S2110, wait for the mark information to be received again, and display the mark again when the mark information is received.

(Other examples of mark display processing)
Next, another example of the mark display process will be described. In addition to using a single piece of mark coordinate information, a form of sending a movement locus to a partner information communication terminal using a set of mark coordinate information is also conceivable. For example, the display content shared between the multifunction TV 10T on the transmission side and the multifunction TV 10T on the reception side is a map, and the user of the multifunction TV 10T on the transmission side is the user of the multifunction TV 10T on the reception side. However, it is possible to give directions. When performing such route guidance, it is important for the other party to recognize the locus of movement of the landmark. In this embodiment, both the transmission side and the reception side show an example using the multi-function TV 10T as an information communication terminal. However, as an example of performing route guidance, information communication on the transmission side and / or reception side is performed. The terminal may be the mobile phone 10 and the form of the information communication terminal is not particularly limited.

(Example of display mode with broken line arrows)
FIG. 37 shows an example of a display screen in which the movement trajectory of the mark is displayed in the form of a broken line arrow. As shown in the figure, the broken line arrow is a figure in which the start point A, the relay points B and C, and the arrival point D are connected in order by a straight line on the map, and an arrow is indicated at the arrival point D. If such a broken line arrow is displayed on the multi-function television 10T on the receiving side, the user on the receiving side can clearly grasp what route should be followed to reach the destination.

  In order to transmit / receive such a marker consisting of a broken line arrow, the following may be performed. In the multi-function TV 10T on the transmission side, the following processing is performed. First, the type and shape of the mark are set to be a broken line arrow. Thereafter, the start point, the relay point, and the arrival point are designated, and the designated positions are stored in the buffer. When the user designates the position up to the arrival point and issues a confirmation instruction, the input operation information stored in the buffer is transmitted to the multi-function TV 10T on the receiving side.

  The details of these processes are basically the same as those in the above-described embodiment. The difference is that the position information of the mark included in the input operation information is the position information about the start point, the relay point, and the arrival point, and is not included for the position in the middle of absolute position designation or relative position designation. It is.

  On the other hand, when receiving the input operation information, the multifunction TV 10T on the receiving side first recognizes that it is a broken line arrow. A broken line arrow is displayed by recognizing the position information of the start point, the relay point, and the arrival point.

  In the above processing, the position designation of the start point, the relay point, and the arrival point is temporarily stored in the buffer, and when the input operation information is confirmed, the input operation information is changed from the transmission-side multifunction TV 10T to the reception-side multifunction TV 10T. To be sent to. On the other hand, the input operation information may be transmitted in the above-described sequential transmission mode. In this case, first, a broken line arrow is transmitted from the multi-function TV 10T on the transmission side to the multi-function TV 10T on the reception side, and when the input operation information is sequentially transmitted to the multi-function TV 10T on the reception side, This can be realized by extending the broken line arrows in the order received.

(Display mode example in sequential transmission mode)
If the display mode of the mark is set to a broken line arrow as described above, the route guidance can be simplified. However, as shown in FIG. In a simple manner of selecting one display mode candidate and displaying it at a desired coordinate, the marker information of the broken line arrow cannot be communicated. Therefore, as shown in FIG. 38, the route guidance may be performed by sequentially moving the landmarks using the sequential transmission mode.

  The example shown in FIG. 38 will be described. First, when the coordinate (100, 400) is designated as a start point in the multi-function TV 10T on the transmission side, this is transmitted to the multi-function TV 10T on the reception side in the sequential transmission mode, and a mark is displayed at the corresponding position. Thereafter, coordinates (100,300), (300,300), (500,300) are designated as relay points, and coordinates (500,150) are sequentially designated as destination points in the multi-function TV 10T on the transmission side. 10T and the mark is displayed in order at the corresponding position.

  If the processing as described above is performed, the landmark moves in an animation manner on the receiving-side multifunction TV 10T, so that a route guidance is realized. Further, since it is only necessary to use the sequential transmission mode in the above-described embodiment, the implementation is simple.

(Example of display mode by sending trajectory information)
In the case of the display mode example in the above-described sequential transmission mode, input operation information is transmitted from the transmission-side multifunction TV 10T to the reception-side multifunction TV 10T every time the mark moves. That is, there is a problem that communication processing occurs every time the mark is moved. Therefore, as an embodiment in which communication processing does not occur each time the mark is moved, a set of coordinate information of the mark is used to collect the movement locus as locus information and the multifunction TV 10T on the receiving side to the multifunction on the receiving side. A method of sending to the television 10T will be described. FIG. 39 shows a display example on the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T when the trajectory information is transmitted and received.

  As a transmission mode of input operation information, a fixed information transmission mode is used. First, in the multi-function TV 10T on the transmission side, coordinates (100, 400) are designated as the starting point. At this time, this position information is not transmitted to the receiving side, but is stored in a buffer in the multifunction TV 10T on the transmitting side. Thereafter, the coordinates (100, 300), (300, 300), (500, 300) are designated as relay points, and the coordinates (500, 150) are sequentially designated as destination points in the multi-function TV 10T on the transmission side, and this information is stored in a buffer.

  When these start point, relay point, and arrival point are determined, the position information of these points is read from the buffer, and the trajectory information is generated by the landmark information creation unit 11. Then, the input operation information including the trajectory information is transmitted from the transmission-side multifunction TV 10T to the reception-side multifunction TV 10T. When receiving the input operation information including the trajectory information, the multi-function TV 10T on the reception side sequentially displays the marks from the start point to the arrival point at predetermined time intervals (for example, 1 second). The processing of the reception-side multifunction TV 10T will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function. Further, it is assumed that content such as moving image data is shared in the multifunction TV 10T on the transmission side and the reception side.

  In S 2131, the shared content is displayed on the screen of the display unit 4. In S2132, when the input operation information including the trajectory information transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7, the input operation information including the trajectory information is marked from the communication control unit 13. It is transmitted to the information movement control unit 14. Then, the mark information movement control unit 14 reads the mark information of the first coordinates from the received trajectory information (S2133), instructs the display control unit 12 to display the mark, and thereby displays the mark on the display unit 4. (S2134). Then, the display position of the mark information and the pattern near the display position are temporarily stored. If the displayed mark information is the mark information of the last coordinate included in the trajectory information, the process ends (S2135).

  When the displayed landmark information is not the landmark information of the last coordinate included in the trajectory information, after a predetermined time (for example, 1 second) has elapsed in S2136, the landmark information of the next coordinate is read from the received trajectory information (S2137). Then, the display control unit 12 is instructed to move and display the mark, and the mark is displayed on the display unit 4 (S2138). Thereafter, the process returns to S2135, and it is determined whether or not the displayed landmark information is landmark information of the last coordinate included in the trajectory information.

  The display instruction to move the mark to the display control unit 12 in S2138 is to delete the mark already displayed and display the mark at a new coordinate position. You may display the mark at the new coordinate position without erasing it. Further, the mode of the mark may be changed according to the mode of the mark included in the input operation information including the received trajectory information, or the mark mode may be set in a fixed manner in advance on the multi-function TV 10T on the receiving side. The mark mode may be changed according to the moving direction and the moving distance from the coordinate position where the mark is displayed immediately before, or of course, the mark mode may not be changed. An embodiment in which the mode of the mark is changed according to the moving direction and the moving distance from the coordinate position where the mark is displayed immediately before will be described in detail later.

  If the processing as described above is performed, the landmark moves in an animation manner on the receiving-side multifunction TV 10T, so that a route guidance is realized. Moreover, since the transmission / reception of the input operation information is performed after the start point to the arrival point is determined, the number of communication processes can be reduced.

(Other examples of mark display mode)
FIGS. 40A to 40E show examples of display screens when the display mode of the mark is changed when the mark is moved and displayed. In this example, the display mode of the mark is changed according to the moving direction and the moving distance of the mark. As an example, anthropomorphic characters are used as the display mode of the mark.

  The reception-side multifunction TV 10T receives input operation information including trajectory information from the transmission-side multifunction TV 10T. Then, in the multi-function TV 10T on the receiving side, the landmark information movement control unit 14 first marks the first coordinate information as shown in FIG. 40A according to the received trajectory information. Instruct to display. At this time, a picture in which anthropomorphic characters are stopped is used as a mark display mode. Hereinafter, the movement display of the mark is performed by an instruction to the display control unit 12 by the mark information movement control unit 14. Next, in FIG. 40B, marks are displayed at the coordinates moved short distance upward with respect to the coordinate position of FIG. At this time, a picture in which the anthropomorphic character is walking upward is used as the display mode of the mark. In this case, since the moving direction is upward, a picture that is moving upward is selected, and since the moving distance is short, a picture that is walking is selected.

  Next, in FIG. 40C, marks are displayed at the coordinates moved a long distance in the right direction with respect to the coordinate positions of FIG. At this time, a picture in which the anthropomorphic character is running in the right direction is used as the display mode of the mark. This is because the moving direction is the right direction, so the picture moving toward the right is selected, and the moving picture is selected because the moving distance is long. Hereinafter, also in FIG. 40D and FIG. 40E, according to the mark trajectory information, a picture of anthropomorphic character as a mark display mode is selected according to the moving direction and moving distance from the immediately preceding coordinates. . Thereby, the movement of the landmark for route guidance is displayed in a more easily understandable manner for the user.

  The object of the present invention is achieved not only by the mobile phone 10 or the multi-function TV 10T equipped with the communication function in the first, second, and third embodiments described above, but each functional block provided in the control unit 1 is provided. It can also be achieved as a terminal control program which is software to be realized.

  Another object of the present invention is to supply a recording medium in which a program code of a program which is software for realizing the functions described above is recorded so as to be readable by a computer, to the system or apparatus, and the computer (or CPU, CPU) of the system or apparatus This can also be achieved by the MPU) reading and executing the program code recorded on the recording medium. In this case, the program code itself read from the recording medium realizes the above-described function, and the recording medium on which the program code is recorded constitutes the present invention.

  The recording medium may be a magnetic tape, a cassette tape, a floppy (registered trademark) disk, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM / MO / MD / DVD / CD-R, an IC card (memory card). Or a semiconductor memory such as a mask ROM / EPROM / EEPROM / flash ROM or the like.

  In the mobile phone 10 or the multi-function TV 10T according to each of the embodiments described above, the type and shape of the mark are changed in the absolute position designation mode, and the size of the mark is changed in the relative position designation mode. It is not limited to this. For example, in either mode, the type, shape, and size of the mark may be changed, and the line type and color of the mark may be changed. Further, buttons other than the dial buttons may be used for each operation.

  In each of the above embodiments, the display mode such as the line type and density of the mark is changed in order to indicate that the absolute position designation mode, the relative position designation mode, the confirmation, or the coordinate designation is in progress or during coordinate designation. However, the present invention is not limited to this, and the color, type, shape, and size of the mark may be changed.

  In each of the above embodiments, the case where the present invention is applied to a mobile phone or a multi-function TV 10T has been described. However, the present invention is not particularly limited to these, and for example, a telephone with a display, a display The present invention can also be applied to a fax machine with a cord and a cordless cordless handset with a display.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  The present invention also provides an information communication terminal that communicates information that causes another information communication terminal to perform display linked to a pointing display, which is generated by a self-input input operation, in a plurality of network information communication terminals. The area on the display screen is made to correspond to the same position as the key, and the means for designating the display area by pressing the key, the means for displaying the mark indicating the position of the designated area, and other information An information communication terminal characterized in that the communication terminal has means for transmitting at least one transmission information among the elements constituting the area designation information or landmark information for designating the designated display area. Good.

  Further, the present invention is an information communication terminal having a function capable of designating an area on a display screen to be divided into at least one or more, at least of information specifying a received area or information about a mark indicating the area. Based on any of the above, it is possible to express an information communication terminal characterized by displaying a mark indicating the position of the area in the area.

  The present invention provides a computer that controls an information communication terminal that communicates information that causes another information communication terminal to perform display linked to pointing display, which is generated by a self-input input operation, in a plurality of network information communication terminals. A storage medium storing a program to be executed, the area on the display screen corresponding to the same key layout position, and the function of designating the display area by pressing the key, and the position of the designated area A function of displaying a mark, and transmitting to the other information communication terminal at least one transmission information among the area designating information designating the designated display area or elements constituting the mark information It may be a recording medium that records a terminal control program to be executed by a computer.

  Further, the present invention is a storage medium storing a program to be executed by a computer controlling an information communication terminal having a function capable of specifying an area on a display screen to be divided into at least one or more, and specifying the received area A terminal control program for causing a computer to execute the display of the mark indicating the position of the area in the area based on at least one of the information to be performed or the information on the mark indicating the area It may be a storage medium.

  Since the information communication terminal according to the present invention is effective when sharing some content with the information communication terminal of the communication destination, in addition to the mobile phone and the multi-function TV having the communication function, for example, the communication function It can also be applied to computers (including desktop type, notebook type, PDA (Personal Digital Assistant) type, etc.).

1 is a functional block diagram of a mobile phone showing an embodiment of the present invention. It is a figure which shows the external appearance of the portable telephone of FIG. (A), (b) is a flowchart which shows the whole operation | movement of the portable telephone of a transmission side and a reception side. 6 is a flowchart showing an example of processing when the mobile phone of FIG. 1 is used as a transmission side. FIG. 5 is a flowchart showing a processing example subsequent to FIG. 4 when the mobile phone of FIG. 1 is used as a transmission side. (A)-(e) is a figure which shows an example of the information required for pointing operation in the portable telephone of FIG. (A)-(d) is a figure which shows the operation example in the case of being set to the sequential transmission mode by the portable telephone which concerns on one Embodiment of this invention. (A)-(d) is a figure which shows the operation example in the case of setting to sequential transmission mode similarly to FIG. It is a figure which shows the outline | summary of operation | movement when the resolution of the display screen which the portable telephone of a transmission side and a receiving side has differs. It is a figure which shows the change transition of the kind of mark information which the portable telephone of FIG. 1 uses, and a shape. It is a flowchart which shows an example of the process by the side of reception of the portable telephone which concerns on one Embodiment of this invention. 12 is a flowchart showing an example of processing following FIG. 11 on the receiving side of the mobile phone according to the embodiment of the present invention. (A)-(d) is a figure which shows the operation example in the case where it is not set to the sequential transmission mode by the portable telephone which concerns on one Embodiment of this invention. (A)-(d) is a figure which shows the operation example in case it is not set to sequential transmission mode similarly to FIG. It is a flowchart which shows an example of the process of the transmission side of the portable telephone which concerns on other embodiment of this invention. FIG. 16 is a flowchart showing a processing example subsequent to FIG. 15 on the transmitting side of the mobile phone according to another embodiment of the present invention. FIG. (A)-(g) is a figure which shows the other example of information required for pointing operation which the portable telephone of FIG. 1 uses. (A)-(d) is a figure which shows an example of the operation | movement in the case of being set to the sequential transmission mode by the portable telephone which concerns on other embodiment of this invention. (A)-(d) is a figure which shows an example of an operation | movement in the case of being set to sequential transmission mode similarly to FIG. It is a flowchart which shows the process of the receiving side in the portable telephone which concerns on other embodiment of this invention. (A)-(d) is a figure which shows an example of the operation | movement when not set to the sequential transmission mode by the portable telephone which concerns on other embodiment of this invention. (A)-(c) is a figure which shows an example of an operation | movement when not setting to sequential transmission mode similarly to FIG. It is a figure which shows the outline | summary of operation | movement when the resolution of the display screen which the portable telephone of a transmission side and a receiving side has differs. It is a block diagram which shows schematic structure of the multifunctional television which concerns on one Embodiment of this invention. (A) is a front view which shows the external appearance of the said multifunction TV, (b) is a top view which shows the external appearance of the remote control as an input part which the said multifunction TV has. (A)-(c) is a display screen figure which shows transition of the pointing process in the said multifunctional television. FIG. 11 is a display screen diagram illustrating an example of a state where pointing is performed in a state where a television program is displayed in the multi-function television. In the example of sharing a television program, (a) is a flowchart showing the flow of processing in the multifunction TV 10T on the transmission side, and (b) is a flowchart showing the flow of processing in the multifunction TV 10T on the reception side. It is a display screen figure which shows an example of the state which performed pointing in the state which displayed the web page in the said multifunctional television. In an example of sharing a Web page, (a) is a flowchart showing a process flow in the multifunction TV 10T on the transmission side, and (b) is a flowchart showing a process flow in the multifunction TV 10T on the reception side. FIG. 11 is a display screen diagram illustrating an example of a state where pointing is performed in a state where a moving image is displayed in the multi-function television. In the example of sharing moving image data on the network, (a) is a flowchart showing the flow of processing in the multifunction TV 10T on the transmission side, and (b) is a flowchart showing the flow of processing in the multifunction TV 10T on the reception side. . In another example of sharing moving image data on a network, (a) is a process flow in the multi-function TV 10T on the transmission side, and (b) is a flowchart showing a process flow in the multi-function TV 10T on the reception side. It is. (A)-(e) is a display screen figure which shows the example of a display when the mark is moved according to a moving image in the said multifunctional television 10T. In the example of the process of deleting the mark, (a) is a flowchart showing a process flow in the multi-function TV 10T on the transmission side, and (b) is a flowchart showing a process flow in the multi-function TV 10T on the reception side. In another example of the processing for deleting the mark, (a) is a flowchart showing the flow of processing in the multifunction TV 10T on the transmission side, and (b) is a flowchart showing the flow of processing in the multifunction TV 10T on the reception side. . It is a display screen figure which shows the example of a display at the time of displaying the locus | trajectory of the movement of a mark in the form of a broken line arrow. It is a figure which shows the example which communicates the movement of a landmark by sequential transmission mode. It is a figure which shows the example which communicates the movement of a mark by fixed information transmission mode. FIGS. 4A to 4E are display screen diagrams showing display examples when the display mode of the mark is changed according to the moving direction and moving distance of the mark. In the multi-function TV on the receiving side, a flowchart showing a flow of processing for recognizing an object indicated by the mark information first instructed from the transmitting side, and then following the mark based on the image recognition result. is there. It is a flowchart which shows the flow of a process in multifunctional television 10T of the receiving side in the case of displaying a mark based on locus | trajectory information. (A)-(e) is a display screen figure which shows the example of a display when the mark is moved according to a moving image in the said multifunctional television 10T.

Explanation of symbols

1 Control unit 2 ROM
3 RAM
4 Display section 4a Effective display area 5 Input section (input reception section)
5a Dial button 6 Voice processing unit 6a Reception unit 6b Transmission unit 7 Communication unit 7a Antenna 10 Portable telephone (information communication terminal)
10T Multi-function TV (information communication terminal)
11. Mark information creation part (mark information creation means)
12 Display control unit (display control means)
13 Communication control unit (communication control means)
14 Mark Information Movement Control Unit (Mark Information Movement Control Unit)
20a Display unit (transmission side)
20b Display unit (receiving side)
21b Effective display area (receiving side)
21a Effective display area (transmission side)
22 Dial button 23a Mark (Sender)
23b Placement (receiving side)
31 Arrow (Mark)
32 Cross (Mark)
33 Circle (marker)
34 Square (Mark)
70a Display section (transmission side)
71a Mark (Sender)
72a Divided grid line 70b Display section (receiving side)
71b Placement (receiving side)
80a Display section (transmission side)
81a Mark (Sender)
82a Divided grid line 80b Display unit (receiving side)
81b Mark (receiving side)
120a Display unit (transmission side)
121a Placemark (Sender)
122a Divided grid line 120b Display unit (receiving side)
121b Placement (receiving side)
130a Display unit (transmission side)
131a Mark (Sender)
132a Divided grid line 130b Display unit (receiving side)
131b Placement (receiving side)
201 TV broadcast receiving unit 202 Camera 203 Channel setting unit (channel setting means)
204 Network content receiving unit (network content receiving means)
205 Image information storage unit 206 Image information storage unit

Claims (28)

A display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and a communication unit that communicates information with other information communication terminals. An information communication terminal provided,
Content acquisition means for acquiring content data from outside;
Display control means for controlling the display unit so as to display content data acquired by the content acquisition means and a mark on the display screen;
Mark information movement control means for moving the display position of the mark based on input operation information by the user received by the input receiving unit;
Communication for controlling the communication unit to transmit mark information indicating the position of the mark and content provider information indicating the provider of the content data displayed on the display unit to another information communication terminal An information communication terminal comprising a control means. In addition to a TV broadcast receiving unit for receiving TV broadcasts,
The content acquisition means is channel setting means for setting a channel of a television broadcast to be received,
The information communication terminal according to claim 1, wherein the communication control unit controls the communication unit to transmit channel information of a channel set by the channel setting unit as the content provider information. The content acquisition means is network content reception means for acquiring the content data from an external network via the communication unit;
The communication control unit controls the communication unit to transmit address information of a network address to which content data acquired by the network content receiving unit is provided as the content provider information. Item 1. An information communication terminal according to item 1. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive the landmark information and the content provider information from the information communication terminal according to claim 1;
Content acquisition means for acquiring content data from the outside based on the received content provider information;
Display control for controlling the display unit to display a landmark on the display screen based on the received landmark information and to control the display unit to display content data acquired by the content acquisition unit And an information communication terminal. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; a communication unit that communicates information with other information communication terminals; and a television broadcast receiver that receives television broadcasts. There,
Communication control means for controlling the communication unit so as to receive landmark information and channel information from the information communication terminal according to claim 2;
Channel setting means for setting a channel corresponding to the received channel information as a television broadcast channel to be received;
On the display screen, based on the received landmark information, the display unit is controlled to display a landmark, and the display unit is controlled to display a television image of the channel set by the channel setting means. An information communication terminal comprising display control means. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive landmark information and address information from the information communication terminal according to claim 2;
Network content receiving means for acquiring content data provided at the corresponding address from the external network via the communication unit based on the received address information;
A display for controlling the display unit to display a landmark on the display screen based on the received landmark information and to control the display unit to display content data acquired by the network content receiving unit. An information communication terminal comprising a control means. A display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and a communication unit that communicates information with other information communication terminals. A terminal control method for an information communication terminal provided,
A content acquisition step of acquiring content data from the outside;
A display control step of controlling the display unit so as to display the content data acquired in the content acquisition step and a mark on the display screen;
A mark information movement control step for moving the display position of the mark based on input operation information by the user received by the input receiving unit;
Communication for controlling the communication unit to transmit mark information indicating the position of the mark and content provider information indicating the provider of the content data displayed on the display unit to another information communication terminal A terminal control method comprising: a control step. A terminal control method for an information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with another information communication terminal.
A communication control step for controlling the communication unit so as to receive the landmark information and the content provider information from the information communication terminal according to claim 1;
A content acquisition step of acquiring content data from the outside based on the received content provider information;
Display control for controlling the display unit to display a landmark on the display screen based on the received landmark information, and to control the display unit to display the content data acquired in the content acquisition step. And a terminal control method. A display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and a communication unit that communicates information with other information communication terminals. An information communication terminal provided,
Display control means for controlling the display unit to display specific moving image data and a mark on the display screen;
Mark information movement control means for moving the display position of the mark based on input operation information by the user received by the input receiving unit;
When the reproduction of the moving image data is started on the display unit, the communication unit is controlled to transmit reproduction instruction information for instructing the reproduction start of the moving image data to another information communication terminal, and the reproduction An information communication comprising: communication control means for controlling the communication unit so as to transmit the mark information indicating the position of the mark to the other information communication terminal after transmitting the command information Terminal. Network content receiving means for acquiring the moving image data from an external network via the communication unit;
The display control unit controls the display unit to display the moving image data acquired by the network content receiving unit on the display screen as the specific moving image data,
The communication control unit controls the communication unit to transmit address information of a network address to which the moving image data acquired by the network content receiving unit is provided to the other information communication terminal. The information communication terminal according to claim 9. An image information storage unit for storing the moving image data;
The display control means controls the display unit to display the moving image data stored in the image information storage unit on the display screen as the specific moving image data,
10. The information communication according to claim 9, wherein the communication control unit controls the communication unit to transmit the moving image data stored in the image information storage unit to the other information communication terminal. Terminal. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive reproduction instruction information and landmark information of the moving image data from the information communication terminal according to claim 9;
When the playback instruction is received, the display unit is controlled to start playback of the moving image data and display the moving image data, and to display the mark based on the received mark information. An information communication terminal comprising display control means for controlling the unit. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit to receive the reproduction instruction information of the moving image data, the address information, and the landmark information from the information communication terminal according to claim 10;
Network content receiving means for acquiring video data provided at the corresponding address from the external network via the communication unit based on the received address information,
When the playback instruction is received, the display unit is controlled to start playback of the moving image data acquired by the network content receiving means and display the moving image data, and based on the received landmark information An information communication terminal comprising display control means for controlling the display unit so as to display a mark. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit to receive the reproduction instruction information of the moving image data, the moving image data, and landmark information from the information communication terminal according to claim 11;
When the playback command is received, the display unit is controlled to start playback of the video data received via the communication unit and display the video data, and based on the received landmark information, An information communication terminal comprising: display control means for controlling the display unit so as to display a mark.   When the display control unit receives the mark information, the image recognition of the object indicated by the mark information is performed, and the display position of the mark is moved following the movement of the image-recognized object. The information communication terminal according to claim 12, 13, or 14. A display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and a communication unit that communicates information with other information communication terminals. A terminal control method for an information communication terminal provided,
A display control step for controlling the display unit to display specific video data and a mark on the display screen;
A mark information movement control step for moving the display position of the mark based on input operation information by the user received by the input receiving unit;
When the reproduction of the moving image data is started on the display unit, the communication unit is controlled to transmit reproduction instruction information for instructing the reproduction start of the moving image data to another information communication terminal, and the reproduction And a communication control step for controlling the communication unit so as to transmit the mark information indicating the position of the mark to the other information communication terminal after transmitting the command information. Control method. A terminal control method for an information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with another information communication terminal.
A communication control step of controlling the communication unit so as to receive reproduction instruction information and landmark information of the moving image data from the information communication terminal according to claim 9;
When the playback instruction is received, the display unit is controlled to start playback of the moving image data and display the moving image data, and to display the mark based on the received mark information. And a display control step for controlling the unit. A display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and a communication unit that communicates information with other information communication terminals. An information communication terminal provided,
Mark information creating means for creating mark information for designating the display position of the mark based on the input operation information by the user received by the input receiving unit;
An information communication terminal comprising: communication control means for controlling the communication unit so as to transmit the mark information and an instruction to delete the mark to another information communication terminal.   The display unit is controlled to display a mark based on input operation information by the user received by the input receiving unit, and the mark displayed in accordance with the mark erasing command is deleted. The information communication terminal according to claim 18, further comprising display control means for controlling the display unit.   20. The information communication terminal according to claim 18, wherein an instruction for deleting the mark is generated when an input operation indicating a delete instruction by a user is received by the input receiving unit.   When the input receiving unit has not received an input operation by the user for designating the display position of the mark for a predetermined period, the communication control means sends an instruction to delete the mark to other information communication terminals. The information communication terminal according to any one of claims 18 to 20, wherein the communication unit is controlled to transmit. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit to receive mark information and a mark erasure command from the information communication terminal according to any one of claims 18 to 21;
The display unit controls the display unit to display a mark on the display screen based on the received mark information, and deletes the displayed mark when a mark erasing command is received. An information communication terminal comprising display control means for controlling the information. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive landmark information from other information communication terminals;
Displayed on the display screen when the display unit is controlled to display a mark based on the received mark information and when the communication control means does not receive the mark information for a predetermined period. An information communication terminal comprising: display control means for controlling the display unit so as to erase the mark. A display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and a communication unit that communicates information with other information communication terminals. A terminal control method for an information communication terminal provided,
A landmark information creating step for creating landmark information for designating the display position of the landmark based on the input operation information by the user accepted by the input accepting unit;
A terminal control method, comprising: a communication control step of controlling the communication unit so as to transmit the mark information and an instruction to delete the mark to another information communication terminal. A terminal control method for an information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with another information communication terminal.
A communication control step of controlling the communication unit so as to receive mark information and a mark erasure command from the information communication terminal according to any one of claims 18 to 21;
The display unit controls the display unit to display a mark on the display screen based on the received mark information, and deletes the displayed mark when a mark erasing command is received. And a display control step for controlling the terminal. A terminal control method for an information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with another information communication terminal.
A communication control step for controlling the communication unit to receive landmark information from other information communication terminals;
Displayed on the display screen when the display unit is controlled to display a mark based on the received mark information and when the communication control means does not receive the mark information for a predetermined period. And a display control step of controlling the display unit so as to erase the mark. A terminal control program for operating the information communication terminal according to any one of claims 1 to 6, 9 to 14, and 18 to 23,
A terminal control program for causing a computer to realize the above means.   A computer-readable recording medium on which the terminal control program according to claim 27 is recorded.

Images