JP2005039772A - Information communication terminal and terminal control method, terminal control program and recording medium recording the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information communication terminal for displaying an image common to a plurality of information communication terminals on each other display screen, capable of displaying a mark indicating a portion of topical object on the above image with a simple operation. <P>SOLUTION: A controller 1 includes mark information generator 11, display controller 12, communication controller 13, and mark information moving controller 14, thus forming a functional block. The display controller 12 displays a mark on a segment area of the display screen corresponding to a dial button 5a depressed by a user. The mark information generator 11 generates mark information. The communication controller 13 transmits the above mark information to other information communication terminals of opposite communication parties. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an information communication terminal and terminal control in which users using information communication terminals having a communication function can communicate with each other by displaying a common screen on the display screen of each information communication terminal. The present invention relates to a method, a terminal control program, and a recording medium on which the program is recorded.

  In recent years, mobile phones have become widespread as personal tools for easily communicating with remote parties, so that voice communication and e-mail communication can be performed on a daily basis regardless of age group. It has become.

  In addition, since it has become common to install camera functions on mobile phones, it is possible to transmit images such as still images and videos taken to the other party through communication using only voice and text, use video phone functions, etc. Communication with visual elements is possible. In addition, the addition of image information has dramatically improved the function as a communication tool, increasing convenience.

  In such communication with visual elements added, a common image is displayed on each other's display screen, such as by sending an image to be talked about to the other party, and a voice call is made on the topic related to that image. It is expected that the number of cases that will be discussed by function will continue to increase with the development of communication technology.

  As such a communication mode in which a common image is displayed on each other's display screen and a voice call is made on a topic related to the image, a videophone system or the like has been conventionally devised.

  In Patent Document 1, in a position designation display device such as a television communication system, a numeric operator (dial button) of a telephone is also used as a cursor moving operator, vector data is assigned to each numeric operator, and a plurality of numeric operations are performed. There has been disclosed a position designation display device that moves a cursor superimposed on an image based on a vector sum of vector data assigned to a numeric operator when the child is turned on.

  Further, in Patent Document 2, in a remote cursor position transmission device such as a video teleconference system using an analog line, mouse cursor information is multiplexed and transmitted by a DTMF signal and transmitted via a single analog telephone line. A remote cursor position transmission device that can simultaneously transmit mouse cursor information and voice is disclosed.

Further, Patent Document 3 discloses an information transmission apparatus that transmits locus data input by voice and coordinates following a facsimile transmission image. A receiving-side apparatus that receives data from the information transmission apparatus displays a trajectory image corresponding to the trajectory data on the screen of the display unit so as to overlap the facsimile image.
Japanese Patent No. 2794586 (issued on September 10, 1998) JP-A-8-179742 (publication date July 12, 1996) JP-A-8-149234 (publication date: June 7, 1996)

  Use an information communication terminal to send a topical image to the other party, display a common image on each other's display screen, and discuss the topic related to that image using the voice call function In such cases, it may be difficult to express in words when explaining the target part of the topic on the image.

  For example, when people who do not know the names of multiple people appear in an unaligned manner, when you want to show a person in the image, or when multiple objects are shown in the image, the name in the image is unknown Or when it is desired to indicate any of a plurality of icons on the display content.

  There are also cases where it is easier to make mistakes easily by directly showing the target portion on the image than to convey it in words, or there are cases where it is desired to discuss various portions on the image while pointing to each other like a game.

  Further, when pointing to a topic target part on an image, the target part may be pointed to by one point (pinpoint) or may be pointed to by a certain range (area).

  In the situation as described above, it is important to quickly point to the target part of the image on the image with a simple operation.

  Moreover, the following is mentioned as an important subject. At first glance, all current mobile phones have the same appearance and shape, and display screen sizes are almost the same. However, the resolution of the display screen differs depending on the model. For example, currently, the vertical size of 160 × 120 pixels is the mainstream, but recently, the number of 320 × vertical 240 pixels is increasing. Between these two models, the number of pixels on the display screen is twice as large in both the vertical and horizontal directions, and the resolution (number of pixels) differs when the coordinates on the display screen are shown based on the number of pixels. There is a problem that the physical position on the display screen differs between models. For this reason, a portable phone that anyone can use easily regardless of age group must have a terminal-to-terminal pointing method that allows the user to respond without being aware of the difference in resolution (number of pixels) between terminals. .

  In the case of using the above-described conventional technique, the following problems are encountered with respect to the above problems.

  That is, in the position designation display device disclosed in Patent Document 1, mark information such as a cursor must be analogly moved to a target portion and pointed on the display screen, and the cursor position and the target portion When the distance is long, the cursor operation takes time, and it is difficult to point the object quickly.

  Furthermore, in the case of a mobile phone, since the dial buttons are small, the button interval is narrow, and the input stroke is small, it is difficult to operate a plurality of dial buttons simultaneously to move the cursor freely using a vector sum. It is.

  On the other hand, in the remote cursor position transmission device disclosed in Patent Document 2, it is considered to point mark information in a timely manner while talking to the information communication terminal on the receiving side by operating the information communication terminal of the own device. However, it assumes an analog pointing device such as a mouse and is difficult to apply to an information communication terminal such as a mobile phone.

  In addition, a mobile phone with a touch panel has been devised, which is suitable for quick pointing operation.

  However, in mobile phones that are strongly required to be low-priced and small and light, it is difficult to provide a touch panel, so that it is difficult to consider widely used in low-priced popular devices.

  In addition, there is no problem for rough pointing that is not accurate enough to be pointed with a finger, but in order to point a small part of a picture displayed on a small screen of a mobile phone, input with a thin point such as a pen Items are required. Therefore, always carrying these input items imposes a burden on the user, and it is difficult to apply it to a portable telephone whose greatest feature is that it can be easily used anytime and anywhere.

  Further, in the information transmission and transmission device disclosed in Patent Document 3, a trajectory image corresponding to the received trajectory data is displayed on the receiving side device, but the trajectory image displayed here is transmitted. The image is drawn and input by a digitizer on the side. In this case, for example, when it is desired to simply display a circle at a certain position, it is necessary to transmit all trajectory information in which the circle is drawn on the transmission side to the reception side, resulting in an increase in communication charges.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to display a common image on a display screen between a plurality of information communication terminals and to be a topic of interest on the image. An object of the present invention is to provide an information communication terminal, a terminal control method, a terminal control program, and a recording medium in which the information communication terminal and the terminal control method can simplify and improve the processing for displaying a mark indicating a part.

  More specifically, the object of the present invention is to display a common image on a display screen between a plurality of information communication terminals, and to quickly and easily operate a target portion of the topic on the image. An object is to provide an information communication terminal, a terminal control method, a terminal control program, and a recording medium that records the information communication terminal and terminal control method capable of displaying a mark to be pointed.

  Another object of the present invention is to display a common image on a display screen between a plurality of information communication terminals and to display a mark indicating a topical part on the image. Is to provide an information communication terminal, a terminal control method, a terminal control program, and a recording medium recording the same.

  In order to solve the above problems, an information communication terminal of the present invention has a display unit that displays an image based on image information on a display screen, and a key input reception unit that has a plurality of key input operators that receive input operations by a user. And a communication unit that communicates information with other information communication terminals, wherein the plurality of key input operators each divide a specific area in the display screen Mark information creating means for creating, as mark information, area designation information indicating an area obtained by dividing the specific area associated with each area and associated with the key input operator that has received an input from the user, And a communication control means for controlling the communication unit so as to transmit the mark information to another information communication terminal.

  According to said structure, in order to point the target object which performs the description etc. which are contained in the image displayed on the display screen, the key corresponding to the area | region which divided | segmented the specific area | region in the display screen where the target object is displayed Since the input operator accepts input from the user, information on the area where the mark is displayed can be created as mark information and sent to other information communication terminals. An area including the above-described object can be designated.

  Here, the key input operator is, for example, a button for inputting a number from 1 to 9 in a mobile phone, and each button is associated with each area obtained by dividing the display screen into nine one-to-one. ing.

  That is, when the numeric input button of the portable telephone is pressed, the display control means controls the display unit, and when the area of the display screen corresponding to the arrangement of the numeric input button, for example, “1” is pressed, the display screen is displayed. A landmark can be displayed in the upper left area.

  As a result, the user simply displays a mark such as an arrow in the corresponding divided area simply by pressing a key input operator such as a numeric input button associated with the divided area of the display screen on which the mark is to be displayed. It is possible to transmit the mark information instructing this to another information communication terminal.

  Therefore, the user can use a conventional configuration as it is without using a pointing device such as a mouse or a special button, and can instruct to display the mark at a desired position in a simple manner. .

  In addition, if the information communication terminal of the communication partner receives the mark information and can display the mark in the specified area on the display screen, the user of the communication partner can visually check the area including the target object. Can be confirmed.

  As described above, it is possible to communicate with a communication partner by mail or voice call in a state where the target object is clearly indicated with respect to the image to be shared.

  The communication control means may transmit the landmark information together with the image information including the object to be explained or the like, and when the transmission partner already possesses the image information, it transmits the landmark information alone. May be.

  In the information communication terminal according to the present invention, in the above configuration, the display is configured to display a mark in an area obtained by dividing the specific area associated with the key input operator that has received an input from the user. Display control means for controlling the unit may be further provided.

  In this case, since a mark is displayed also on the information communication terminal on the transmission side, it is possible to confirm on the transmission side how the mark display instruction is performed.

  The area designation information may be input operation information that is information indicating a key input operator that receives an input from the user.

  As described above, the information communication terminal can transmit the input operation information as mark information to another information communication terminal. That is, the input number or the like can be transmitted as it is to the information communication terminal of the communication partner as information.

  For example, when the numeric input button “1” of the mobile phone associated with the upper left area of the display screen is pressed, “1” as information indicating the upper left area of the display screen is used as mark information, and information on the communication partner is displayed. It can be transmitted to the communication terminal.

  The area designation information may be coordinate information that is information indicating a display position of the mark.

  As described above, the information communication terminal can transmit coordinate information as mark information to another information communication device.

  For example, when the numeric input button “1” of the cellular phone is pressed, the display screen area corresponding to the numeric input button and the coordinate information of the central portion of the divided area located at the upper left of the display screen are transmitted to the information communication terminal. Send. In this way, it is possible to specify an area including the object to be described on the display screen on the information communication terminal of the communication partner. If the information communication terminal of the communication partner can display a mark or the like in the region designated by the coordinate information, the user of the communication partner can visually confirm the region including the object.

  In the information communication terminal according to the present invention, in addition to the above-described configuration, the landmark information creating means creates landmark aspect information that is a display aspect of the landmark, and the communication control means uses the landmark aspect information as landmark information. The structure which controls the said communication part so that it may transmit with respect to this information communication terminal may be sufficient.

  According to the above configuration, the mark mode such as an arrow is displayed on the display screen of the information communication terminal in the display mode such as an arrow, a cross, a circle, and a square based on the mark information created by the mark information creating unit. And can point to a point or a predetermined area in the image. In addition, since this can be transmitted to other information communication terminals as mark information, the mark in the same mode as the transmission side is displayed on the display screen of the communication partner information communication terminal. It can be displayed in the included area.

  When the key input receiving unit receives an input to a predetermined key input operator included in the key input operator, the mark information creating means changes the display mode of the mark, and the display control means It is more preferable to display the mark whose aspect has been changed on the display screen.

  Thereby, for example, as a predetermined key input operator, by pressing the “*” button among the dial buttons of the mobile phone, the mark information is changed, and the appropriate type, shape, size, line type, Color markers can be displayed on the display screen.

  When the key input accepting unit accepts an input to a predetermined key input operator included in the key input operator, the mark information creating means determines the display mode of the mark, and the display control means It is more preferable to display the mark whose mode has been determined on the display screen.

  Thus, by pressing a predetermined key input operator, the mark information including the display type such as the mark type or shape, size, line type, color, etc. can be determined.

  In addition to the above configuration, the information communication apparatus according to the present invention can further switch the input to the key input operator between a function for designating an area for displaying the mark and a function for moving the display position of the mark. And a mark information movement control means for moving the position of the mark by a user's operation of a key input operator, and the communication control means includes mark movement information indicating movement of the mark position. The structure which controls the said communication part so that it may transmit with respect to another information communication terminal as mark information may be sufficient.

  According to the above configuration, after the mark is displayed in the divided area of the designated display screen, the mark can be moved, and the display position of the mark can be finely adjusted in the area.

  Therefore, the object in the display screen can be pointed more accurately by the finely adjusted mark. For this reason, even when the object is small, the mark information for displaying the mark that accurately points to the object can be transmitted to the communication partner.

  More preferably, when the key input accepting unit accepts an input to a predetermined key input operator included in the key input operator, the amount of movement of the mark is switched in stages for each input.

  Thus, the amount of movement when the mark is moved and the mark display position is finely adjusted can be changed, so that the mark display position can be adjusted more freely.

  More preferably, the display control means switches the display mode of the mark when the input to the key input operator is switched to the mark moving function.

  Thereby, the user of the information communication terminal easily recognizes that the mark displayed at a desired position on the display screen can be moved and finely adjusted by inputting to the key input operator. be able to. In addition, it is possible to recognize that the communication partner can move the mark and finely adjust it, that is, the display position of the mark has not yet been determined.

  The display mode of the mark is determined based on the information such as the line type, line thickness, and color included in the mark information.

  More preferably, the communication control means has a sequential transmission mode in which the mark information is transmitted each time the key input operator is pressed.

  As a result, the user can simply set the sequential transmission mode to change the transition of the landmark information including the display position, movement, display mode, etc. of the landmark input at the transmission side information communication terminal, sequentially at the communication partner. It can be transmitted to an information communication terminal on a receiving side. Therefore, by sequentially displaying the mark information on the display screen of the information communication terminal of the communication partner, it is possible to cause the partner user of the communication partner to sequentially check the transition of the mark change.

  The communication control means may have a confirmed information transmission mode for transmitting the mark information after the mark information is fixed.

  Since only the confirmed mark information is transmitted, it is only necessary to transmit the minimum necessary information, and the data communication amount can be reduced as compared with the case where the sequential transmission mode is set.

  In addition, since the confirmed landmark information is transmitted, the user of the communication partner can immediately confirm the object included in the display screen.

  More preferably, the communication control means transmits and receives the mark information together with voice data of a call.

  Thereby, for example, in an information communication terminal such as a mobile phone capable of performing a voice call while displaying an image, landmark information including digital data can be transmitted and received together with the voice data of the call.

  Therefore, the user can communicate with the target object accurately pointed by the mark included in the display screen while making a call.

  The communication control means may transmit the mark information using a DTMF (Dual Tone Multiple Frequency) signal.

  Thus, for example, the mark information can be transmitted using the DTMF signal while making a call using the output function of a push button signal (PB signal) generally mounted on a fixed telephone or the like.

  Further, by using the DTMF signal, even when the communication line is used not in the data communication mode but in the call mode, the above-described mark information can be transmitted and received, so that the mark information and the like are transmitted and received during a call. It becomes possible.

  The communication control means may be configured to transmit the mark information as data composed of sound.

  As a result, even if the communication line cannot use data communication and voice call at the same time, or the communication line cannot be used in the data communication mode, the mark information can be transmitted to the information communication terminal on the receiving side.

  For example, when an input button is pressed by a user, voice data (eg, “1” when 1 is input from the key input operator, “ni”, etc. when 2 is input) is input. The mark information can be transmitted by combining and transmitting it to the information communication terminal of the communication partner. Alternatively, when the key input operator is pressed by the user, the voice data corresponding to the key input operator is read from the voice data stored in advance and transmitted to the information communication terminal of the communication partner to transmit the mark information. can do. Alternatively, the user can transmit the mark information by transmitting the voice saying “Ichi” or “Ni” to the information communication terminal of the communication partner as voice data. In this case, for example, before the mark information is transmitted as data composed of voice, the voice of the conversation and the voice as the mark information are not mixed with each other by the communication partner, or the conversation information is switched with a button. Then, an operation such as recognizing only the voice indicating the button is required so as not to react.

  More preferably, the display control means displays the divided grid lines on the display screen.

  As a result, the area divided by the divided grid lines can be displayed on the display screen, and the user can easily determine in which area the object is displayed, so that the area to be pointed can be easily determined. Can do.

  In the information communication terminal according to the present invention, in the above configuration, the mark information creating unit is associated with the key input operator that has been input when the key input operator is input by the user. An area obtained by dividing the specific area is set as a first divided area, and when the key input operator is input by the user, an input operation is performed using the first divided area as the specific area. An area associated with the key input operator may be set as a second divided area, and area designation information indicating the second divided area may be created as mark information.

  According to this configuration, even when an information communication terminal having a relatively large display screen is used, it is possible to quickly point to a desired position. More specifically, when the display screen is relatively large, the area obtained by dividing the specific area associated with the key input operator is also relatively large, and the object in the area cannot be accurately pointed out. . On the other hand, according to the above configuration, since the area once selected is further divided into areas associated with the key input operation elements, the pointing to a desired position can be performed more accurately. Can be done. Further, in this case, detailed position designation can be performed only by specifying the area twice, so that the operation amount of the user can be kept low.

  If the region specifying operation can be performed twice or more, more detailed position specification can be performed.

  An information communication terminal according to the present invention includes a display unit that displays an image based on image information on a display screen, an input reception unit that includes an input operator that receives an input operation by a user, and another information communication terminal. An information communication terminal including a communication unit for communicating information between the display control means for controlling the display unit to display a mark on the display screen, and the input received by the input receiving unit Mark information movement control means for moving the position of the mark based on the operation, trace information indicating the trace of the display position of the mark moved by the mark information movement control means, and a mark mode indicating the display mode of the mark Mark information creating means for creating information as mark information, and communication control means for controlling the communication unit so as to transmit the mark information to another information communication terminal. It is characterized in.

  According to the above configuration, the information communication terminal on the receiving side can grasp the movement of the mark from the trajectory information and can grasp the display mode of the mark from the mark form information. Therefore, for example, when the display mode of the mark is a circle, conventionally, it has been necessary to express the circle with the trajectory information. However, according to the above configuration, the mark mode information indicating the circle is transmitted and received. Can be realized. Accordingly, it is possible to save the trouble of drawing the mark mode on the transmission side.

  Further, in the above example, when the circle mark is expressed by the trajectory information, it is necessary to transmit / receive all the position information of the circle mark trajectory, and there is a problem that the communication amount becomes relatively large. According to the configuration of the present invention, it is possible to represent a circle with only the mark mode information, and it is possible to keep the traffic amount low.

  An information communication terminal according to the present invention is an information communication terminal including a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with another information communication terminal. A communication control means for controlling the communication unit to receive the mark information from the information communication terminal described above, and the display unit to display the mark on the display screen based on the received mark information. Any configuration may be used as long as it includes display control means for controlling the display.

  According to said structure, the information of the area | region on the display screen in which the target object in which the description etc. which are contained in the image displayed on the display screen are performed is displayed can be received. Further, based on the received landmark information, the landmark can be displayed in an area including the object on the display screen. Therefore, the user can visually confirm the region including the object.

  As a result, it is possible to communicate with a communication partner by e-mail or voice call in a state where the target object is clearly indicated with respect to the image to be shared.

  When the display control means displays a mark based on the mark information received from the information communication terminal on the transmission side via the communication unit, the display control means also receives information on display conditions in the information communication terminal on the transmission side. It is more preferable to adjust the display position of the mark.

  As a result, even if the transmission side information communication terminal and the reception side information communication terminal have different display capabilities such as the resolution of the display screen, the transmission side can recognize the display conditions on the transmission side and display the mark. And the receiving side can display a mark at the same position on the display screen.

  Therefore, the user can perform pointing between the information communication terminals without being aware of the difference in the resolution (number of pixels) of the display screens of the information communication terminals.

  The display control means may receive the area designation information and the mark mode information from the information communication terminal on the transmission side, and display the mark based on these.

  In addition, when the display control means receives the area designation information from the transmission side information communication terminal, the display control means displays the mark in the corresponding area, and when receiving the mark movement information from the transmission side information communication terminal, The mark may be displayed based on the corresponding mark movement information.

  Further, when displaying the mark based on the mark movement information, the display control means displays the mark based on the corresponding movement amount when the information about the movement amount of the mark is also received. It may be.

  Further, the display control means may receive the trajectory information and the mark mode information from the information communication terminal on the transmission side, and display the mark based on these.

  The display control means may be configured to change the display mode of the mark according to the moving direction and / or the moving amount of the mark indicated by the trajectory information.

  In order to solve the above problems, a terminal control method according to the present invention has a display unit that displays an image based on image information on a display screen, and a key input reception unit that has a plurality of key input operators that receive input operations by a user. And a communication unit that communicates information with another information communication terminal, wherein the plurality of key input operators are respectively specified areas in the display screen. As the mark information, the mark information creating means uses the area designation information indicating the area obtained by dividing the specific area associated with the key input operator that has received the input from the user as mark information. The creating step and the communication control means include a step of controlling the communication unit so as to transmit the landmark information to another information communication terminal.

  According to the terminal control method described above, in order to indicate an object to be described in the image displayed on the display screen, it corresponds to an area obtained by dividing a specific area in the display screen on which the object is displayed. The key input operator that accepts input from the user can create information on the area for displaying the mark as mark information and send it to other information communication terminals. An area including the object on the display screen can be designated.

  Here, the key input operator is, for example, a button for inputting a number from 1 to 9 in a mobile phone, and each button is associated with each area obtained by dividing the display screen into nine one-to-one. ing.

  That is, when the numeric input button of the portable telephone is pressed, the display control means controls the display unit, and when the area of the display screen corresponding to the arrangement of the numeric input button, for example, “1” is pressed, the display screen is displayed. In the upper left area, mark information for instructing to display a mark such as an arrow based on the mark information created by the mark information creating means can be transmitted to another information communication terminal.

  As a result, the user simply displays a mark such as an arrow in the corresponding divided area simply by pressing a key input operator such as a numeric input button associated with the divided area of the display screen on which the mark is to be displayed. be able to.

  Therefore, the user uses the conventional configuration as it is without requiring a pointing device such as a mouse or a special button, and instructs the user to display the mark at a desired position on the display screen. be able to.

  In addition, since the landmark information can be transmitted to other information communication terminals, it is possible to communicate with the communication partner by e-mail or voice call while clearly pointing to the target object with respect to the image to be shared. .

  The communication control means may transmit the landmark information together with the image information including the object to be explained or the like, and when the transmission partner already possesses the image information, it transmits the landmark information alone. May be.

  In order to solve the above-described problem, the terminal control method of the present invention includes a display unit that displays an image based on image information on a display screen, and a communication unit that communicates information with other information communication terminals. A terminal control method for an information communication terminal provided, wherein the communication control means controls the communication unit so as to receive landmark information from the information communication terminal according to any one of claims 1 to 15. And a step of controlling the display unit so that the display control means displays the mark on the display screen based on the received mark information.

  According to said terminal control method, the information of the area | region on the display screen where the target object in which the description etc. which are contained in the image displayed on the display screen are performed is displayed can be received. Further, based on the received landmark information, the landmark can be displayed in an area including the object on the display screen. Therefore, the user can visually confirm the region including the object.

  That is, in the terminal control method of the present invention, the communication control means receives the mark information transmitted from another information terminal, and the display control means displays the mark on the display screen based on the mark information.

  A terminal control program of the present invention is a terminal control program for operating the information communication terminal in order to solve the above-described problem, and is characterized by causing a computer to realize the above means.

  According to said structure, the said information communication terminal is realizable with the said terminal control program.

  The recording medium of the present invention is characterized in that the terminal control program is recorded in order to solve the above problems.

  According to said structure, the said information communication terminal is realizable with the terminal control program read from the recording medium of this invention.

  As described above, the information communication terminal according to the present invention creates, as mark information, area designation information indicating an area obtained by dividing the specific area associated with the key input operator that has received an input from the user. A creation unit and a communication control unit for controlling the communication unit so as to transmit the mark information to another information communication terminal. As a result, the user can use a conventional configuration as it is without using a pointing device such as a mouse or a special button, and give an instruction to display the mark at a desired position in a simple manner. There is an effect that can be done.

  Further, as described above, the information communication terminal according to the present invention is moved by the mark information movement control means for moving the position of the mark based on the input operation received by the input receiving unit, and the mark information movement control means. Mark information generating means for generating, as mark information, locus information indicating the locus of the displayed position of the mark, and mark aspect information indicating the display aspect of the mark, and the mark information to other information communication terminals Communication control means for controlling the communication unit to transmit. As a result, it is possible to save the trouble of drawing the mark mode on the transmission side, and it is possible to reduce the amount of communication.

Embodiment 1
An embodiment relating to an information communication terminal, a terminal control method, a terminal control program, and a recording medium recording the information communication terminal according to the present invention will be described below with reference to FIGS.

  As shown in FIG. 2, the mobile phone (information communication terminal) 10 of the present embodiment includes a display unit 4 having an effective display area 4a, an input unit 5 having a dial button 5a, a receiving unit 6a, and a transmitting unit 6b. Has the appearance.

  As shown in FIG. 1, the mobile phone 10 includes a control unit 1, a ROM (Read Only Memory) 2, a RAM (Random Access Memory) 3, a display unit 4, and an input unit (key input receiving means). 5. A voice processing unit 6 and a communication unit 7 are provided.

  The control unit 1 includes a microcomputer, and operates according to an input operation from the input unit 5 and a control signal from the communication unit 7 in accordance with a computer program read from the ROM 2. The display unit 4, the communication unit 7, and the sound processing unit 6 is controlled. The functional blocks provided in the control unit 1 will be described in detail later.

  The ROM 2 is configured by a non-volatile memory such as a flash ROM, for example, and stores a computer program which is a terminal control program of the present invention executed by the control unit 1 and various data used by the control unit 1. Display contents such as photographic image data shared with the mobile phone 10 on the receiving side are also stored in the ROM 2.

  The computer program stored in the ROM 2 is not limited to that stored in the ROM 2 at the manufacturing / shipping stage in advance, and a storage medium such as a memory card is inserted into a storage medium reading unit (not shown). Thus, the program in the storage medium may be written in the ROM 2 or the storage medium itself may be a readable program medium. In addition, since the mobile phone 10 according to the present embodiment includes the communication unit 7 that can be connected to a communication network including the Internet, a program may be downloaded from the communication network and stored in the ROM 2.

  The RAM 3 is composed of a volatile memory such as SRAM or DRAM, for example, and is used as a work memory when the control unit 1 executes a computer program read from the ROM 2.

  The display unit 4 includes an FPD (flat panel display) such as a liquid crystal display or an organic EL display, and provides display information such as characters and images to the user by being controlled by the control unit 1. .

  The input unit 5 includes a plurality of input buttons for operating the mobile phone, including a dial button (key input operator) 5a for inputting a telephone number, characters, and the like.

  The voice processing unit 6 is connected to the receiver unit 6a and the transmitter unit 6b, outputs the voice signal input from the control unit 1 from the receiver unit 6a, and outputs the voice signal input from the transmitter unit 6b to the control unit 1 Process to output to.

  The communication unit 7 is a circuit that is connected to the antenna 7a and performs communication processing via a communication line by being controlled by the control unit 1. The communication unit 7 modulates a voice signal, data, a control signal, and the like with a high frequency, and the antenna 7a. The voice signal, data, and control signal received from the antenna 7a are demodulated and output to the control unit 1.

  In addition, when the communication unit 7 transmits / receives mark information (described later) to / from the mobile phone 10 on the receiving side, the transmission form of the mark information is digital data such as characters or a PB signal (DTMF). Are transmitted and received in a manner that can coexist with voice data for calls.

  Specifically, voice data for a call and digital data or PB signal (DTMF) are multiplexed and transmitted / received. When the transmission mode of the mark information is voice data, the voice data for the call and the voice data of the mark information are transmitted / received together.

  In this way, when digital data is used as the landmark information, the landmark information can be transmitted and received together with the voice data using a portable telephone capable of displaying an image. However, it is possible to talk about the object pointed by the mark displayed on the display screen.

  In addition, when a DTMF signal is used as the mark information, in particular, the transmission side uses a push button signal (PB signal) output function that is generally installed in a fixed telephone or the like, and the transmission side makes a DTMF while making a call. A signal can be transmitted.

  Further, when the DTMF signal is used as the mark information, the mark information can be transmitted and received even when the communication line is used in the call mode instead of the data communication mode.

  In addition, when data consisting of voice is used as the landmark information, while communicating between communication lines and information communication terminals that cannot use data communication and voice call at the same time, and information communication terminals that cannot transmit and receive DTMF signals, The landmark information can be transmitted and received.

  In this case, when the input button is pressed by the user, the mobile phone 10 on the transmission side has voice data (for example, “1” when 1 is input and “ni” when 2 is input). Etc.) may be combined and transmitted to the mobile phone 10 on the receiving side. Alternatively, the mobile phone 10 on the transmission side stores voice data in a storage unit such as a ROM in advance, and when the user presses an input button, reads out the corresponding voice data, and receives the mobile phone 10 on the reception side. May be sent to. Alternatively, the voices such as the users “1” and “ni” may be transmitted as they are to the mobile phone 10 on the receiving side as data consisting of voice.

  Note that the voice data for the call and the landmark information can co-exist in order to point to the display screen while talking with the other party. Of course, if there is no need for a call, only the landmark information is transmitted and received. May be.

  Further, as shown in FIG. 2, the mobile phone 10 has an appearance in which the display unit 4 and the input unit 5 are arranged on the user side to operate.

  A fixed display area for displaying the remaining battery level and the radio wave state is displayed on the upper end side of the display unit 4, and operation guidance indicating functions that can be used by specific button operations is displayed on the lower end side of the display unit 4. A fixed display area is displayed. In addition, the display area normally used except these fixed display areas is defined as the effective display area 4a. However, when the entire display area is used without displaying the fixed display area, the effective display area 4 a is the entire display area of the display unit 4.

  In the mobile phone 10 of the present embodiment, the effective display area 4a is managed as nine divided areas (vertical 3 × horizontal 3), and nine buttons 1 to 9 (3 × vertical) of the dial buttons 5a. This corresponds to the arrangement 3).

  Thus, when any one of the buttons 1 to 9 of the dial button 5a is pressed, the center position of one area among the nine divided areas of the effective display area 4a corresponding to the position is pointed as an absolute position. The In the present embodiment, information indicating an area including the absolute position is area specifying information indicating an area for displaying a mark.

  For example, when pointing to the lower left area of the divided area of the effective display area 4a, among the buttons 1 to 9 of the dial button 5a, the "7" button which is also arranged at the lower left is input. Thus, it is possible to point to a desired divided area.

  Further, as shown in FIG. 1, the control unit 1 provided in the mobile phone 10 of the present embodiment displays a CPU by executing various terminal control programs (application programs) stored in the ROM 2 by a CPU (not shown). As a functional block for realizing various functions by controlling hardware such as the unit 4, the input unit 5, the communication unit 7, and the voice processing unit 6, a landmark information creation unit (marking information creation unit) 11, a display control unit A (display control means) 12, a communication control section (communication control means) 13, and a mark information movement control section (mark information movement control means) 14 are formed as functional blocks.

  When the dial button 5a is pressed by the user, the mark information creating unit 11 creates mark information according to the terminal control program stored in the ROM 2. In this embodiment, the landmark information creation unit 11 creates landmark designation information indicating the landmark display mode and area designation information indicating the area where the landmark is displayed, as the landmark information. However, the present invention is not limited to this. Instead, only the area designation information may be created.

  The display control unit 12 controls the display unit 4 in accordance with the terminal control program, and the mark information created by the mark information creating unit 11 is divided into divided areas on the display screen corresponding to the dial button 5a pressed by the user. Display. The display control unit 12 can display a predetermined mark in a divided area on the display screen corresponding to the dial button 5a pressed by the user without using the mark information. It doesn't matter.

  The communication control unit 13 controls the communication unit 7 according to the terminal control program, and transmits the mark information, image information, and the like to other information communication terminals that are communication partners.

  The mark information movement control unit 14 moves and finely adjusts the display position of the mark displayed on the display screen by pressing the dial button 5a. In the present embodiment, information indicating the movement of the display position of the mark is the mark movement information.

  In the mobile phone 10 of the present embodiment, with the configuration as described above, input operation information that is region designation information or coordinate information on the effective display area is used as mark information with another mobile phone 10; Communicates input operation information or mark attribute information that is information related to the display mode of the mark, such as type, shape, size, line type, color, etc., which constitutes the mark information, and other necessary command information, etc. Thus, pointing, that is, a mark can be displayed on the images displayed on the display screens of each other.

  Further, in the mobile phone 10 of the present embodiment, since the arrangement of the divided areas of the effective display area 4a and the arrangement of the dial buttons 5a match, the user can easily display the mark in the desired divided area. be able to.

  Further, the dial button 5a provided in the conventional portable telephone is assigned to the divided area of the display unit 4 without adding a pointing device such as a mouse. Can be directly pointed to.

  Note that the landmark information, which is the format for displaying the landmark on the screen, is, for example, the type of position designation, such as whether the landmark position is designated by a point or an area, whether the shape is an arrow or a + shape, etc. The shape of the mark, the display size of the mark, and the display mode indicated by the line type such as the solid line and the broken line forming the mark, the color, and the like.

  The mark information is graphic information for pointing to a specific part on the display screen, and an “arrow” or “cross” pointing to one point (pinpoint) and “o” or “pointing” indicating a certain range (area). A figure having a shape such as “□” is superimposed and displayed on a display content such as a photographic image.

  Next, the plurality of portable telephones 10 to which the present invention is applied transmit the mark information formed by the input operation to the input unit 5 to the other portable telephones 10, and the other portable telephones 10 The flow of processing up to display on the display screen will be described below with reference to FIGS. 3 (a) and 3 (b).

  Note that the reception-side mobile phone 10 is not limited to one, and when there are a plurality of mobile phones 10, the transmission-side mobile phone 10 is similar to the plurality of reception-side mobile phones 10. Perform the process.

  First, processing in the transmitting-side mobile phone 10 will be described with reference to FIG.

  In step S <b> 1001, display content (image information) such as photographic image data that is a subject of a topic shared with the mobile phone 10 on the reception side (reception side) is displayed in the effective display area 4 a of the display unit 4. The display content that has been transmitted to the receiving side in advance or received from the receiving side may be read out from the ROM 2 by an operation from the input unit 5 and displayed, or at the time of starting pointing, You may transmit / receive with the type | mold telephone 10. FIG.

  Further, this step may be performed by independent operation irrespective of the mobile phone 10 on the reception side, or performed in synchronization by communicating with the mobile phone 10 on the reception side via the communication unit 7. May be.

  However, it is necessary to send the mark information for the effective display area 4a of the mobile phone 10 on the transmitting side to the receiving side and point the same part of the display content displayed in the effective display area 4a.

  Therefore, in the mobile phone 10 of the present embodiment, the display is performed such that the aspect ratio of the effective display area 4a and the display range of the display content are the same. Further, if necessary, display control is performed so that the aspect ratio of the effective display area 4a and the display range of the display content are the same by communicating with the receiving side via the communication unit 7, or, for example, For example, “display the entire photo of XX in full screen vertically” may be used so that the users can confirm each other using voice call or the like and perform appropriate pointing.

  Next, in S1002, the pointing start state (transmission side) is set by an operation from the input unit 5. Further, if necessary, information indicating the start of pointing may be transmitted to the mobile phone 10 on the receiving side via the communication unit 7, and the receiving side indicates that the pointing operation is started in a voice call or the like. You may tell.

  In S1003, a pointing operation is performed by an operation from the input unit 5, and the mark information is transmitted to the mobile phone 10 on the receiving side. The processing content of S1003 will be described in detail later.

  This step is finished when the pointing is completed, but this step may be repeatedly executed as necessary to perform the pointing operation continuously.

  Subsequently, processing on the receiving side will be described with reference to FIG.

  In S1004, display content such as photographic image data to be talked about shared with the mobile phone 10 on the transmission side (transmission side) is displayed in the effective display area 4a of the display unit 4.

  The display content may be shared image information that has been transmitted and received in advance with the transmission side, read out from the ROM 2 by an operation from the input unit 5, and displayed at the time of starting pointing. You may send and receive.

  The processing in this step may be performed by a single operation regardless of the transmission side, or may be performed in synchronization by communicating with the transmission side via the communication unit 7.

  However, in the mobile phone 10 on the receiving side, the mark information displayed in the effective display area 4a of the mobile phone 10 on the transmitting side is received, and the same part of the display content displayed in each effective display area 4a is displayed. Need to point.

  Therefore, in the mobile phone 10 of the present embodiment, the display is performed such that the aspect ratio of the effective display area 4a and the display range of the display content are the same. If necessary, display control is performed so that the aspect ratio of the effective display area 4a and the display range of the display content are the same by communicating with the transmission side via the communication unit 7, or, for example, For example, “display the entire photo of XX in full screen vertically” may be used so that the users can confirm each other using voice call or the like and perform appropriate pointing.

  In step S <b> 1005, the pointing start state is set by an operation from the input unit 5 or information indicating the pointing start received from the transmission side via the communication unit 7.

  Here, if necessary, the mobile phone (sender) 10 on the transmission side may be informed that the pointing operation can be started by voice call or the like.

  In S1006, a pointing operation is performed based on the landmark information received from the transmission side via the communication unit 7. If the received mark information does not include mark mode information, a mark having a predetermined shape may be displayed on the display screen. The processing content in this step will be described later.

  This step is completed when the pointing is completed, but this step may be repeatedly executed as necessary to continuously perform the pointing operation.

  The above is the outline of the overall processing by the mobile phone 10 of the present embodiment.

  Next, the case where the input operation information of the input unit 5 on the transmission side is used as the mark information transmitted / received between the mobile phones 10 will be described with reference to the flowcharts shown in FIGS. 4 and 5.

  The input operation information is information indicating the type of the input button. Among the dial buttons 5a, “1” is input when one button is input, “*” is input when the * button is input, characters, etc. It is generated by digital data expressed by, PB signal (DTMF) corresponding to the input button, voice data (such as “1”, “ni”, “asterisk” in Japanese).

  First, in S1, a setting for starting pointing control is performed.

  Specifically, the structure of the divided area of the effective display area 4a for designating the absolute position, the correspondence of the dial button 5a for designating the divided area, the transmission mode of the input operation information to be transmitted as the mark information, and the transmission mode Perform settings required for pointing operations, such as settings.

  Note that the mobile phone 10 of the present embodiment, as the transmission mode, every time the input operation information is recognized, that is, every time the dial button 5a is pressed, the mobile phone 10 that is the transmission partner with the input operation information as mark information. It has a “sequential transmission mode” for transmitting to the telephone 10 and a “confirmed information transmission mode” for transmitting input operation information after the landmark information is confirmed.

  Here, when the mobile phone 10 is set to the “determined information transmission mode”, all the buffer areas (not shown) of the RAM 3 for storing the input operation information are cleared.

  The “sequential transmission mode” can be arbitrarily set according to the user's preference, and the mode setting screen is displayed in the effective display area 4a every time pointing is started, and the user can set it. Alternatively, the user's favorite mode may be stored in advance in the ROM 2 as setting data, and this may be set as a default setting.

  As described above, the mobile phone 10 according to the present embodiment includes the effective display area 4a including the nine divided areas (3 × 3) shown in FIG. 2, and the dial button 5a for designating the divided area. Nine buttons (vertical 3 × horizontal 3) from 1 to 9 correspond to the input.

  In addition, when the mobile phone 10 on the transmission side and the mobile phone 10 on the reception side are information communication terminals having different types and specifications, the mobile phone 10 on the transmission side and the mobile phone 10 on the reception side In the meantime, if the information necessary for the pointing operation is not clear, the information necessary for the pointing operation is transmitted to the mobile phone 10 on the receiving side via the communication unit 7.

  In addition, when the information required for the pointing operation is clear, such as when the model and specification of the mobile phone 10 on the transmission side and the mobile phone 10 on the reception side are the same, the information required for the pointing operation is It is not necessary to transmit to the mobile phone 10 on the receiving side.

  Here, an example of information necessary for the pointing operation will be described.

  As definition information of the effective display area 4a set in the mobile phone 10 on the transmission side, as shown in FIG. 6A, the vertical and horizontal division numbers of the effective display area 4a are set.

  The button used for pointing operation and the definition of the function assigned to each button are set in a format as shown in FIG.

  The code for identifying the type and shape of the mark pointed by the pointing operation, the mark applied to the code, and the definition of the size change step are set in a format as shown in FIG.

  The definition of the change step of the relative movement amount in the relative position designation mode is set in a format as shown in FIG.

  The definition of the transmission form of the input operation information to be transmitted as the mark information is set in a format as shown in FIG. 6E, and any one of the defined transmission forms is selected.

  Subsequently, in S2, the pointing mode is set to the absolute position designation mode, and the divided grid lines and the mark information created by the mark information creating unit 11 are displayed as default marks.

  Note that the mark displayed based on the divided grid lines and the default mark information is not necessarily displayed, and may not be displayed if it is not necessary.

  Here, the divided grid lines and default mark information will be described.

  As shown in FIG. 7A, the display unit 4 of the mobile phone 10 on the transmission side includes a divided grid line 72a for indicating a divided area of the effective display area 70a, a default mark, and the effective display area 70a. 71a is displayed.

  Here, the default mark information created by the mark information creating unit 11 displays an arrow defined by the identification code “type = 1, shape = 1”. Further, in order to indicate the absolute position designation mode, the display mode of the mark is displayed with a double line type and a light display density.

  Thus, by indicating the divided areas using grid lines, the user can easily recognize in which area the target object to be pointed is included.

  The expression method for indicating the absolute position designation mode may be other methods. For example, the mark display color may be a specific color to indicate the absolute position designation mode.

  In S3, the input of the dial button 5a used for the pointing operation is detected. When the input of the button is detected, the process proceeds to S4.

  In S4, input operation information is generated based on the button whose input is detected in S3.

  Since the input operation information only needs to indicate the type of the input button, digital data represented by a character or the like indicating “1” when one button is input and “*” when the * button is input is generated. .

  In S5, it is determined whether or not the input operation information generated in S4 is a button input indicating an absolute position input. The buttons indicating the input of the absolute position are nine dial buttons 1 to 9 as shown in FIG.

  If the determination is YES, the process proceeds to S6, and if the determination is NO, the process proceeds to S10.

  In S6, since the button indicating the input of the absolute position is pressed, a mark is displayed in the effective display area 4a of the mobile phone 10 on the transmission side based on the input operation information. Specifically, a mark is displayed as an absolute position in the divided area of the effective display area 4a corresponding to the dial button 5a pressed by the user. Here, the mark is displayed based on the mark information indicating the display mode of the type / shape / size currently selected.

  When the mark type points to one point (pinpoint), use “arrow” or “cross” as the mark, and place it so as to point to the center of the designated divided area. If you want to indicate a range (area), use mark information such as “○ (circle)” or “□ (square)” to set the center of the specified divided area as the center position or The smaller one of the horizontal sizes is placed as the outline size.

  When the absolute position designation is completed, a mark is displayed in a state where, for example, the line type is a broken line and the display density is normal to indicate that the relative position designation mode has been switched next.

  In S7, every time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted as mark information to the mobile phone 10 on the receiving side is set.

  If the determination is YES, the process proceeds to S8, and if the determination is NO, the process proceeds to S9.

  In S8, since the sequential transmission mode is set, input operation information, which is area designation information input by the user, is transmitted from the communication unit 7 to the mobile phone 10 on the receiving side as landmark information. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above.

  Subsequently, in order to shift to the relative position designation mode for finely adjusting the display position of the mark, the process proceeds to S20 of the flowchart shown in FIG.

  On the other hand, in S9, the input operation information is stored in a buffer area (not shown) of the RAM 3, and the process proceeds to S20 shown in the flowchart of FIG.

  In S <b> 10, it is determined whether or not the input operation information generated in S <b> 4 is a button input indicating a change in the mark type. Here, the button input indicating the change in the type of the mark is a * button defined as a key input operator for changing the type of the mark as shown in FIG.

  If the determination is YES, the process proceeds to S11, and if the determination is NO, the process proceeds to S15.

  In S11, since the type change of the mark is input, the type of the mark displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  Specifically, as shown in FIG. 10, the type of the mark indicates a certain range (area) from the type = 1 group such as “arrow 31” or “cross 32” indicating one point (pinpoint). The type is changed to the group of type = 2 such as “◯ (circle) 33” or “□ (square) 34”, or from the group of type = 2 to the group of type = 1.

  In this embodiment, when the type of the mark is changed, the shape is also changed to the changed shape = 1.

  In S12, each time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted as mark information to the mobile phone 10 on the receiving side is set.

  If the determination is YES, the process proceeds to S13, and if the determination is NO, the process proceeds to S14.

  In S13, since the sequential transmission mode is set, the input operation information that is the mark mode information is transmitted from the communication unit 7 to the mobile phone 10 on the receiving side as the mark information. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above. Subsequently, the process returns to S3.

  In S14, since the sequential transmission mode is not set, the input operation information is stored in the buffer area (not shown) of the RAM 3, and the process returns to S3.

  In S15, it is determined whether or not the input operation information generated in S4 is a button input indicating a mark shape change. Here, the button input indicating the change in the shape of the mark is the 0 button as shown in FIG.

  If the determination is YES, the process proceeds to S16, and if the determination is NO, the process proceeds to S17.

  In S16, since the mark shape change has been input, the mark shape displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  Specifically, as shown in FIG. 10, the shape of the mark is changed from shape = 1 to shape = 2 or from shape = 2 to shape = 1 in each type group.

  In S17, it is determined whether or not the input operation information generated in S4 is a button input indicating confirmation of the landmark information. Here, the button input indicating the confirmation of the landmark information is the # button as shown in FIG.

  In this step, if the absolute position has not been designated yet, the center position of the central divided area of the effective display area 4a where the mark is displayed based on the default mark information is the mark position. Recognized as a pointing position.

  If the determination is YES, the process proceeds to S37 in the flowchart of FIG. 5, and if NO, the process returns to S3.

  Subsequently, according to the flowchart shown in FIG. 5, in S20, the pointing mode is set to the relative position designation mode.

  Here, the relative movement amount at the time of relative movement is set to the default “1/2”.

  In S21, the input operation of the dial button 5a used for the pointing operation is detected, and when the input of the button is detected, the process proceeds to S22.

  In S22, input operation information is generated based on the button whose input is detected in S21.

  Since the input operation information only needs to indicate the type of the input button, digital data represented by a character or the like indicating “1” when one button is input and “*” when the * button is input is generated. .

  Subsequently, in S23, it is determined whether or not the input operation information generated in S22 is a button input indicating an input of a relative position. In the present embodiment, the button inputs indicating the input of relative positions are eight dial buttons 5a from 1 to 9, excluding 5, as shown in FIG.

  If the determination is YES, the process proceeds to S24, and if the determination is NO, the process proceeds to S25.

  In S24, since the relative position has been input, the mark displayed in the effective display area 4a of the transmitting-side mobile phone 10 is currently set based on the input operation information that is the mark movement information. Based on the relative movement amount, the relative movement is performed in the input direction.

  In S29, each time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted to the mobile phone 10 on the reception side as the mark information is set.

  Here, if the determination is YES, the process proceeds to S30, and if the determination is NO, the process proceeds to S31.

  In S30, since the sequential transmission mode is set, the input operation information is transmitted as mark information from the communication unit 7 to the mobile phone 10 on the receiving side. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above. Then, it returns to S21.

  In S31, since the sequential transmission mode is not set, the input operation information is stored in a buffer area (not shown) of the RAM 3 until the mark information is determined, and the process returns to S21.

  In S25, it is determined whether or not the input operation information generated in S22 is a button input indicating a size change of the mark. Here, the button input indicating the size change of the mark is the 0 button as shown in FIG.

  If the determination is YES, the process proceeds to S26, and if the determination is NO, the process proceeds to S27.

  In S26, since the size change of the mark is input, the size of the mark displayed in the effective display area 4a of the mobile phone 10 on the transmission side is changed based on the input operation information that is the mark mode information.

  Here, as shown in FIG. 6C, the size of the mark is set to “medium” as the default size for each kind and shape mark, and “small” and “large” each time a size change is input. The size is changed repeatedly in order in the “medium” step.

  Then, it progresses to S29. The processing after S29 is as described above.

  In S27, it is determined whether or not the input operation information generated in S22 is a button input indicating a change in the relative movement amount. Here, the button input indicating the change of the relative movement amount is the * button as shown in FIG.

  If the determination is YES, the process proceeds to S28, and if the determination is NO, the process proceeds to S32.

  In S28, since the change of the relative movement amount is input, the relative movement amount is changed based on the input operation information.

  Here, as shown in FIG. 6D, the default relative movement amount is set to “1/2” of the size of the divided area in both the vertical direction and the horizontal direction, and the relative movement amount is changed. Each time it is input, it is changed repeatedly in order of "1/4", "minimum", and "1/2" steps.

  For “minimum”, an appropriate value may be applied according to the resolution of the effective display area 4a and the size of the divided area, such as “1/10” in both the vertical and horizontal directions.

  Then, it progresses to S29 and the process after S29 is as above-mentioned.

  In S32, it is determined whether or not the input operation information generated in S22 is a button input instructing to “redo” pointing from the beginning. In the present embodiment, the button input indicating “redo” is five buttons as shown in FIG.

  If the determination is YES, the process proceeds to S33, and if the determination is NO, the process proceeds to S36.

  In S33, since “redo” is input, whether or not the “sequential transmission mode” is set in which the input operation information is transmitted to the mobile phone 10 on the receiving side as the mark information every time the input operation information is recognized. Determine whether.

  If the determination is YES, the process proceeds to S34, and if the determination is NO, the process proceeds to S35.

  In S34, since the sequential transmission mode is set, the input operation information is transmitted as mark information from the communication unit 7 to the mobile phone 10 on the receiving side. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above.

  In S35, all input operation information stored in the buffer area (not shown) of the RAM 3 is cleared. Then, it returns to S2 of the flowchart shown in FIG.

  In S36, it is determined whether or not the input operation information generated in S22 is a button input indicating confirmation of the landmark information. In the present embodiment, the button input indicating the confirmation of the landmark information is the # button as shown in FIG.

  If the determination is YES, the process proceeds to S37, and if the determination is NO, the process returns to S21.

  In S37, since the confirmation of the landmark information is input, the landmark information displayed in the effective display area 4a of the mobile phone 10 on the transmission side is confirmed in the current state based on the input operation information.

  Further, in order to indicate that the mark information has been determined, the display mode of the mark is displayed by changing the line type from a broken line to a solid line, for example.

  Further, the divided grid lines displayed in the effective display area 4a are also deleted. Here, the division grid lines are erased at the time of determination, but may be erased when the absolute position is designated, for example.

  In S38, it is determined whether or not input operation information is stored in a buffer area (not shown) of the RAM 3 and the buffer is empty.

  If the determination is YES, the process proceeds to S41, and if the determination is NO, the process proceeds to S39.

  In S39, since the input operation information is stored in the RAM 3, the stored input operation information is read one by one in the stored order, and the read input operation information is used as landmark information from the communication unit 7 on the receiving side. The data is sequentially transmitted to the mobile phone 10. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above. This step is repeated until all input operation information stored in the buffer area (not shown) of the RAM 3 is transmitted.

  In S40, since all mark information has been transmitted to the mobile phone 10 on the receiving side, all input operation information stored in the buffer area of the RAM 3 is cleared.

  In S41, the input operation information indicating the confirmation generated in S22 is transmitted as mark information from the communication unit 7 to the mobile phone 10 on the receiving side. When there are a plurality of mobile phones 10 on the receiving side, the mark information is transmitted to each mobile phone 10 as described above.

  This completes the pointing process on the transmission side.

  In the mobile phone 10 of the present embodiment, as described above, the display control unit 12 controls the display unit 4 and presses the dial button 5a of the mobile phone 10 for the image displayed on the display screen. By doing so, the mark can be easily displayed at a desired position based on the mark information created by the mark information creating unit 11.

  Similarly, by pressing the dial button 5a for the mark pointed on the display screen, the mark information movement control unit 14 easily fine-tunes the display position of the mark, and the display control unit 12 controls the display unit 4. By doing so, the mark can be displayed at the position desired by the user.

  Further, by pressing a specific button of the dial button 5a, the mark information creating unit 11 can change the display mode of the mark or confirm the mark information.

  Next, processing on the receiving side in the mobile phone 10 of the present embodiment will be described as follows using the flowcharts shown in FIGS. 11 and 12. Note that the basic conditions for processing in the mobile phone 10 on the receiving side are the same as those in the mobile phone 10 on the transmitting side.

  First, in the mobile phone 10 on the receiving side, pointing processing is performed according to the flowchart shown in FIG.

  First, in S50, a setting for starting pointing control is performed.

  Specifically, the configuration of the divided area of the effective display area 4a for designating the absolute position, the correspondence of the dial button 5a indicated by the input operation information for designating the divided area, and the input operation information received as the mark information Make settings necessary for pointing operation, such as transmission mode.

  Information necessary for the pointing operation is the same as the example shown in FIGS. 6A to 6E described above.

  In S51, the pointing mode is set to the absolute position designation mode, and a default mark is displayed. Note that the default mark information is not necessarily displayed, and may not be displayed.

  On the display screen shown in FIG. 7A, an arrow 71b is displayed in the effective display area 70b on the reception side based on the default landmark information. Here, the default mark information is an arrow defined by the identification code “type = 1, shape = 1”. Further, in order to show that the mode is the absolute position designation mode, the mark display mode is a double line type and a light display density.

  In S52, the communication unit 7 waits to receive input operation information indicating the type of button input on the transmission side. The input operation information is received in a form selected in the input operation information transmission form.

  Here, if input operation information is received, it will progress to S53.

  In S53, it is determined whether or not the input operation information received in S52 is a button input indicating a change in the mark type.

  If the determination is YES, the process proceeds to S58, and if the determination is NO, the process proceeds to S54.

  In S58, since the type change of the mark is input, the type of the mark displayed in the effective display area 4a is changed based on the input operation information. When the type of the mark is changed, the type = 1 group is changed to the type = 2 group, or the type = 2 group is changed to the type = 1 group.

  In the present embodiment, when the type is changed, the shape is also changed to the changed type group shape = 1. Subsequently, the process returns to S52.

  In S54, it is determined whether or not the input operation information received in S52 is a button input indicating a change in the shape of the mark.

  If the determination is YES, the process proceeds to S59, and if the determination is NO, the process proceeds to S55.

  In S59, since the mark shape change has been input, the mark shape displayed in the effective display area 4a is changed based on the input operation information. When the shape of the mark is changed, the shape = 1 is changed to the shape = 2 or the shape = 2 is changed to the shape = 1 in each type of group. Subsequently, the process returns to S52.

  In S55, it is determined whether or not the input operation information received in S52 is a button input indicating confirmation of the landmark information.

  In this step, although the absolute position is not yet designated, the center position of the divided area at the center of the effective display area 4a pointed based on the default mark information is recognized as the pointing position.

  If the determination is YES, the process proceeds to S67 in the flowchart shown in FIG. 12, and if the determination is NO, the process proceeds to S56.

  In S56, it is determined whether or not the input operation information received in S52 is a button input indicating an absolute position input.

  If the determination is YES, the process proceeds to S57, and if the determination is NO, the process returns to S52.

  In S57, since the absolute position is input, the mark is displayed in the effective display area 4a based on the input operation information with the mark information indicating the display mode of the type / shape / size currently selected. indicate.

  When the type of the mark is “arrow” or “cross” indicating one point (pinpoint), the mark is displayed so as to indicate the center of the designated divided area. On the other hand, when the mark type is “○” or “□” indicating a certain range (area), the center of the specified divided area is the center position, whichever is smaller, vertical or horizontal of the divided area The mark is displayed with the size as the outline size.

  In addition, in order to indicate that the absolute position designation is completed and the relative position designation mode is set next, the display mode of the mark is, for example, the line type is a broken line and the display density is normal.

  Subsequently, in order to shift to a relative position designation mode for finely adjusting the display position of the mark, the process proceeds to S60 of the flowchart shown in FIG.

  In S60, the pointing mode is set to the relative position designation mode, and the relative movement amount at the time of relative movement is set to the default “1/2”.

  In S <b> 61, the communication unit 7 waits for reception of input operation information indicating the type of button input on the transmitting-side mobile phone 10. The input operation information is received in a form selected in the input operation information transmission form. If input operation information is received, it will progress to S62.

  In S62, it is determined whether or not the input operation information received in S61 is a button input indicating a size change of the mark.

  If the determination is YES, the process proceeds to S68, and if the determination is NO, the process proceeds to S63.

  In S68, since the mark size change has been input, the size of the mark displayed in the effective display area 4a is changed based on the input operation information. Subsequently, the process returns to S61.

  In S63, it is determined whether or not the input operation information received in S61 is a button input indicating a change in the relative movement amount of the mark.

  If the determination is YES, the process proceeds to S69, and if the determination is NO, the process proceeds to S64.

  In S69, since the change of the relative movement amount of the mark is input, the relative movement amount is changed based on the input operation information. Subsequently, the process returns to S61.

  In S64, it is determined whether or not the input operation information received in S61 is a button input instructing to “redo” pointing from the beginning.

  Here, if the determination is YES, the process returns to S51, and if the determination is NO, the process proceeds to S65.

  In S65, it is determined whether or not the input operation information received in S61 is a button input indicating input of a relative position.

  If the determination is YES, the process proceeds to S70, and if the determination is NO, the process proceeds to S66.

  In S70, based on the input operation information, the mark displayed in the effective display area 4a of the mobile phone 10 on the receiving side is relatively moved in the designated direction based on the currently set relative movement amount. Subsequently, the process returns to S61.

  In S66, it is determined whether or not the input operation information received in S61 is a button input indicating confirmation of the landmark information.

  If the determination is YES, the process proceeds to S67, and if the determination is NO, the process returns to S61.

  In S67, the mark information displayed in the effective display area 4a of the mobile phone 10 on the receiving side is determined in the current state based on the input operation information.

  Further, in order to indicate that the mark information has been confirmed, the display mode of the mark is displayed by changing the line type to a solid line, for example.

  This completes the pointing-side pointing process.

  In the mobile phone 10 of the present embodiment, as described above, the display control unit 12 controls the display unit 4 based on the landmark information received from the transmission side, even in the mobile phone 10 on the reception side. The same display as that displayed on the transmitting-side mobile phone 10 can be performed.

  Thereby, it is possible to display on the display screen in a state where a mark is added to a common image in a plurality of mobile phones 10 that perform transmission and reception. Therefore, the user can exchange information about the object pointed by the mark using a call or text information.

  Furthermore, in the mobile phone 10 of the present embodiment, specific display states on the transmitting-side and receiving-side mobile phones 10 when the sequential transmission mode is set will be described.

  7 (a) to 7 (d) and FIGS. 8 (a) to 8 (d), two portable telephones 10 share "images showing a desktop personal computer" and display them on each other's screens. In this example, a mark is superimposed on each other's screen by a pointing operation from one mobile phone 10.

  At the time of starting communication, as shown in FIG. 7A, the effective display area 70a of the mobile phone 10 on the transmission side and the effective display area 70b of the mobile phone 10 on the reception side are shared “desktops”. An image showing a computer "is displayed.

  Further, as shown in FIG. 7A, the effective display area 70a of the mobile phone 10 on the transmission side is based on divided grid lines 72a for indicating divided areas of the effective display area 70a and default mark information. A mark 71a is displayed. Here, the default mark 71a is an arrow defined by the identification code “type = 1, shape = 1”, and in order to indicate the absolute position designation mode, the display mode of the mark 71a is a double line. And the display density is lightly displayed (hereinafter, the same display is performed in the absolute position designation mode).

  Further, in the effective display area 70b of the mobile phone 10 on the receiving side, a default mark 71b is displayed in the same display manner as the mobile phone 10 on the transmitting side.

  Next, when the shape of the mark is changed in the absolute position designation mode, the mark information changes to a cross as shown in FIG.

  That is, in the mobile phone 10 on the transmission side, as shown in FIG. 7B, the shape of the mark 71a displayed on the mobile phone 10 on the transmission side is reduced by pressing the 0 button of the dial button 5a. , The arrow defined by “shape = 1” is changed to a cross defined by “shape = 2”.

  Further, the transmitting-side mobile phone 10 transmits input operation information “0” indicating the type of the input button as mark information to the receiving-side mobile phone 10. Based on the received input operation information, the mobile phone 10 on the reception side changes the shape of the mark 71b displayed in the effective display area 70b on the reception side from the arrow defined as “shape = 1” to “shape”. = 2 ”.

  Next, when an absolute position is designated, as shown in FIG. 7C, a mark is displayed in the divided area of the display screen corresponding to the dial button 5a.

  That is, when one button of the dial button 5a is input in the mobile phone 10 on the transmission side, as shown in FIG. 7C, 9 shown in the effective display area 70a of the mobile phone 10 on the transmission side. Of the two divided areas, a mark 71a of the currently selected type, shape, and size is displayed in the upper left divided area that is the absolute position corresponding to one button. It should be noted that the display mode of the mark 71a is a broken line and the display density is normally displayed in order to indicate that the relative position designation mode has been switched after the absolute position of the mark is set (hereinafter referred to as the relative position). It shall be displayed in the same way in the designated mode).

  Furthermore, the mobile phone 10 on the transmission side transmits input operation information “1” indicating the type of the input button as mark information to the mobile phone 10 on the reception side. Based on the received input operation information, the mobile phone 10 on the receiving side is divided into an upper left divided area that is an absolute position corresponding to one button among the nine divided areas shown on the mobile phone 10 on the receiving side. A mark 71b of the type / shape / size currently selected is displayed.

  Next, when the size of the mark is changed, the size of the mark is changed as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, as shown in FIG. 7 (d), the mark 71a displayed on the mobile phone 10 on the transmission side is displayed. The size is changed from the default “medium” to “small”.

  Further, the transmitting-side mobile phone 10 transmits input operation information “0” indicating the type of the input button as mark information to the receiving-side mobile phone 10. The mobile phone 10 on the receiving side changes the size of the mark 71b displayed in the effective display area 70b on the receiving side from the default “medium” to “small” based on the received input operation information.

  Next, when the relative position is designated in the relative position designation mode, the position of the mark is changed as shown in FIG.

  That is, when 6 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, the mark 71a displayed on the mobile phone 10 on the transmission side is displayed as shown in FIG. , 6 moves relative to the right, which is the relative direction corresponding to the 6 button, by the amount of relative movement currently selected. In this case, the relative movement amount is “1/2” as a default, and thus is ½ of the horizontal size of the divided area.

  Furthermore, the mobile phone 10 on the transmission side transmits input operation information “6” indicating the type of the input button as mark information to the mobile phone 10 on the reception side. Based on the received input operation information, the mobile phone 10 on the receiving side selects the mark 71b displayed in the effective display area 70b on the receiving side at the present time in the right direction that is the relative direction corresponding to the 6 buttons. The relative movement is performed by the amount of relative movement. The relative movement amount is the same as described above.

  Next, when the relative movement amount in the relative position designation is changed, the * button is pressed as shown in FIG.

  That is, in the mobile phone 10 on the transmission side, when the * button of the dial button 5a is pressed, as shown in FIG. 8 (b), the relative movement amount when the relative movement of the mark 71a on the transmission side is performed. The default “1/2” is changed to “1/4”.

  Further, the transmitting-side mobile phone 10 transmits input operation information “*” indicating the type of the input button as mark information to the receiving-side mobile phone 10. Based on the received input operation information, the mobile phone 10 on the receiving side changes the relative movement amount when the relative mark 71b on the receiving side is moved from the default “1/2” to “¼”. To do.

  Next, when the relative position is further changed in the relative position designation mode, the mark moves as shown in FIG.

  That is, when two buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, the mark 71a displayed on the mobile phone 10 on the transmission side is displayed as shown in FIG. The relative movement is made in the upward direction, which is the relative direction corresponding to the two buttons, by the amount of relative movement currently selected. Since the relative movement amount is “¼”, it is ¼ of the vertical size of the divided area.

  Furthermore, the mobile phone 10 on the transmission side transmits input operation information “2” indicating the type of the input button as mark information to the mobile phone 10 on the reception side. Based on the received input operation information, the mobile phone 10 on the reception side selects the mark 71b displayed in the effective display area 70b on the reception side in the upward direction, which is a relative direction corresponding to the two buttons, at the present time. The relative movement is performed by the amount of relative movement. The relative movement amount is the same as described above.

  Next, when the landmark information is confirmed, the display mode of the landmark changes as shown in FIG.

  That is, when the # button of the dial button 5a is input in the mobile phone 10 on the transmission side, the mark 71a displayed on the mobile phone 10 on the transmission side is displayed as shown in FIG. In order to indicate that the display state of the mark 71a has been determined in the current state, it is displayed with a solid line and a display density of normal.

  Further, the transmitting-side mobile phone 10 transmits input operation information “#” indicating the type of the input button to the receiving-side mobile phone 10 as the mark information. Based on the received input operation information, the mobile phone 10 on the receiving side determines the mark 71b displayed in the effective display area 70b of the mobile phone 10 on the receiving side in the current state, and sets the mark 71b. In order to indicate that the display mode has been determined, the display mode is displayed with a solid line and a display density of normal.

  When the mobile phone 10 of the present embodiment is set to the sequential transmission mode, as described above, when the input is made via the dial button 5a on the transmission side, the communication control unit 13 controls the communication unit 7. For each input, the input information is transmitted to the mobile phone 10 on the receiving side.

  On the other hand, in the mobile phone 10 on the receiving side, the display control unit 12 controls the display unit 4 to display a mark on the display screen based on the received mark information, A similar screen can be displayed.

  In the sequential transmission mode, the input operation information is transmitted for each input operation of the transmitting-side mobile phone 10, and the receiving-side mobile phone 10 receives the input operation information and performs a pointing process. For this reason, the content of the operation until the landmark information is confirmed by the mobile phone 10 on the transmission side can be confirmed on the screen also by the mobile phone 10 on the reception side. Therefore, compared with the case where the mark is displayed at some point on the display screen, the follower of the user on the receiving side to the pointing position of the mark can be improved. Furthermore, it can be expected that a feeling of pointing with the user of the mobile phone 10 on the transmission side can be obtained.

  On the other hand, in the mobile phone 10 of the present embodiment, specific display examples when the fixed information transmission mode is set instead of the sequential transmission mode are shown in FIGS. 13 (a) to 13 (d) and FIG. It will be as follows if it demonstrates using (a)-FIG.14 (d).

  Here, in the same manner as described above, the two portable telephones 10 share the “desktop personal computer image” and display them on the screens of each other, and the pointing operation from one portable telephone 10 allows the mutual screens to be displayed. The operation for displaying the mark in a superimposed manner will be described.

  Note that the same conditions as those described with reference to FIGS. 7A to 7D and FIGS. 8A to 8D are omitted here.

  At the start of communication, as shown in FIG. 13A, the effective display area 80a of the mobile phone 10 on the transmission side and the effective display area 80b of the mobile phone 10 on the reception side are shared. “Desktop computer image” is displayed.

  Next, when the type of the mark is changed, the display mode of the mark changes from an arrow to a circle as shown in FIG.

  That is, when the * button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. The type of the mark 81a is changed from “type = 1” group indicating one point (pinpoint) to “◯” defined by “shape = 1” of “type = 2” group indicating a certain range (area). To do.

  Further, the transmitting-side mobile phone 10 stores input operation information “*” indicating the type of the input button as mark information in the buffer area of the RAM 3.

  Next, when the absolute position is designated, a mark is displayed in the user designated area as shown in FIG.

  That is, when 6 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, nine divided areas in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. Among them, a mark 81a of the type / shape / size currently selected is displayed in the right center divided area, which is the absolute position corresponding to 6 buttons.

  Further, in the mobile phone 10 on the transmitting side, input operation information “6” indicating the type of the input button is stored as mark information in the buffer area of the RAM 3.

  Next, when it is instructed to “redo” the pointing of the mark from the beginning, as shown in FIG. 13D, the state returns to the state shown in FIG.

  That is, when 5 buttons of the dial button 5a are input to the mobile phone 10 on the transmission side, the mobile phone 10 on the transmission side stores them in the buffer area of the RAM 3 as shown in FIG. Clear all input operation information and return to the absolute position designation mode start state.

  Next, when the type of the mark is changed again, as shown in FIG. 14A, the display mode of the mark changes from an arrow to a circle.

  That is, when the * button of the dial button 5a is input in the mobile phone 10 on the transmission side, the mark displayed in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. The type of 81a is changed from a “type = 1” group indicating one point (pinpoint) to a circle defined by “shape = 1” of a “type = 2” group indicating a certain range (area). .

  Further, the transmitting-side mobile phone 10 stores input operation information “*” indicating the type of the input button as mark information in the buffer area of the RAM 3.

  Next, when the absolute position is designated again, the mark is displayed in the user designated area as shown in FIG.

  That is, when 9 buttons of the dial button 5a are input to the mobile phone 10 on the transmission side, as shown in FIG. 14B, the nine divided areas in the effective display area 80a of the mobile phone 10 on the transmission side are shown. Among them, a mark 81a of the type / shape / size currently selected is displayed in the lower right divided area, which is the absolute position corresponding to the 9 button.

  Further, the transmitting-side mobile phone 10 stores input operation information “9” indicating the type of the input button as mark information in the buffer area of the RAM 3.

  Next, after the absolute position of the mark is determined, the process proceeds to the relative position designation mode. When the relative position is designated, the mark display position is moved as shown in FIG.

  In other words, when the “1” button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. The mark 81a is relatively moved in the upper left direction, which is the relative direction corresponding to the “1” button, by the relative movement amount currently selected. Since the relative movement amount is “1/2” by default, it is ½ each of the vertical and horizontal sizes of the divided areas.

  Further, the transmission side stores input operation information “1” indicating the type of the input button as mark information in the buffer area of the RAM 3.

  Next, when the landmark information is confirmed, the display mode of the landmark changes as shown in FIG.

  That is, when the # button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 80a of the mobile phone 10 on the transmission side as shown in FIG. In order to indicate that the mark 81a is confirmed in the current state and the display mode of the mark 81a is confirmed, the display density is normally displayed as a solid line.

  Further, the mobile phone 10 on the transmitting side sequentially transmits the input operation information “*”, “9”, “1” stored in the buffer area of the RAM 3 as the mark information, and finally indicates confirmation. Input operation information “#” is transmitted.

  The mobile phone 10 on the reception side sequentially performs the pointing process of the mark 81b displayed in the effective display area 80b on the reception side based on the received input operation information.

  In other words, the mobile phone 10 on the receiving side receives “*”, “9”, “1”, “#” as input operation information, thereby indicating the type of the mark 81b as one point (pinpoint). Change the display type of the mark 81b from the group of “type = 1” to the circle defined by “shape = 1” of the group of “type = 2” pointing to a certain range (area). In order to indicate the mode, a double line and a light display density are displayed.

  Next, of the nine divided areas in the effective display area 80b, the mobile phone 10 on the receiving side has the type, shape, and shape currently selected in the lower right divided area that is the absolute position corresponding to the nine buttons. A size mark 81b is displayed. Note that the display mode of the mark 81b is displayed with a broken line and a normal display density in order to indicate the next relative position designation mode.

  Next, in the mobile phone 10 on the receiving side, the mark 81b displayed in the effective display area 80b is relative to the upper left direction, which is the relative direction corresponding to one button, by the relative movement amount currently selected. Move. Note that the relative movement amount is the default “½”, as described above, and thus is ½ each of the vertical and horizontal sizes of the divided area.

  Next, in the mobile phone 10 on the receiving side, the mark 81b displayed in the effective display area 80b is confirmed in the current state, and the display mode of the mark 81b is indicated by a solid line to indicate that it has been confirmed. And the display density is displayed normally.

  When the mobile phone 10 according to the present embodiment is set to the fixed information transmission mode instead of the sequential transmission mode, the communication control unit 13 sets the landmark information setting input as described above and then the communication control unit 13 By controlling the communication unit 7 and sequentially transmitting the confirmed mark information to the mobile phone 10 on the receiving side, the mobile phone 10 on the receiving side is displayed at the same position as the mobile phone 10 on the transmitting side. A landmark can be displayed.

  Further, since it is only necessary to transmit a minimum amount of information to indicate the determined state, it is possible to reduce the amount of data communication as compared with the case where the sequential transmission mode is set.

  Further, the display control unit 12 controls the display unit 4 to process and display the processing in the mobile phone 10 on the receiving side for one input operation information in a time of about several hundred ms that can be confirmed by human eyes. Also good. Thereby, it becomes possible to confirm the operation steps until the landmark information is confirmed also on the mobile phone 10 on the receiving side, and the same effect as in the sequential transmission mode can be obtained. Of course, it may be important to make the processing time on the receiving side for one piece of input operation information as fast as possible and to point quickly.

  The receiving-side mobile phone 10 stores the received input operation information in the buffer of the RAM 3 on the receiving side until receiving the input operation information indicating confirmation, and at the time of receiving the input operation information indicating confirmation. The pointing processing based on the input operation information in the buffer of the RAM 3 may be sequentially processed without being displayed on the display screen, and the mark may be displayed on the display screen after the processing up to the confirmation is completed.

  Thereby, the mobile phone 10 on the receiving side can delete this display when it does not want to see an extra operation step until it is confirmed.

  Here, the processing when the display conditions of the mobile phones 10 that perform communication in the mobile phone 10 of the present embodiment are different will be described as follows.

  In other words, when the display screen resolution differs between the mobile phone 10 on the transmission side and the reception side, the following processing is performed.

  For example, as shown in FIG. 9, the effective display area 21a of the display unit 20a of the mobile phone 10 on the transmission side is 128 × 120 pixels wide and is divided into nine areas (3 × 3 horizontal). The effective display area 21b of the display unit 20b of the mobile phone 10 on the receiving side is 256 × 240 pixels wide, and, similarly to the mobile phone 10 on the transmitting side, 9 areas (3 × vertical) It is assumed that it is divided into 3).

  If the original image is 128 pixels long by 120 pixels wide, the mobile phone 10 on the transmission side has the same number of pixels as the effective display area 21a, so the image displayed on the screen is displayed as it is. To do.

  On the other hand, since the mobile phone 10 on the receiving side has a difference of twice the number of pixels in the effective display area 21b in both the vertical and horizontal directions, the image is displayed in a size twice as large in both the vertical and horizontal directions.

  For this reason, even when the display screens of the mobile phones 10 on the transmission side and the reception side have different resolutions, pointing can be performed only with the input operation information of the buttons indicating the same area.

  That is, when the three buttons of the dial button 22 of the mobile phone 10 on the transmission side are input, the marks 23a and 23b are pointed to the upper right area in both the mobile phone 10 on the transmission side and the reception side.

  Also, since the relative position is specified based on “1 / n” of the size of the divided area, similarly, pointing can be performed only with the input operation information of the direction button.

  As described above, in the mobile phone 10 of the present embodiment, the display control unit 12 controls the display unit 4 and receives the received input even when the display screen resolutions of the mobile phone 10 on the transmission side and the reception side are different. By displaying based on the operation information, it is possible to point to the same position on each other's display screen.

  In the present embodiment, the input unit 5 is premised on an input function as a telephone. However, for example, when the present invention is applied to a television equipped with a communication function, 1 to 0 (or 12 or the like). A remote controller having a plurality of input buttons such as a channel button on which the number is marked may be used as the input unit 5.

  In the present embodiment, it is assumed that the communication unit 7 has a wireless communication function as a mobile phone, but the present invention is not limited to this. For example, if the communication function of wired analog telephone line or digital telephone line, wired or wireless LAN, Bluetooth (registered trademark), UWB (Ultra Wide Band), etc., that can communicate voice and data, apply Is possible.

  In the present embodiment, the display unit 4 has nine divided areas (vertical 3 × horizontal 3). For example, the display unit 4 may have 12 divided areas (vertical 4 × horizontal 3) or four divided areas ( An appropriate number of divisions may be set in accordance with the size of the effective display area, the arrangement of buttons, and the number of buttons, such as 2 × 2).

  In the present embodiment, the mark size change and the relative movement amount change are described as three steps. However, the present invention is not limited to this, and any number of steps may be used as long as the number of steps is two or more. If there is no need to change the size or change the relative movement amount, the change may not be necessary.

  In this embodiment, as an expression method for indicating the absolute position designation mode, an example of displaying the line type as a double line and a light display density, an expression for indicating the relative position designation mode. An example of displaying the line type as a broken line and the display density as a normal method, and an example of displaying the line type as a solid line and a normal display density as an expression method for indicating that the mark has been confirmed However, the present invention is not limited to this. For example, even when a method of changing the display color of the mark to a specific color is adopted, the same effect as described above can be obtained.

  In the present embodiment, an example in which digital data is generated as input operation information has been described. However, the present invention is not limited to this, and may be generated as a PB signal (DTMF) or audio data.

  Further, the voice data may be generated by voice synthesis, or voice data corresponding to each button may be stored in advance in the ROM 2 and read out for use.

[Embodiment 2]
Other embodiments relating to the information communication terminal, terminal control method, terminal control program, and recording medium on which the information communication terminal of the present invention is recorded will be described below with reference to FIGS.

  For convenience of explanation, components having the same functions as those described in the first embodiment are denoted by the same reference numerals and description thereof is omitted. Further, the description based on the flowchart in the present embodiment is basically the same as the processing content described in the first embodiment, and therefore, the description of the conditions overlapping with those in the first embodiment is omitted.

  In the present embodiment, coordinate information on the effective display area, mark attribute information indicating a mark state (type, shape, size, line type, color, etc.), and the like are used as the mark information.

  That is, in the mobile phone 10 of the present embodiment, the mark information creating unit 11 shown in FIG. 1 creates coordinate information and mark attribute information related to mark information in response to an input from the user. It is different from 1.

  Further, the display control unit 12 controls the display unit 4 to display a mark shown in a user-designated display mode at a desired position on the display unit 4 based on the coordinate information and the mark attribute information.

  Furthermore, the communication control unit 13 transmits the coordinate information and the mark attribute information to the mobile phone 10 on the receiving side, so that the mobile phone 10 on the receiving side can receive the received coordinate information and the mark attribute information. Based on this, it is possible to perform a display similar to the display on the mobile phone 10 on the transmission side.

  In the present embodiment, the processing by the mobile phone 10 on the transmission side is performed according to the flowcharts shown in FIGS.

  That is, as shown in FIG. 15, in S80, a setting for starting pointing control is performed.

  Specifically, the setting contents are the same as those in the flowchart shown in FIG. 4 described in the first embodiment.

  Also in this embodiment, as in the mobile phone 10 shown in FIG. 2 described in the first embodiment, the effective display area 4a is configured as nine divided areas (vertical 3 × horizontal 3), and the divided areas are designated. The dial button 5a corresponds to nine buttons (vertical 3 × horizontal 3) 1 to 9, and the transmission mode of the mark information is digital data (characters, etc.).

  Regarding the information necessary for the pointing operation, four pieces of information shown in FIGS. 17 (a) to 17 (d) are information that needs to be recognized by the mobile phone 10 on the reception side. To the mobile phone 10.

  As shown in FIG. 17A, the effective display area 4a of the mobile phone 10 on the transmission side is defined by the number of pixels (resolution) in the vertical and horizontal directions of the effective display area 4a.

  The command of the coordinate information on the effective display area 4a is identified by “command code = 01” and defined by the X coordinate and the Y coordinate as shown in FIG.

  The command of the mark attribute information is identified by “command code = 02” as shown in FIG. 17C, and is defined by a code for identifying the type and shape, and the pixel size of the mark information.

  As shown in FIG. 17D, other commands are defined by “redo” identified by “command code = 03” and “confirmed” identified by “command code = 04”.

  Further, the function of the use button is defined by a button used for pointing operation and a function assigned to each button, as shown in FIG.

  As shown in FIG. 17F, the mark information is defined by a code for identifying the type and shape of the mark pointed by the pointing operation, a mark applied to the code, and a size change step.

  As shown in FIG. 17G, the relative movement amount is defined by a change step of the relative movement amount in the relative position designation mode.

  Subsequently, in S81 to S84, processing similar to S2 to S5 of the first embodiment is performed.

  In s84, if the determination is YES, the process proceeds to S85, and if the determination is NO, the process proceeds to S89.

  In S85, coordinate information in the effective display area 4a of the transmitting-side mobile phone 10 is generated based on the input operation information.

  Specifically, coordinates indicating the absolute position of the effective display area 4a corresponding to the dial button 5a are calculated, and the calculated coordinates are used as coordinate information on the effective display area 4a.

  In the present embodiment, as in the first embodiment, the absolute position of the effective display area 4a corresponding to each dial button is designated by the input to the nine dial buttons 1 to 9 of the dial button 5a. Therefore, in this embodiment, the coordinate which shows the center position of the designated division | segmentation area is made into coordinate information.

  Subsequently, in S86, a mark is displayed in the effective display area 4a of the mobile phone 10 on the transmission side based on the coordinate information in the effective display area 4a generated in S85.

  Specifically, the mark is displayed based on the mark information indicating the display mode of the currently selected type, shape, and size with the position indicated by the coordinate information on the effective display area 4a as the center.

  In addition, in order to indicate that the absolute position display for displaying the mark is completed and the relative position specifying mode is set next, the display mode of the mark is displayed in a state where the line type is a broken line and the display density is normal. The

  In S87, every time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted as mark information to the mobile phone 10 on the receiving side is set.

  If the determination is YES, the process proceeds to S88. If the determination is NO, the process proceeds to S100 of the flowchart shown in FIG. 16 in order to shift to the relative position designation mode.

  In S88, since the sequential transmission mode is set, the coordinate information on the effective display area 4a is used as the mark information which is the area designation information, and the coordinate information command on the effective display area defined in FIG. The data is transmitted in the form by the communication unit 7 to the mobile phone 10 on the receiving side.

  Subsequently, in order to shift to the relative position designation mode, the process proceeds to S100 of the flowchart shown in FIG.

  In S89, it is determined whether or not the input operation information generated in S83 is a button input indicating a change in the mark type.

  If the determination is YES, the process proceeds to S90, and if the determination is NO, the process proceeds to S93.

  In S90, since the change of the mark type is input, the type of the mark displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  In S91, each time the input operation information is recognized, it is determined whether or not the “sequential transmission mode” in which the input operation information is transmitted as mark information to the mobile phone 10 on the receiving side is set.

  If the determination is YES, the process proceeds to S92. If the determination is NO, the process returns to S82.

  In S92, since the sequential transmission mode is set, information indicating the type, shape, and size of the mark is used as the mark information that is the mark mode information in the mark attribute information command format defined in FIG. Then, the communication unit 7 transmits the data to the mobile phone 10 on the receiving side. Subsequently, the process returns to S82.

  In S93, it is determined whether or not the input operation information generated in S83 is a button input indicating a change in the shape of the mark.

  If the determination is YES, the process proceeds to S94, and if the determination is NO, the process proceeds to S95.

  In S94, since the mark shape change has been input, the mark shape displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  Then, it progresses to S91. The processing after S91 is as described above.

  In S95, it is determined whether or not the input operation information generated in S83 is a button input indicating confirmation of landmark information.

  Here, if the determination is YES, the process proceeds to S118 of the flowchart shown in FIG. 16, and if the determination is NO, the process returns to S82.

  The processing in S100 to S103 is the same as S20 to S23 in the flowchart shown in FIG.

  In S104, coordinate information on the effective display area 4a of the mobile phone 10 on the transmission side is generated based on the input operation information.

  Specifically, a coordinate indicating a position where the mark displayed in the effective display area 4a of the mobile phone 10 on the transmission side is relatively moved in the designated direction based on the relative movement amount is calculated and calculated. These coordinates are used as coordinate information on the effective display area 4a.

  In S105, the mark displayed in the effective display area 4a of the mobile phone 10 on the transmission side is relatively moved based on the coordinate information on the effective display area 4a generated in S104.

  In S106, it is determined whether or not the “sequential transmission mode” is set.

  If the determination is YES, the process proceeds to S107, and if the determination is NO, the process returns to S101.

  In S107, since the sequential transmission mode is set, the coordinate information on the effective display area 4a is used as the mark information that is the mark movement information, and the coordinate information command on the effective display area defined in FIG. The data is transmitted in the form by the communication unit 7 to the mobile phone 10 on the receiving side. Subsequently, the process returns to S101.

  In S108, it is determined whether or not the input operation information generated in S102 is a button input indicating the size change of the mark.

  If the determination is YES, the process proceeds to S109, and if the determination is NO, the process proceeds to S112.

  In S109, since the mark size change has been input, the size of the mark displayed in the effective display area 4a of the transmitting-side mobile phone 10 is changed based on the input operation information.

  In S110, it is determined whether or not the “sequential transmission mode” is set.

  If the determination is YES, the process proceeds to S111. If the determination is NO, the process returns to S101.

  In S111, since the sequential transmission mode is set, information indicating the type, shape, and size of the mark is used as the mark information that is the mark mode information in the mark attribute information command format defined in FIG. Then, the communication unit 7 transmits the data to the mobile phone 10 on the receiving side. Subsequently, the process returns to S101.

  In S112, it is determined whether or not the input operation information generated in S102 is a button input indicating a change in the relative movement amount.

  If the determination is YES, the process proceeds to S113, and if the determination is NO, the process proceeds to S114.

  In S113, since the change of the relative movement amount is input, the relative movement amount is changed based on the input operation information. Subsequently, the process returns to S101.

  In S <b> 114, it is determined whether or not the input operation information generated in S <b> 102 is a button input instructing to “redo” the mark pointing from the beginning.

  If the determination is YES, the process proceeds to S115, and if the determination is NO, the process proceeds to S117.

  In S115, since a redo instruction has been input, it is determined whether or not the “sequential transmission mode” is set.

  If the determination is YES, the process proceeds to S116, and if the determination is NO, the process returns to S81.

  In S116, since the sequential transmission mode is set, the redo command defined in FIG. 17D is transmitted from the communication unit 7 to the mobile phone 10 on the receiving side as landmark information. Subsequently, the process returns to S81 in FIG.

  In S117, it is determined whether or not the input operation information generated in S102 is a button input indicating confirmation of landmark information.

  If the determination is YES, the process proceeds to S118. If the determination is NO, the process returns to S101.

  In S118, since the confirmation of the landmark information is input, the landmark information displayed in the effective display area 4a of the transmitting-side mobile phone 10 is confirmed in the current state based on the input operation information.

  Further, in order to indicate that the mark information has been confirmed, the display mode of the mark is displayed by changing the line type to a solid line, for example.

  Further, the divided grid lines displayed in the effective display area 4a are also deleted.

  In S119, it is determined whether or not the “sequential transmission mode” is set.

  If the determination is YES, the process proceeds to S122, and if the determination is NO, the process proceeds to S120.

  In S120, since the sequential transmission mode is not set, the coordinate information on the valid display area 4a determined as the mark information is in the format of the coordinate information command on the valid display area defined in FIG. The data is transmitted from the communication unit 7 to the mobile phone 10 on the receiving side. Then, it progresses to S121.

  In S121, as the mark information, information indicating the type, shape, and size of the determined mark is set in the mark attribute information command format defined in FIG. Send to.

  In S122, a confirmation command defined in FIG. 17D is transmitted as mark information from the communication unit 7 to the mobile phone 10 on the receiving side.

  This completes the pointing process on the transmission side.

  In the mobile phone 10 of the present embodiment, as described above, the display control unit 12 controls the display unit 4 and presses the dial button 5a of the mobile phone 10 for the image displayed on the display screen. Thus, the mark can be easily displayed at a desired position based on the mark attribute information and the coordinate information input as described above.

  In addition, with respect to the mark pointed to the display screen, the mark information movement control unit 14 changes the mark attribute information and the coordinate information by pressing the dial button 5a, thereby easily changing the display mode and the display position of the mark. can do.

  On the other hand, processing in the mobile phone 10 on the receiving side is performed according to the flowchart shown in FIG.

  First, in S130, a setting for starting pointing control is performed.

  Specifically, calculation of a multiplier for absorbing the difference between the resolution of the effective display area 4a of the mobile phone 10 on the transmission side and the resolution of the effective display area 4a of the terminal itself, command definition of the received landmark information, Settings necessary for pointing operation, such as the transmission form of each command received as mark information, are made.

  The multiplier for absorbing the difference in resolution is calculated from the following relational expression (1) for each of the vertical direction and the horizontal direction, and used when multiplying the received coordinates and landmark information.

Number of pixels on the transmitting side / number of pixels on the receiving side = multiplier (1)
Note that the transmission mode of the mark information is digital data (characters, etc.), similar to the mobile phone 10 on the transmission side.

  Information necessary for the pointing operation is the same as the information shown in FIGS. 17 (a) to 17 (g).

  Subsequently, in S131, a default mark is displayed.

  Note that the mark based on the default mark information may have a display form indicated by an arrow as shown in FIG.

  In S132, the communication unit 7 waits for reception of the mark information. When the mark information is received, the process proceeds to S133.

  In S133, it is determined whether or not the landmark information received in S132 is a coordinate information command on the effective display area.

  If the determination is YES, the process proceeds to S138, and if the determination is NO, the process proceeds to S134.

  In S138, since the received mark information is a coordinate information command in the effective display area, the mark is displayed in the effective display area 4a of the mobile phone 10 on the receiving side based on the received coordinate information command.

  Specifically, Px which is the X coordinate and Py which is the Y coordinate of the mobile phone 10 on the transmission side indicated by the received coordinate information command on the effective display area is expressed by the expression (1) in S130. Multiply the calculated multipliers to calculate the coordinates on the effective display area 4a of the mobile phone 10 on the receiving side, and display the mark of the type / shape / size currently selected with the calculated position as the center. .

  When the type of the mark is “arrow” or “cross” indicating one point (pinpoint), the mark is displayed so as to indicate the coordinates on the designated effective display area 4a. In the case of “◯” or “□” indicating a range (area), the coordinate on the specified effective display area 4a is set as the center position, and the smaller one of the vertical and horizontal sizes of the divided area is set as the outline size. Display placemarks.

  In order to indicate that coordinates are being specified, the display mode of the mark is displayed, for example, with the line type being a broken line and the display density being normal. Note that other methods may be used as an expression method for indicating that coordinates are being specified. For example, a display color of a mark may be a specific color to indicate that coordinates are being specified. .

  In S134, it is determined whether or not the landmark information received in S132 is a landmark attribute information command.

  If the determination is YES, the process proceeds to S139, and if the determination is NO, the process proceeds to S135.

  In S139, since the received landmark information is a landmark attribute information command, the type, shape, and size of the landmark displayed in the effective display area 4a are changed based on the landmark attribute information.

  For example, regarding the size, each of Mx which is the X-direction size on the transmission side and My which is the Y-direction size indicated by the received landmark attribute information command is multiplied by the multiplier calculated by Expression (1) in S130. After calculating the size of the mobile phone 10 on the receiving side and displaying the mark with the calculated size, the process returns to S132.

  In S135, it is determined whether or not the landmark information received in S132 is a redo command.

  Here, if the determination is YES, the process returns to S131, and if the determination is NO, the process proceeds to S136.

  In S136, since it is not a redo command, it is determined whether or not the landmark information received in S132 is a confirmation command.

  If the determination is YES, the process proceeds to S137, and if the determination is NO, the process returns to S132.

  In S137, since the confirmation command is received, the mark information displayed in the effective display area 4a of the receiving-side mobile phone 10 is confirmed in the current state based on the confirmation command.

  Further, in order to indicate that the mark information has been confirmed, the display mode of the mark is displayed by changing the line type to a solid line, for example. It should be noted that the expression method for indicating that the mark has been confirmed may be other methods. For example, the mark may be displayed in a specific color in order to indicate that the mark has been confirmed.

  This completes the pointing process in the mobile phone 10 on the receiving side.

  In the mobile phone 10 of the present embodiment, as described above, also in the mobile phone 10 on the receiving side, the display control unit 12 controls the display unit 4, and based on the received landmark attribute information and coordinate information, The same display as that displayed on the transmitting-side mobile phone 10 can be performed.

  As a result, in the plurality of mobile phones 10 that perform transmission / reception, the image can be displayed on the display screen with a mark added to a common image. Therefore, the user can select the object indicated by the mark. Can be exchanged through telephone calls or text information.

  Next, a display example when the mobile phone 10 of this embodiment is set to the sequential transmission mode will be described.

  At the start of communication, as shown in FIG. 18 (a), the transmitting-side mobile phone 10 and the receiving-side mobile phone 10 have “camera images” based on the shared image information. It is displayed.

  Here, the mobile phone 10 on the transmission side displays a divided grid line 122a for indicating a divided area of the effective display area 120a and a default mark 121a.

  The default mark 121a is an arrow defined by the identification code “type = 1, shape = 1”, and the display mode of the mark 121a is a double line to indicate the absolute position designation mode. And the display density is displayed lightly. In addition, in the effective display area 120b of the mobile phone 10 on the receiving side, a default mark 121b is displayed in the same display mode as the mobile phone 10 on the transmitting side in order to indicate the state before the coordinate designation.

  Next, when the shape of the mark is changed in the absolute position designation mode, the mark is changed to a cross mark as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. The shape of the mark 121a is changed from an arrow defined by “shape = 1” to a cross defined by “shape = 2”. Further, the mobile phone 10 on the transmission side transmits a mark attribute information command as the mark information.

  Based on the received mark attribute information command, the mobile phone 10 on the receiving side changes the shape of the mark 121b displayed in the effective display area 120b on the receiving side from the arrow defined as “shape = 1” to “shape”. = 2 ”.

  Note that the display mode of the mark 121b is a double line and the display density is lightly displayed to indicate that the coordinate is not specified.

  Next, when the absolute position is designated in the absolute position designation mode, a mark is displayed in the user designated area as shown in FIG.

  That is, when one button of the dial button 5a is input in the mobile phone 10 on the transmission side, nine divided areas in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. Among them, a mark 121a of the type, shape, and size currently selected is displayed in the upper left divided area that is an absolute position corresponding to one button. Further, the mobile phone 10 on the transmission side transmits a coordinate information command on the effective display area as the mark information.

  Based on the received coordinate information command on the effective display area, the mobile phone 10 on the receiving side has a mark 121b of the type / shape / size currently selected in the effective display area 120b of the mobile phone 10 on the receiving side. Is displayed. The display mode of the mark 121b is displayed with a broken line and a normal display density in order to indicate that coordinates are being specified.

  Next, when it is instructed to “redo” the pointing of the mark from the beginning, the mark returns to the arrow as shown in FIG.

  That is, when 5 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, the mobile phone 10 on the transmission side returns to the start state of the absolute position designation mode in FIG. Further, the transmission side transmits a redo command as the mark information.

  The mobile phone 10 on the receiving side returns to the pre-coordinate designation state based on the received redo command.

  Next, when an absolute position is designated again in the absolute position designation mode, a mark is displayed in the user designated area as shown in FIG.

  That is, when one button of the dial button 5a is input in the mobile phone 10 on the transmission side, as shown in FIG. 19A, nine divided areas in the effective display area 120a of the mobile phone 10 on the transmission side. Among them, a mark 121a of the type, shape, and size currently selected is displayed in the upper left divided area that is an absolute position corresponding to one button. Further, the mobile phone 10 on the transmission side transmits a coordinate information command on the effective display area as the mark information.

  Based on the received coordinate information command on the effective display area, the mobile phone 10 on the receiving side has the type, shape, and size currently selected on the effective display area 120b of the mobile phone 10 on the receiving side. A mark 121b is displayed.

  Next, when the size of the mark is changed in the relative position designation mode, the size of the mark is changed as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. The size of the mark 121a is changed from the default “medium” to “small”. Further, the mobile phone 10 on the transmission side transmits a mark attribute information command as the mark information.

  The mobile phone 10 on the receiving side changes the size of the mark 121b displayed in the effective display area 120b on the receiving side based on the received mark attribute information command.

  Next, if the relative position is designated after the relative position designation mode, the mark display position is finely adjusted as shown in FIG.

  That is, when 8 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, they are displayed in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. The mark 121a is relatively moved in the downward direction, which is a relative direction corresponding to the 8 buttons, by the amount of relative movement currently selected. Since the relative movement amount is “1/2” by default, it is ½ of the vertical size of the divided area. Further, the mobile phone 10 on the transmission side transmits a coordinate information command on the effective display area as the mark information.

  Based on the received coordinate information command on the effective display area, the mobile phone 10 on the receiving side uses the mark of the type, shape, and size currently selected in the effective display area 120b of the mobile phone 10 on the receiving side. 121b is displayed.

  Next, when the landmark information is confirmed, the grid lines are erased and the landmark information is confirmed as shown in FIG.

  That is, when the # button of the dial button 5a is inputted in the mobile phone 10 on the transmission side, it is displayed in the effective display area 120a of the mobile phone 10 on the transmission side as shown in FIG. The mark 121a is confirmed in the current state. Here, in order to indicate that the display mode of the mark 121a is confirmed, the display density is normally displayed as a solid line. Further, the mobile phone 10 on the transmission side transmits a confirmation command as the mark information.

  The mobile phone 10 on the reception side determines the mark 121b displayed in the effective display area 120b on the reception side in the current state based on the received confirmation command.

  As described above, even when the sequential transmission mode is set in the present embodiment, the display control unit 12 controls the display unit 4 based on the mark attribute information and the coordinate information as the mark information. 1 can be obtained.

  On the other hand, a display example when the mobile phone 10 according to the present embodiment is set to the fixed information transmission mode instead of the sequential transmission mode will be described.

  When two mobile phones 10 share the “camera image” and display them on each other's screen, and when a mark is superimposed on each other's screen by a pointing operation from one mobile phone 10 21 (a) to 21 (d) and FIGS. 22 (a) to 22 (c) are displayed.

  That is, when the absolute position designation mode is started, as shown in FIG. 21A, the effective display area 130a of the transmitting-side mobile phone 10 and the effective display area 130b of the receiving-side mobile phone 10 are not displayed. The shared “camera image” is displayed.

  Here, in the effective display area 130a of the mobile phone 10 on the transmission side, a divided grid line 132a and a default mark 131a for displaying a divided area of the effective display area 130a are displayed.

  Further, in the effective display area 130b of the mobile phone 10 on the receiving side, a default mark 131b is displayed in the same display manner as the mobile phone 10 on the transmitting side.

  Next, when the type of the mark is changed, the mark display mode is changed from an arrow to a circle as shown in FIG.

  That is, when the * button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The type of the mark 131a is changed from a “type = 1” group indicating one point (pinpoint) to a circle defined by “shape = 1” of a “type = 2” group indicating a certain range (area). Is done.

  Next, when the shape of the mark is changed in the absolute position designation mode, the mark is changed from ○ to □ as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The shape of the mark 131a is changed from ◯ defined by “shape = 1” to □ defined by “shape = 2”. Note that the display mode of the mark 131a is a double line and the display density is light to indicate that it is the absolute position designation mode.

  Next, when the absolute position for displaying the mark is designated, the mark is displayed in the user designated area as shown in FIG.

  That is, when one button of the dial button 5a is input in the mobile phone 10 on the transmission side, as shown in FIG. 21 (d), nine divided areas in the effective display area 130a of the mobile phone 10 on the transmission side. Among them, a mark 131a of the type / shape / size currently selected is displayed in the upper left divided area, which is the absolute position corresponding to one button.

  Next, when the relative position of the mark is designated, the display position of the mark is finely adjusted as shown in FIG.

  That is, when 8 buttons of the dial button 5a are input in the mobile phone 10 on the transmission side, they are displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The mark 131a relatively moves in the downward direction, which is a relative direction corresponding to the 8 buttons, by the amount of relative movement currently selected.

  Next, when the size of the mark is changed in the relative position designation mode, the size of the mark is changed as shown in FIG.

  That is, when the 0 button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The size of the mark 131a is changed from the default “medium” to “small”.

  Next, when the landmark information is confirmed, the grid lines are deleted and the landmark information is confirmed as shown in FIG.

  That is, when the # button of the dial button 5a is input in the mobile phone 10 on the transmission side, it is displayed in the effective display area 130a of the mobile phone 10 on the transmission side as shown in FIG. The mark 131a is confirmed in the current state. Here, in order to indicate that the display mode of the mark 131a has been determined, the display density is normally displayed with a solid line.

  Here, since the mark information has been confirmed, the mobile phone 10 on the transmission side sequentially transmits the coordinate information command, mark attribute information command, and confirm command on the effective display area as the mark information.

  The mobile phone 10 on the receiving side performs pointing processing based on the received landmark information.

  Specifically, the mobile phone 10 on the receiving side places a mark 121b of type, shape, and size based on the mark attribute information command at a position on the effective display area 120b based on the coordinate information command on the effective display area. Based on the confirmation command, a solid line is displayed in a display mode in which the display density is normal.

  As described above, even when the fixed information transmission mode is set in the present embodiment, the display control unit 12 controls the display unit 4 based on the mark attribute information and the coordinate information as the mark information, thereby implementing the above-described implementation. The same effect as in the first mode can be obtained.

  Furthermore, as shown in FIG. 23, processing when the resolution is different between the mobile phone 10 on the transmission side and the mobile phone 10 on the reception side will be described.

  In this case, if necessary, the number of pixels (120 × 128) in the vertical and horizontal directions, which is information indicating the resolution of the effective display area on the transmission side, is transmitted to the mobile phone 10 on the reception side. .

  On the other hand, the mobile phone 10 on the receiving side calculates a multiplier for absorbing the difference in resolution based on the relational expression (1) of S130 shown in the flowchart of FIG. The resolution difference may be absorbed by multiplying the coordinates on the area or the size of the mark by the calculated multiplier.

  Therefore, even when the display-side mobile phone 10 and the receiving-side mobile phone 10 have different display screen resolutions, the coordinates in the effective display area of the transmitting-side mobile phone 10 and the size of the mark are used. Thus, the same position of the image of the mobile phone 10 on the receiving side can be pointed.

  That is, when three buttons of the dial button 22 of the mobile phone 10 on the transmission side are input, the marks 23a and 23b are pointed to the upper right area on both the mobile phone 10 on the transmission side and the reception side.

  The relative position is also specified by multiplying a multiplier for absorbing the difference in resolution by the mobile phone 10 on the reception side with reference to the coordinates in the effective display area of the mobile phone 10 on the transmission side, Therefore, pointing can be performed with the coordinate information after the relative position is designated in the effective display area of the mobile phone 10 on the transmission side.

  As described above, in the mobile phone 10 of this embodiment, even when the display screen resolution differs between the transmission side and the reception side, coordinate information in the effective display area at the resolution of the mobile phone 10 on the transmission side is received. Thus, also in the mobile phone 10 on the receiving side, the display control unit 12 can control the display unit 4 to point to the same position on the screen.

  In the above example, the mobile phone 10 is used as the information communication terminal, but the present invention is not limited to this. That is, the technique of pointing to the same position on the screen when the display screen has different resolutions on the transmission side and the reception side is also effective when the information communication terminal is not the mobile phone 10. For example, the information communication terminal may be a television receiver (hereinafter simply referred to as a television) equipped with a communication function.

  Televisions are classified according to the shape of the display screen into standard televisions with a ratio of 4: 3 in the horizontal and vertical directions of the screen and wide televisions with a ratio of 16: 9. In other words, there may be a case where the aspect ratio of the display screen is different between the transmission-side television and the reception-side television.

  On the other hand, by applying the technique shown in the second embodiment, the display screen on the standard television and the display screen on the wide television can be pointed at the same position on the screen. In addition, even when a TV equipped with a communication function and the mobile phone 10 communicate with each other, a large display screen of the TV and a small display screen of the mobile phone 10 can be obtained by applying the technique described in the second embodiment. Can point to the same position on the screen.

  In addition, since the mobile phone 10 on the receiving side multiplies a multiplier for absorbing the difference in resolution to absorb the difference in resolution, for example, information displayed on the main screen of a television equipped with a communication function Even when the icon is displayed again on the child screen, the mark can be displayed on the child screen at the same position as the mark displayed on the parent screen.

[Embodiment 3]
Embodiments relating to an information communication terminal, a terminal control method, a terminal control program, and a recording medium recording the same according to the present invention will be described below.

  For convenience of explanation, components having the same functions as those described in the first and second embodiments are denoted by the same reference numerals and description thereof is omitted. Furthermore, the description based on the flowchart in the present embodiment is basically the same as the processing content described in the first embodiment, and therefore, the description of the conditions overlapping those in the first and second embodiments is omitted.

  In the present embodiment, a multi-function television 10T equipped with a communication function is assumed as an information communication terminal. FIG. 24 is a block diagram showing a schematic configuration of the multi-function TV 10T according to the present embodiment. As shown in the figure, the multi-function television 10T includes a control unit 1, a ROM 2, a RAM 3, a display unit 4, an input unit 5, an audio processing unit 6, a communication unit 7, a television broadcast receiving unit 201, and a camera 202. Yes. The control unit 1, the ROM 2, the RAM 3, the display unit 4, the input unit 5, the voice processing unit 6, and the communication unit 7 are the same as those described in the first embodiment, and thus description thereof is omitted here. .

  The TV broadcast receiving unit 201 is a tuner that receives an RF signal as a TV broadcast signal received by a TV antenna (not shown). Examples of television broadcasting include terrestrial analog broadcasting, terrestrial digital broadcasting, analog satellite broadcasting, and digital satellite broadcasting. Moreover, the form which receives a broadcast signal from a cable television may be sufficient.

  The camera 202 is photographing means for photographing the user side of the multi-function TV 10T when the multi-function TV 10T is used as a videophone. The camera 202 is realized by a CCD camera, for example.

  In the first embodiment, the communication unit 7 performs communication via the antenna 7a. However, in the present embodiment, the communication unit 7 may perform communication by wired connection. Examples of the wired connection include an ISDN (integrated services digital network) communication network, an ADSL (asymmetric digital subscriber line) communication network, and an optical fiber communication network. In the present embodiment, the input unit 5 is implemented as a remote controller that performs instruction input wirelessly such as infrared rays.

  In addition, the control unit 1 includes a landmark information creation unit 11, a display control unit 12, a communication control unit 13, a landmark information movement control unit 14, a channel setting unit (channel setting unit) 203, and a network content receiving unit (network content receiving unit). 204, an image information holding unit 205, and an image information storage unit 206 are formed as functional blocks. Since the mark information creating unit 11, the display control unit 12, the communication control unit 13, and the mark information movement control unit 14 are the same as those described in the first embodiment, the description thereof is omitted here.

  The channel setting unit 203 sets a TV broadcast channel to be received by the TV broadcast receiving unit 201. The network content receiving unit 204 performs processing for acquiring content on the network from the network via the communication unit 7. Examples of the content on the network include, but are not limited to, web page data including image data, moving image data, audio data, and the like.

  The image information holding unit 205 stores information on content to be shared, for example, information about a network address such as moving image data, from the communication target multifunction TV 10T, for example. The image information storage unit 206 stores and stores content to be shared, for example, moving image data itself. The image information holding unit 205 may be configured by a temporary storage unit such as a RAM, and the image information storage unit 206 may be configured by a non-volatile storage unit such as a hard disk drive. It is not limited to these.

  FIG. 25A shows the appearance of the multi-function TV 10T. As shown in the figure, the multi-function TV 10T basically has the same appearance as a normal TV, and a display unit 4 as a TV screen display means is provided on the front surface. The transmitter 6b used when using the videophone function is provided as an upper part of the multi-function TV 10T as a microphone.

  The receiver 6a used when using the videophone function is provided as a speaker on the front surface of the multi-function TV 10T. The speaker as the receiver 6a is configured to output various sounds output from the multi-function TV 10T, for example, TV sound when receiving a TV broadcast.

  The camera 202 used when using the videophone function is provided on the top of the multi-function TV 10T. Note that the configuration illustrated in FIG. 25A is merely an example, and the arrangement positions of the transmission unit 6b, the reception unit 6a, the camera 202, and the like are not limited thereto.

  FIG. 25B shows the appearance of the input unit 5 as a remote controller of the multifunction TV 10T. As shown in the figure, the input unit 5 includes a display content switching button 211, a content sharing button 212, a mark moving button 213, an utterance button 214, an end button 215, a cancel button 216, a numeric input button 217, and a video reproduction control. A button 218 and a mark determination button 219 are provided.

  The display content switching button 211 is a button for switching input of a signal to be displayed on the display unit 4. For example, every time the display content switching button 211 is pressed, a signal to be displayed on the display unit 4 is switched to a television broadcast signal, a videophone signal, a video signal, or the like.

  The content sharing button 212 is used when instructing to start sharing or end sharing of some information (content) with the terminal device of the call destination when using the videophone function. Button. Examples of the content include television programs, Web pages, moving image data on the network, moving image data stored in the information communication terminal on the transmission side or the reception side, and the like.

  The utterance button 214 is a button for inputting an instruction to start a call when the videophone function is used. The call end button 215 is a button for inputting an instruction to end a call when the videophone function is used. The cancel button 216 is a button for issuing a cancel instruction for some operation.

  The numeric input button 217 is a button used when some numeric input is performed. For example, the numeric input button 217 is used as a channel selection button when watching TV, while the numeric input button 217 is used as a telephone number input button when the videophone function is used. It is done.

  The moving image reproduction control button 218 is a button for performing reproduction control such as reproduction / pause, stop, rewind, and fast forward of moving image data when reproducing moving image data. Examples of the moving image data controlled by the moving image reproduction control button 218 include moving image data stored in the image information storage unit 206.

  The mark moving button 213 is a button used when moving the mark displayed on the display unit 4, and is represented as a donut-shaped button in FIG. The mark moving button 213 can be tilted with respect to all directions such as up, down, left and right, and the mark moves in the direction in which the mark moving button 213 is tilted. A mark determination button 219 is used to determine the position of the mark.

  As with the dial button 5a in the above-described embodiment, the mark can be moved using the buttons 1 to 9 in the number input button 217, but the mark is also moved by the mark moving button 213. It is possible. Although the details of moving the mark with the mark moving button 213 will be described later, when moving images are displayed, the mark is gradually moved as the object to be pointed is moved. This is suitable for a simple pointing operation.

  In the present embodiment, as described above, an example in which the multi-function TV 10T is used as an information communication terminal is described. However, the information communication terminal is not limited to this, and for example, a mobile phone having an equivalent function. It may be a type communication terminal (including a mobile phone).

(Pointing operation example)
In the first and second embodiments described above, pointing on a relatively small display screen of the mobile phone 10 is assumed. On the other hand, when the multi-function television 10T having a relatively large display screen is used as in the present embodiment, it is necessary to devise a pointing process. That is, when specifying a mark using the absolute position mode, the area of the divided area is large if only one divided area is specified among the nine divided areas as shown in FIG. Cannot be accurately pointed to. In addition, even when the mark is moved using the relative position mode in order to point the object more accurately, the dial screen 5a must be operated many times to move the mark because the display screen is large. .

  In order to solve such a problem, in the present embodiment, as shown below, absolute position designation is performed in two stages. FIG. 26A to FIG. 26C are display screen diagrams for explaining the pointing processing in the present embodiment.

  First, at the start of communication, as shown in FIG. 26 (a), image information shared with the information communication terminal on the reception side is displayed in the effective display area 4Ta of the multifunction TV 10T on the transmission side. . In the effective display area 4Ta, divided grid lines for dividing the effective display area 4Ta into nine divided areas (length 3 × width 3) are displayed.

  When the absolute position is designated in the absolute position mode, a mark 221a is displayed in the divided area of the display screen corresponding to the input number input button 217 as shown in FIG. That is, in the multi-function TV 10T, when the “1” button of the numeric input button 217 is input, as shown in FIG. 26B, among the nine divided areas shown in the effective display area 4Ta, “ A mark 221a is displayed in the upper left divided area, which is the absolute position corresponding to the 1 "button. The shape of the mark 221a may be, for example, a circle inscribed in the selected divided area, but the shape is not particularly limited.

  Thereafter, the divided area whose absolute position is designated for the first time is further divided into a plurality of small divided areas. That is, in the divided area designated for the absolute position for the first time, a divided grid line for dividing the divided area into nine small divided areas (vertical 3 × horizontal 3) is displayed.

  In the state of FIG. 26B, when the “9” button of the numeric input button 217 is further input on the multi-function TV 10T, as shown in FIG. The mark 221b is displayed in the lower right subdivision area that is the absolute position corresponding to the button “9” among the nine subdivision areas. The shape of the mark 221b may be, for example, a circular shape that is inscribed in the selected subdivision area, but the shape is not particularly limited.

  As a result, when the input operation is performed twice on the dial button 5a, it is possible to specify one of the subdivided areas obtained by dividing the display screen into 81 pieces.

  Note that, from the state shown in FIG. 26C, the subdivision area may be further divided into nine so that one of them can be designated and selected at an absolute position. That is, by repeating the absolute position specification a plurality of times, it is possible to accurately perform pointing processing even for a relatively small position on the display screen. The mark information set as described above is transmitted to the multi-function TV 10T on the receiving side in the above-described sequential transmission mode or fixed information transmission mode.

  The process for selecting one of the divided area and the small divided area is not limited to the method using the buttons 1 to 9 in the number input buttons 217, and various methods are conceivable. . For example, a selection switching button is provided in the input unit 5, and each time the selection switching button is pressed, the mark 221a or the mark 221b sequentially moves in a divided area (small divided area), and a desired divided area (small divided area) is selected. The position may be determined by pressing the mark determination button 219 after moving to the (division area). In addition, a four-way movement button is provided in the input unit 5, and the mark 221a or the mark 221b is moved to a desired divided area (small divided area) by using the four-way movement button, and the mark determination button 219 is pressed. Thus, the position may be determined.

  Further, the position may be determined by moving the mark 221a or the mark 221b to a desired divided area (small divided area) using the mark moving button 213 and pressing the mark determining button 219. Further, by using the cancel button 216, it may be possible to cancel the divided area (small divided area) once determined and re-designate it. In other words, you can redesignate one of the subdivision areas within the subdivision area, cancel the subdivision area specification, set the target to be the subdivision area that is the parent, cancel the subdivision area and subdivision area specification, etc. May be possible.

(Sharing TV programs)
Next, in this embodiment, an information communication terminal on both the transmission side and the reception side is the multi-function television 10T, and an image shared between the transmission side and the reception side is an example of an image of a television broadcast. In this embodiment, it is assumed that the transmitting side and the receiving side display the same TV program and have a conversation through a videophone while performing a pointing operation. According to such a usage mode, for example, as shown in FIG. 27, among members of a singer group appearing in a certain TV program, a certain member is marked with a mark 221 and pointed to the other party. You can enjoy conversations like “I like you”.

  At this time, a problem arises when the channel selected on the multi-function TV 10T on the transmission side is different from the channel selected on the multi-function TV 10T on the reception side. In this case, even if the mark information is transmitted / received, the information indicated by the mark is different between the transmission side and the reception side, and therefore the transmission / reception of the mark information is meaningless.

  In order to prevent such a situation, the multi-function TV 10T on the transmission side transmits the currently selected channel information to the multi-function TV 10T on the reception side prior to the transmission of the landmark information. The multi-function TV 10T on the receiving side receives the channel information from the multi-function TV 10T on the transmission side prior to receiving the landmark information, and sets the channel according to the received channel information.

  Here, the flow of processing in the multifunction TV 10T on the transmission side and the multifunction TV 10T on the reception side will be described below with reference to FIGS. 28 (a) and 28 (b). FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, processing in the multi-function TV 10T on the transmission side will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function.

  In step S2001, when the user presses the content sharing button 212 in the input unit 5, a content sharing start instruction is transmitted to the multi-function TV 10T on the receiving side. More specifically, when the content sharing button 212 is pressed, a content sharing instruction signal is transmitted to the communication control unit 13 in the control unit 1, and the content sharing instruction signal is received from the communication unit 7 based on the control of the communication control unit 13. To the multi-function TV 10T. As a result, the multi-function TV 10T on the receiving side shifts to a content sharing standby state.

  Next, in S2002, the channel setting unit 203 acquires the channel setting of the television program that is currently receiving the television broadcast in the device itself. Here, it is assumed that the user is simultaneously viewing the television while using the videophone function. In this case, a videophone video and a television video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  In step S2003, the channel information acquired by the channel setting unit 203 is transmitted to the communication control unit 13, and a channel information signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. Is done. Thereby, the multi-function TV 10T on the receiving side can recognize which channel the TV program should be displayed.

  After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creation unit 11 generates landmark information (S2004). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  In addition, when the video by the videophone and the video of the TV are displayed on the display unit 4 in the multi-screen format, the position information of the mark is the relative position information in the area where the TV video is displayed. Are transmitted to the multi-function television 10T on the receiving side.

  In step S2005, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Next, in S2006, it is confirmed whether or not the content sharing is to be terminated. Specifically, it is determined whether or not it has been detected that the content sharing button 212 in the input unit 5 has been pressed. Unless the content sharing button 212 has been pressed (NO in S2006), the processing in S2004 and S2005 is performed. Will be repeated.

  On the other hand, if YES in S2006, that is, if it is detected that the content sharing button 212 is pressed, a content sharing end signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. (S2007). As a result, the multi-function TV 10T on the receiving side can recognize the end of content sharing.

  Next, processing in the multi-function TV 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state where

  In S2008, the content sharing instruction signal transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. When the communication control unit 13 is notified that the content sharing instruction signal has been received, the communication control unit 13 shifts to a content sharing standby state.

  Next, in S2009, the channel information signal transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. The received channel information signal is transmitted from the communication control unit 13 to the channel setting unit 203. Then, the channel setting unit 203 starts receiving the television program of the channel corresponding to the received channel information signal, and instructs the display control unit 12 to display the television program of the corresponding channel (S2010). ). Here, it is assumed that the user is simultaneously viewing the television while using the videophone function. In this case, a videophone video and a television video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  In step S <b> 2011, when the mark information transmitted from the transmission-side multifunction TV 10 </ b> T is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2012).

  In addition, when the video by the videophone and the video of the TV are displayed on the display unit 4 in the multi-screen format, the position information of the mark included in the received mark information is an area where the TV video is displayed. Is displayed on the display unit 4 as a relative position.

  Next, in S2013, the communication control unit 13 confirms whether or not a content sharing end signal indicating a content sharing end instruction is received from the multi-function TV 10T on the transmission side. In S2013, NO, that is, unless the content sharing end signal has been received, the processes in S2011 and S2012 are repeated.

  On the other hand, if YES in S2013, that is, if a content sharing end signal is received, content sharing ends.

  In addition, when receiving the channel information from the multi-function TV 10T on the transmission side in the multi-function TV 10T on the reception side, the channel currently being viewed is not changed suddenly, but the channel information is received from the other party. May be displayed, and a confirmation process may be performed such that the channel change is approved by the user.

(Sharing web pages)
Next, in this embodiment, the multi-function TV 10T on both the transmitting side and the receiving side can be connected to the Internet and has a Web (World Wide Web) browser function. An example in which an image shared on the receiving side is an image of a Web page will be described. In this embodiment, it is assumed that the transmitting side and the receiving side display the same Web page, and a conversation is performed by a videophone while performing a pointing operation. According to such a form of use, for example, as shown in FIG. 29, a Web page of a toy shop site on the network is displayed, and a mark 221 is displayed for a toy among the displayed toy images. You can enjoy the conversation "I want this stuffed animal".

  At this time, a problem arises when the Web page displayed on the transmission-side multifunction TV 10T is different from the displayed Web page selected on the reception-side multifunction TV 10T. In this case, even if the mark information is transmitted / received, the information indicated by the mark is different between the transmission side and the reception side, and therefore the transmission / reception of the mark information is meaningless.

  In order to prevent such a situation, the multi-function TV 10T on the transmission side transmits address information designating the currently displayed Web page to the multi-function TV 10T on the reception side prior to the transmission of the landmark information. The reception-side multifunction TV 10T receives address information from the transmission-side multifunction TV 10T prior to receiving the landmark information, accesses the network by the received address, and displays the acquired Web page.

  Here, the flow of processing in the multifunction TV 10T on the transmission side and the multifunction TV 10T on the reception side will be described below with reference to FIGS. 30 (a) and 30 (b). FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, processing in the multi-function TV 10T on the transmission side will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function.

  In S2021, when the user presses the content sharing button 212 in the input unit 5, a content sharing start instruction is transmitted to the multi-function TV 10T on the receiving side. As a result, the multi-function TV 10T on the receiving side shifts to a content sharing standby state.

  Next, in S2022, the network content receiving unit 204 acquires the address (URL (Uniform Resource Locator)) of the Web page currently displayed by the Web browsing function of the network content receiving unit 204 in its own device. Here, it is assumed that the Web page is being browsed at the same time while using the videophone function. In this case, a videophone video and a web page video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  Next, in S2023, the URL information acquired by the network content receiving unit 204 is transmitted to the communication control unit 13, and the URL information is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. Is done. Thereby, the multi-function TV 10T on the receiving side can recognize the address of the Web page to be displayed.

  After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creating unit 11 generates landmark information (S2024). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  When the video by the videophone and the video of the Web page are displayed on the display unit 4 in the multi-screen format, the position information of the mark is the relative position within the area where the video of the Web page is displayed. Information is transmitted to the multi-function TV 10T on the receiving side.

  In step S <b> 2025, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Further, when a scroll operation is performed by a user while a Web page is displayed, operation information indicating the scroll amount may be transmitted to the multi-function TV 10T on the receiving side. . In this way, if the size (number of pixels) of the display area of the Web page in both the multifunction TV 10T on both the transmission side and the reception side is the same, it is possible to synchronize the scrolling state. It is possible to make them completely match.

  Further, display size information regarding the size (number of pixels) of the display area of the Web page in the transmission-side multifunction TV 10T may be transmitted to the reception-side multifunction TV 10T. In this way, in the multi-function TV 10T on the reception side, the display state of the Web page is received from the transmission side by setting the Web page display area to the same size as the display area of the Web page on the transmission side. It is possible to completely match with the side.

  Alternatively, even if the size of the display area of the Web page is different between the transmission side and the reception side, the reception side analyzes the size of the display area of the Web page on the transmission side and the position information of the mark on the reception side. It is also possible to calculate at which position in the display area of the Web page the mark should be displayed. As a result, even if the display state (arrangement positions of characters and images) of the Web page is different between the transmission side and the reception side, the pointing object can be matched between the transmission side and the reception side.

  Next, in S2026, it is confirmed whether or not the content sharing is to be terminated. Specifically, it is determined whether or not it has been detected that the content sharing button 212 in the input unit 5 has been pressed. Unless the content sharing button 212 has been pressed (NO in S2026), the processing in S2024 and S2025 is performed. Will be repeated.

  On the other hand, if YES in S2026, that is, it is detected that the content sharing button 212 has been pressed, a content sharing end signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. (S2027). As a result, the multi-function TV 10T on the receiving side can recognize the end of content sharing.

  Next, processing in the multi-function television 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state of being.

  In step S2028, the content sharing instruction signal transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. When the communication control unit 13 is notified that the content sharing instruction signal has been received, the communication control unit 13 shifts to a content sharing standby state.

  In step S2029, the URL information transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. The received URL information is transmitted from the communication control unit 13 to the network content receiving unit 204. Then, the network content receiving unit 204 acquires a Web page having an address corresponding to the received URL information from the network, and instructs the display control unit 12 to display the corresponding Web page (S2030). Here, it is assumed that the Web page is being browsed at the same time while using the videophone function. In this case, a videophone video and a web page video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  Next, in S2031, when the mark information transmitted from the multi-function TV 10T on the transmission side is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2032).

  In addition, when the video by the videophone and the video of the Web page are displayed on the display unit 4 in the multi-screen format, the video of the Web page is displayed as the position information of the mark included in the received mark information. It is displayed on the display unit 4 as a relative position within the area.

  Next, in S2033, the communication control unit 13 confirms whether or not the content sharing end signal indicating the content sharing end instruction is received from the multi-function TV 10T on the transmission side. As long as NO in S2033, that is, unless a content sharing end signal is received, the processing in S2031 and S2032 is repeated.

  On the other hand, if YES in S2033, that is, if a content sharing end signal is received, content sharing ends.

  When receiving the URL information from the transmitting multifunction TV 10T, the receiving multifunction TV 10T received the URL information from the other party instead of suddenly changing the currently viewed web page. May be displayed, and a confirmation process may be performed such that the change of the Web page is approved by the user.

(Video sharing)
Next, in the present embodiment, an example in which the image shared between the transmission side and the reception side is moving image data on the network or moving image data stored in the information communication terminal on the transmission side will be described. In this embodiment, it is assumed that the transmitting side and the receiving side display the same moving image and have a conversation through a videophone while performing a pointing operation. According to such a form of use, for example, as shown in FIG. 31, a motion picture of an athletic meet is played on the multi-function TV 10T on both the transmission side and the reception side, and the person shown in the motion picture You can enjoy the conversation "This is my child".

  The problem at this time is that the timing of moving image playback on the transmission-side multifunction TV 10T and the timing of moving image playback on the reception-side multifunction TV 10T are shifted. If the displayed timing is different, the object pointed to on the transmitting side and the object pointed to on the receiving side will be different, and transmission / reception of landmark information will be meaningless. .

  In order to prevent such a situation, the transmission-side multi-function TV 10T transmits a moving image reproduction start command to the reception-side multi-function TV 10T prior to the transmission of the landmark information, and also reproduces the moving image on the display screen. To start. Prior to the reception of the landmark information, the receiving-side multifunction TV 10T receives a moving image playback command from the transmitting-side multifunction TV 10T, and starts playing the moving image. In other words, the above-described problem can be solved by transmitting and receiving the landmark information in a state where the reproduction start timing of the moving image is matched between the transmission side and the reception side.

  In the following, two video sharing methods will be described as methods for reproducing the same video on the multi-function TV 10T on the transmission side and the multi-function TV 10T on the reception side.

  The first moving image sharing method is a method of using moving image data on the network as described with reference to FIGS. 30 (a) and 30 (b). In this case, in the multi-function TV 10T on the transmission side, after a moving image reproduction start command is transmitted to the multi-function TV 10T on the reception side, the moving image data on the Web is accessed using the network address to reproduce the moving image data. . The multi-function TV 10T on the receiving side accesses the moving image data on the Web using the designated network address after receiving the moving image reproduction start command, and reproduces the moving image data.

  The second moving image sharing method is a method in which the receiving multifunction TV 10T receives and reproduces the moving image data held by the transmitting multifunction TV 10T. In this case, after the moving image data to be shared is first transmitted from the multi-function TV 10T on the transmission side to the multi-function TV 10T on the reception side, a reproduction start command is issued from the multi-function TV 10T on the transmission side. As a result, the multi-function TV 10T on the transmission side and the reception side simultaneously reproduces the moving image data.

  First, the flow of processing in the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T in the first moving image sharing method will be described below with reference to FIGS. 32 (a) and 32 (b). To do. FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, processing in the transmission-side multifunction TV 10T will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function.

  In step S2041, the network content receiving unit 204 acquires an address (URL information) on the Internet where the moving image data to be shared is placed. Here, for example, the user selects a hyperlink indicating the corresponding moving image data and inputs an instruction to set the selected hyperlink as moving image data in the Web browser. In this case, when the instruction input input by the user from the input unit 5 is recognized by the network content receiving unit 204, the network content receiving unit 204 acquires the URL information of the corresponding moving image data.

  In step S <b> 2042, the URL information acquired by the network content receiving unit 204 is transmitted to the communication control unit 13, and the URL information is transmitted from the communication unit 7 to the multi-function television 10 </ b> T on the receiving side based on control of the communication control unit 13. Is done. Thereby, the multi-function television 10T on the receiving side can recognize the address on the Internet of the moving image data to be displayed.

  In step S <b> 2043, when the user presses the content sharing button 212 in the input unit 5, a content sharing start instruction is transmitted from the communication unit 7 to the multi-function TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. Sent. In addition, when transmitting the content sharing start instruction, a moving image data reproduction command corresponding to the URL information transmitted in S2042 is also transmitted at the same time. This process can be realized by, for example, displaying an item of a moving image reproduction start instruction as an option when the content sharing button 212 is pressed and selecting it by the user. As a result, the multi-function TV 10T on the receiving side shifts to a content sharing standby state and starts to reproduce moving image data corresponding to the already notified URL information.

  At the same time as the reproduction instruction of the moving image data shared in S2043 is transmitted, in S2044, the network content receiving unit 204 accesses the moving image data corresponding to the URL information and reproduces the acquired moving image data. The moving image reproduced by the network content receiving unit 204 is displayed on the display unit 4 under the control of the display control unit 13. Here, it is assumed that a video is displayed simultaneously while using the videophone function. In this case, a videophone video and a video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creation unit 11 generates landmark information (S2045). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  When the videophone video and the video image are displayed on the display unit 4 in the multi-screen format, the position information of the mark is the relative position information in the area where the video image is displayed. Are transmitted to the multi-function television 10T on the receiving side.

  In step S <b> 2046, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Next, in S2047, it is confirmed whether or not to end the content sharing. Specifically, it is determined whether or not it has been detected that the content sharing button 212 in the input unit 5 has been pressed. Unless the content sharing button 212 has been pressed (NO in S2047), the processing in S2045 and S2046 is performed. Will be repeated.

  On the other hand, if YES in S2047, that is, it is detected that the content sharing button 212 has been pressed, a content sharing end signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. (S2048). As a result, the multi-function TV 10T on the receiving side can recognize the end of content sharing.

  Next, processing in the multi-function television 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state of being.

  In S2049, the URL information transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7. The received URL information is temporarily stored in the image information holding unit 205 so that it can be called later when a reproduction instruction is issued.

  In step S2050, a content sharing start instruction and a moving image data reproduction command are received via the communication unit 7. When the communication control unit 13 is notified that the content sharing instruction signal has been received, the communication control unit 13 shifts to a content sharing standby state. In addition, when a moving image data playback command is transmitted to the communication control unit 13, this is transmitted to the network content receiving unit 204. Then, the network content receiving unit 204 reads out the URL information temporarily stored in the image information holding unit 205, accesses the moving image data corresponding to the URL information, and reproduces the acquired moving image data (S2051).

  Here, it is assumed that the video data is being played back simultaneously while using the videophone function. In this case, a videophone video and video data may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  In step S <b> 2052, when the mark information transmitted from the transmission-side multifunction TV 10 </ b> T is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2053).

  Note that when the videophone video and the video data are displayed on the display unit 4 in a multi-screen format, the video position data included in the received landmark information is displayed as video data. It is displayed on the display unit 4 as a relative position within the area.

  Next, in S2054, the communication control unit 13 confirms whether or not a content sharing end signal indicating a content sharing end instruction is received from the multi-function TV 10T on the transmission side. As long as NO in S2054, that is, unless a content sharing end signal is received, the processes in S2052 and S2053 are repeated.

  On the other hand, if YES in S2054, that is, if a content sharing end signal is received, content sharing ends.

  Note that when the multi-function TV 10T on the receiving side receives a video data playback command from the multi-function TV 10T on the transmitting side, the video data is not played back suddenly, but the video data playback command is sent from the other party. A confirmation process may be performed such that the reception is displayed and the reproduction of the moving image data is approved by the user.

  Next, the flow of processing in the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T in the second moving image sharing method will be described below with reference to FIGS. 33 (a) and 33 (b). explain. FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, processing in the multi-function TV 10T on the transmission side will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function.

  In S2061, the communication control unit 13 reads the moving image data to be shared from the image information storage unit 206, and transmits the moving image data to the receiving-side multifunction TV 10T via the communication unit 7. Here, for example, the user inputs an instruction to transmit the moving image data stored in the image information storage unit 206 to the communication destination. When the transmission of the moving image data is completed, the process proceeds to S2062. If the receiving-side multi-function TV 10T is implemented to transmit a moving image data reception completion notification, the process proceeds to S2062 after receiving the moving image data reception completion notification.

  Next, in S2062, when the user presses the content sharing button 212 in the input unit 5, based on the control of the communication control unit 13, an instruction to start content sharing is sent from the communication unit 7 to the multi-function TV 10T on the receiving side. Sent. Further, when transmitting the content sharing start instruction, the moving image data reproduction command transmitted in S2061 is also transmitted at the same time. This process can be realized by, for example, displaying an item of a moving image reproduction start instruction as an option when the content sharing button 212 is pressed and selecting it by the user. As a result, the multi-function TV 10T on the receiving side shifts to a content sharing standby state and starts to reproduce the already received video data.

  At the same time as the reproduction command of the moving image data to be shared in S2062, the corresponding moving image data stored in the image information storage unit 206 is reproduced in S2063. The video of the moving image data is displayed on the display unit 4 based on the control of the display control unit 13. Here, it is assumed that a video is displayed simultaneously while using the videophone function. In this case, a videophone video and a video may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creation unit 11 generates landmark information (S2064). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  When the videophone video and the video image are displayed on the display unit 4 in the multi-screen format, the position information of the mark is the relative position information in the area where the video image is displayed. Are transmitted to the multi-function television 10T on the receiving side.

  In step S <b> 2065, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Next, in S2066, it is confirmed whether or not to end the content sharing. Specifically, it is determined whether or not it has been detected that the content sharing button 212 in the input unit 5 has been pressed. Unless the content sharing button 212 has been pressed (NO in S2066), the processing of S2064 and S2065 is performed. Will be repeated.

  On the other hand, if YES in S2066, that is, it is detected that the content sharing button 212 has been pressed, a content sharing end signal is transmitted from the communication unit 7 to the multi-function TV 10T on the receiving side based on the control of the communication control unit 13. (S2067). As a result, the multi-function TV 10T on the receiving side can recognize the end of content sharing.

  Next, processing in the multi-function TV 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state where

  In step S <b> 2068, the moving image data transmitted from the transmission-side multifunction TV 10 </ b> T is received via the communication unit 7. The received moving image data is stored in the image information storage unit 206 so that it can be called later when a reproduction instruction is given (S2069). When the reception of the moving image data is completed, the process proceeds to S2070. Note that the video data reception completion notification may be transmitted to the multi-function TV 10T on the transmission side. If the multi-function TV 10T on the transmission side receives a video data reception completion notification and transmits a content sharing start instruction and a video data playback command, the video data playback command has received video data. You will receive it only after

  Next, in S 2070, a content sharing start instruction and a moving image data playback command are received via the communication unit 7. When the communication control unit 13 is notified that the content sharing instruction signal has been received, the communication control unit 13 shifts to a content sharing standby state. In addition, the moving image data reproduction command is transmitted to the communication control unit 13, whereby the corresponding moving image data stored in the image information storage unit 206 is reproduced. The video of the moving image data is displayed on the display unit 4 based on the control of the display control unit 13. (S2071).

  Here, it is assumed that the video data is being played back simultaneously while using the videophone function. In this case, a videophone video and video data may be displayed on the display unit 4 in a multi-screen format, or may be displayed while being switched by the display content switching button 211.

  In step S <b> 2072, when the mark information transmitted from the transmission-side multifunction TV 10 </ b> T is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2073).

  Note that when the videophone video and the video data are displayed on the display unit 4 in a multi-screen format, the video position data included in the received landmark information is displayed as video data. It is displayed on the display unit 4 as a relative position within the area.

  Next, in S2074, the communication control unit 13 confirms whether or not a content sharing end signal indicating a content sharing end instruction is received from the multi-function TV 10T on the transmission side. In S2074, NO, that is, unless the content sharing end signal is received, the processing of S2072 and S2073 is repeated.

  On the other hand, if YES in S2074, that is, if a content sharing end signal is received, content sharing ends.

  Note that when the multi-function TV 10T on the receiving side receives a video data playback command from the multi-function TV 10T on the transmitting side, the video data is not played back suddenly, but the video data playback command is sent from the other party. A confirmation process may be performed such that the reception is displayed and the reproduction of the moving image data is approved by the user.

  In the second moving image sharing method, the receiving multi-function TV 10T receives all moving image data from the transmitting multi-function TV 10T and stores it in the image information storage unit 206, and then playback is started. However, in this case, the moving image data cannot be reproduced while the reception of the moving image data is not completed. On the other hand, a method may be used in which moving image data is reproduced on the transmission-side multifunction TV 10T and the reproduced moving image information is transmitted as stream data to the reception-side multifunction TV 10T. According to such a method, it is possible to eliminate the need to wait for the time required for transmission / reception of moving image data.

  Also, according to such a method, the playback timing on the transmission-side multifunction TV 10T and the playback timing on the reception-side multifunction TV 10T are almost the same. The display timing shift from the mark information is not a big problem.

  However, it is also conceivable that the reproduction quality of moving image data in the multi-function television 10T on the receiving side is reduced due to network congestion or the like. For such a problem, as in the second moving image sharing method described above, a method in which moving image data possessed by the transmitting-side multifunction TV 10T is transmitted in advance to the receiving-side multifunction TV 10T. Is preferred.

  Also, in the streaming playback method described above, if the buffer size when streaming playback is performed in the multi-function TV 10T on the receiving side is large due to network congestion or the like, the video on the transmitting side and the receiving side It is conceivable that the display timing shift between the reproduction timing and the landmark information becomes large. In order to cope with this, the following landmark transmission method may be performed.

  As a first mark transmission method, in the method of transmitting the mark information in the sequential transmission mode, the multi-function TV 10T on the transmission side transmits the mark information in the header of each packet of the moving image data to be transmitted. Can be mentioned. According to this method, the multi-function television 10T on the receiving side displays the landmark information included in the header of the packet of the received streaming moving image data in synchronization with the display timing of the data included in the packet. The display timing difference between the reproduction timing and the mark information can be eliminated. For example, in RTP (Real-time Transport Protocol), which is a video and audio transmission protocol, the 4th byte from the beginning of the header of the RTP packet is an extension bit, and the header is set by setting the extension bit. Can be extended. Using the expanded header area, the coordinate position of the mark can be transmitted.

  As a second mark transmission method, a method of including information indicating at which timing of corresponding moving image data each mark included in the mark information is displayed in the mark information transmitted from the multi-function TV 10T on the transmission side. Is mentioned. This method can also be applied to the first moving image sharing method. In the first moving image sharing method, moving image data on the network is acquired and reproduced on the transmitting side and the receiving side, but it is conceivable that streaming reproduction is also performed here. Also in this case, moving image reproduction can be performed by including, in the mark information transmitted from the multi-function TV 10T on the transmission side, information indicating at which timing of the corresponding moving image data each mark included in the mark information is to be displayed. The display timing difference between the timing and the landmark information can be eliminated.

  As a third method, in the multi-function TV 10T on the receiving side, the object indicated by the mark information first instructed from the transmitting side is image-recognized, and then the mark is followed based on the image recognition result. There is a method of making it. The processing of the receiving-side multifunction TV 10T will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function. Further, it is assumed that content such as moving image data is shared in the multifunction TV 10T on the transmission side and the reception side.

  In S <b> 2121, the shared content is displayed on the screen of the display unit 4. In S2122, when the mark information transmitted from the multi-function TV 10T on the transmission side is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display the mark based on the received mark information, and the mark is displayed on the display unit 4 (S2123). Then, the display position of the mark information and the pattern near the display position are temporarily stored. The pattern to be stored may identify a person or a car by image recognition, or may be a simple color pattern storage.

  After a predetermined time (for example, 1 second) has elapsed in S2125, it is checked whether a pattern similar to the pattern stored in S2124 is found near the display position stored in S2124 (S2126). That is, within a certain distance from the display position stored in S2124, the pattern stored in S2124 is the same, or a pattern that can be regarded as having undergone a change in size within a certain range, or rotation or deformation within a certain range is found. Find out if.

  If a similar pattern is found, the process proceeds to step S2127, the mark is moved to the position of the found similar pattern, and the process returns to step S2124. If a similar pattern is not found, the process proceeds to S2128, the mark is deleted, and the process ends.

(Example of mark movement control)
As described above, when moving image data is used as shared content, it is important to move mark information following the moving image. For example, as shown in FIG. 34 (a) to FIG. 34 (e), or FIG. 43 (a) to FIG. 43 (e), the athletic meet video is played on the transmission-side and reception-side multifunction TV 10T, When a person is marked and pointed to the other person in the video, the person moves in accordance with the reproduction of the video. Therefore, the mark must be moved in accordance with the movement of the person. The sequential transmission mode described above can be used as such a technique for moving the mark. Note that in FIGS. 34 (a) to 34 (e), a circle is used as the mode of the mark information, and in FIGS. 43 (a) to 43 (e), a balloon is used as the mode of the mark information. The information “Hanako-chan” is displayed in the balloon.

  That is, as described in FIG. 32 (a) or 33 (a), after reproduction of moving image data is started on the transmission-side multifunction TV 10T, a mark is placed on a person appearing in the moving image, The mark information is transmitted to the multifunction TV 10T on the receiving side. When the person on the display screen moves, the transmission-side multifunction TV 10T remarks the person appearing in the moving image, and transmits information regarding the movement of the mark to the reception-side multifunction TV 10T.

  On the other hand, as described with reference to FIG. 32B or FIG. 33B, the multi-function TV 10T on the receiving side starts displaying the moving image and then displays the mark on the display screen every time the mark information is received. Move to display. Since the timing for starting the reproduction of moving picture information on the multi-function TV 10T on the transmission side matches the timing for starting the reproduction of moving picture information on the multi-function TV 10T on the receiving side, the target is set on the multi-function TV 10T on the receiving side. There will be no deviation from the landmark.

(Example of mark deletion control)
As described above, when moving image data is used as shared content, it is important to delete the landmark information. For example, when an athletic meet video is played on the multi-function TV 10T on the transmission side and on the reception side, and a person shown in the video is marked and pointed to the other party, the target person disappears from the display screen. If the display of the mark remains after it is closed, it may be confused when the partner knows the target person. To avoid this situation, landmarks that are no longer needed should be deleted.

  Two methods are conceivable for deleting the mark from the display screen in the multi-function TV 10T on the transmission side. One mark erasing method is a method of associating mark erasure with a specific key input operator. When the user operates the key input operator, the mark disappears from the display screen on the multi-function TV 10T on the transmission side. The other mark erasing method is a method of erasing a mark when an operation of a key input operator related to the mark display is not performed for a certain period of time. If the user does not perform an operation related to the display of the mark for a certain period of time, the mark disappears from the display screen on the multi-function TV 10T on the transmission side. Note that, as a method for enabling an erasure instruction, a key corresponding to the erasure instruction may be provided in the input unit 5, or a menu is displayed by pressing any key, and the erasure instruction included in this menu is displayed. It may be selected.

  In any case, when the mark disappears from the display screen on the multi-function TV 10T on the transmission side, an instruction to delete the mark is sent from the multi-function TV 10T on the transmission side to the multi-function TV 10T on the reception side. In the multi-function TV 10T on the receiving side, when the mark deletion command is received, the mark is deleted from the display screen.

  Here, with reference to FIG. 35 (a) and FIG. 35 (b), the flow of processing in the multi-function television 10T on the transmission side and the multi-function television 10T on the reception side in the above-described mark erasing method will be described. . FIG. 4A shows the flow of processing in the transmission-side multifunction TV 10T, and FIG. 4B shows the flow of processing in the reception-side multifunction TV 10T.

  First, the processing in the multifunction TV 10T on the transmission side will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function. Further, it is assumed that content such as moving image data is shared in the multifunction TV 10T on the transmission side and the reception side.

  In S2081, the shared content is displayed on the screen of the display unit 4. After that, a mark is displayed on the display unit 4, and according to an input operation from the input unit 4, the mark position movement operation, the type specifying operation, the shape specifying operation, etc. are performed by the mark information movement control unit 14. Is called. Based on these operations, the landmark information creation unit 11 generates landmark information (S2082). Note that the method of generating the mark information is the same as the method described in the above embodiment, and thus the description thereof is omitted here.

  In step S <b> 2083, the landmark information created by the landmark information creation unit 11 is transmitted from the communication unit 7 to the multifunction TV 10 </ b> T on the receiving side based on the control of the communication control unit 13. As a result, the multifunction TV 10T on the receiving side can perform a pointing operation based on the received landmark information.

  Next, in step S <b> 2084, the mark information movement control unit 204 determines whether or not deletion of the mark is instructed by a key input from the input unit 5. If NO in S2084, that is, if no deletion of the mark is instructed, in S2085, the mark information movement control unit 204 determines whether or not a key input related to the display of the mark has not been made for a certain period of time. If NO in S2085, that is, if a key input related to the display of the mark is made within a certain time, the process returns to S2082.

  On the other hand, if YES in S2085, that is, if the key input related to the display of the mark has not been made for a certain period of time, in S2086, the communication control unit 13 causes the multifunction TV 10T on the receiving side to be received via the communication unit 7. A mark erasure command is transmitted. In S2087, the display control unit 13 erases the mark displayed on the display unit 4. Although not shown, it may be configured to wait for input operation information again after erasing the mark in S2087, and return to S2082 when the display of the mark is instructed by the input operation information.

  Next, processing in the multi-function TV 10T on the receiving side will be described with reference to FIG. Similar to the processing on the transmission side described above, prior to the following processing, communication is established between the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T by the video phone function or the voice phone function. It is assumed that it is in a state where Further, it is assumed that content such as moving image data is shared in the multifunction TV 10T on the transmission side and the reception side.

  In S2088, the shared content is displayed on the screen of the display unit 4. In S2089, when the mark information transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7, the mark information is transmitted from the communication control unit 13 to the mark information movement control unit 14. Then, the mark information movement control unit 14 instructs the display control unit 12 to display a mark based on the received mark information, thereby displaying the mark on the display unit 4 (S2090).

  In step S <b> 2091, the communication control unit 13 determines whether a mark deletion command is received from the transmission-side multifunction TV 10 </ b> T via the communication unit 7. If NO in S2091, that is, if no mark erasure command has been received, the processing in S2089 and S2090 is repeated.

  On the other hand, if YES in S2091, that is, if a mark deletion command is received, the display control unit 13 deletes the mark displayed on the display unit 4 in S2092. Although not shown, it may be configured to return to S2089 after erasing the mark in S2092 and wait for the mark information to be received again, and to display the mark again when the mark information is received.

(Example of mark deletion control 2)
As a modification of the above-described mark erasure control example, a method for erasing a mark from the display screen on both the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T without communicating a mark erasure command will be described. To do.

  In the multi-function TV 10T on the transmission side, as described above, the mark is deleted using a method of deleting the mark when the operation of the key input operator related to the display of the mark is not performed for a certain period of time. The mark deletion command is not transmitted to the multi-function television 10T on the receiving side. Instead, in the multi-function TV 10T on the reception side, the mark is deleted when communication related to the display of the mark is not performed for a certain period of time from the multi-function TV 10T on the transmission side. If a communication related to the movement of the mark or other mark display is not received from the multi-function TV 10T on the transmission side for a certain period of time, the mark disappears from the display screen on the multi-function TV 10T on the receiving side.

  A certain time for detecting that the operation of the key input operator for determining whether or not to delete the mark in the multi-function TV 10T on the transmission side is detected, and whether the mark is deleted in the multi-function TV 10T on the reception side If the fixed time for detecting that the communication related to the display for determining whether or not to receive is the same interval, at the same time as the mark is erased in the multi-function TV 10T on the transmission side, The mark is erased from the multi-function TV 10T.

  FIG. 36A shows the flow of processing in the multifunction TV 10T on the transmission side in this example of mark erasure control, and FIG. 36B shows the flow of processing in the multifunction TV 10T on the reception side.

  First, the flow of processing in the multifunction TV 10T on the transmission side will be described. In FIG. 36A, the processing of S2101 to S2105 is the same as the processing of S2081 to S2083, S2085, and S2087 in FIG. That is, the processing shown in FIG. 36 (a) is different only in that there is no mark erasure instruction detection processing in S2084 of S35 (a) and no mark erasure instruction transmission processing in S2086. Is the same. Although not shown, it may be configured to wait for input operation information again after erasing the mark in S2105, and return to S2102 when the display of the mark is instructed by the input operation information.

  Next, the flow of processing in the multi-function TV 10T on the receiving side will be described. In FIG. 36B, the processing in S2106 to S2108 and S2110 is the same as the processing in S2088 to S2090 and S2092 in FIG. In the process of FIG. 36 (b), in place of the mark deletion command reception confirmation process in S2091 in FIG. 35 (b), has the mark information been received from the multi-function TV 10T on the transmission side for a certain time in S2109? The communication control unit 13 determines whether or not. If NO in S2109, that is, if landmark information is received within a certain time, the process returns to S2107. On the other hand, if YES in S2109, that is, if the landmark information has not been received for a certain time, the process proceeds to S2110. Although not shown, it may be configured to return to S2107 after erasing the mark in S2110, wait for the mark information to be received again, and display the mark again when the mark information is received.

(Other examples of mark display processing)
Next, another example of the mark display process will be described. In addition to using a single piece of mark coordinate information, a form of sending a movement locus to a partner information communication terminal using a set of mark coordinate information is also conceivable. For example, the display content shared between the multifunction TV 10T on the transmission side and the multifunction TV 10T on the reception side is a map, and the user of the multifunction TV 10T on the transmission side is the user of the multifunction TV 10T on the reception side. However, it is possible to give directions. When performing such route guidance, it is important for the other party to recognize the locus of movement of the landmark. In this embodiment, both the transmission side and the reception side show an example using the multi-function TV 10T as an information communication terminal. However, as an example of performing route guidance, information communication on the transmission side and / or reception side is performed. The terminal may be the mobile phone 10 and the form of the information communication terminal is not particularly limited.

(Example of display mode with broken line arrows)
FIG. 37 shows an example of a display screen in which the movement trajectory of the mark is displayed in the form of a broken line arrow. As shown in the figure, the broken line arrow is a figure in which the start point A, the relay points B and C, and the arrival point D are connected in order by a straight line on the map, and an arrow is indicated at the arrival point D. If such a broken line arrow is displayed on the multi-function television 10T on the receiving side, the user on the receiving side can clearly grasp what route should be followed to reach the destination.

  In order to transmit / receive such a marker consisting of a broken line arrow, the following may be performed. In the multi-function TV 10T on the transmission side, the following processing is performed. First, the type and shape of the mark are set to be a broken line arrow. Thereafter, the start point, the relay point, and the arrival point are designated, and the designated positions are stored in the buffer. When the user designates the position up to the arrival point and issues a confirmation instruction, the input operation information stored in the buffer is transmitted to the multi-function TV 10T on the receiving side.

  The details of these processes are basically the same as those in the above-described embodiment. The difference is that the position information of the mark included in the input operation information is the position information about the start point, the relay point, and the arrival point, and is not included for the position in the middle of absolute position designation or relative position designation. It is.

  On the other hand, when receiving the input operation information, the multifunction TV 10T on the receiving side first recognizes that it is a broken line arrow. A broken line arrow is displayed by recognizing the position information of the start point, the relay point, and the arrival point.

  In the above processing, the position designation of the start point, the relay point, and the arrival point is temporarily stored in the buffer, and when the input operation information is confirmed, the input operation information is changed from the transmission-side multifunction TV 10T to the reception-side multifunction TV 10T. To be sent to. On the other hand, the input operation information may be transmitted in the above-described sequential transmission mode. In this case, first, a broken line arrow is transmitted from the multi-function TV 10T on the transmission side to the multi-function TV 10T on the reception side, and when the input operation information is sequentially transmitted to the multi-function TV 10T on the reception side, This can be realized by extending the broken line arrows in the order received.

(Display mode example in sequential transmission mode)
If the display mode of the mark is set to a broken line arrow as described above, the route guidance can be simplified. However, as shown in FIG. In a simple manner of selecting one display mode candidate and displaying it at a desired coordinate, the marker information of the broken line arrow cannot be communicated. Therefore, as shown in FIG. 38, the route guidance may be performed by sequentially moving the landmarks using the sequential transmission mode.

  The example shown in FIG. 38 will be described. First, when the coordinate (100, 400) is designated as a start point in the multi-function TV 10T on the transmission side, this is transmitted to the multi-function TV 10T on the reception side in the sequential transmission mode, and a mark is displayed at the corresponding position. Thereafter, coordinates (100,300), (300,300), (500,300) are designated as relay points, and coordinates (500,150) are sequentially designated as destination points in the multi-function TV 10T on the transmission side. 10T and the mark is displayed in order at the corresponding position.

  If the processing as described above is performed, the landmark moves in an animation manner on the receiving-side multifunction TV 10T, so that a route guidance is realized. Further, since it is only necessary to use the sequential transmission mode in the above-described embodiment, the implementation is simple.

(Example of display mode by sending trajectory information)
In the case of the display mode example in the above-described sequential transmission mode, input operation information is transmitted from the transmission-side multifunction TV 10T to the reception-side multifunction TV 10T every time the mark moves. That is, there is a problem that communication processing occurs every time the mark is moved. Therefore, as an embodiment in which communication processing does not occur each time the mark is moved, a set of coordinate information of the mark is used to collect the movement locus as locus information and the multifunction TV 10T on the receiving side to the multifunction on the receiving side. A method of sending to the television 10T will be described. FIG. 39 shows a display example on the transmission-side multifunction TV 10T and the reception-side multifunction TV 10T when the trajectory information is transmitted and received.

  As a transmission mode of input operation information, a fixed information transmission mode is used. First, in the multi-function TV 10T on the transmission side, coordinates (100, 400) are designated as the starting point. At this time, this position information is not transmitted to the receiving side, but is stored in a buffer in the multifunction TV 10T on the transmitting side. Thereafter, the coordinates (100, 300), (300, 300), (500, 300) are designated as relay points, and the coordinates (500, 150) are sequentially designated as destination points in the multi-function TV 10T on the transmission side, and this information is stored in a buffer.

  When these start point, relay point, and arrival point are determined, the position information of these points is read from the buffer, and the trajectory information is generated by the landmark information creation unit 11. Then, the input operation information including the trajectory information is transmitted from the transmission-side multifunction TV 10T to the reception-side multifunction TV 10T. When receiving the input operation information including the trajectory information, the multi-function TV 10T on the reception side sequentially displays the marks from the start point to the arrival point at predetermined time intervals (for example, 1 second). The processing of the reception-side multifunction TV 10T will be described with reference to FIG. Prior to the following processing, it is assumed that communication is established between the transmitting multifunction TV 10T and the receiving multifunction TV 10T by the videophone function or the voice telephone function. Further, it is assumed that content such as moving image data is shared in the multifunction TV 10T on the transmission side and the reception side.

  In S 2131, the shared content is displayed on the screen of the display unit 4. In S2132, when the input operation information including the trajectory information transmitted from the transmission-side multifunction TV 10T is received via the communication unit 7, the input operation information including the trajectory information is marked from the communication control unit 13. It is transmitted to the information movement control unit 14. Then, the mark information movement control unit 14 reads the mark information of the first coordinates from the received trajectory information (S2133), instructs the display control unit 12 to display the mark, and thereby displays the mark on the display unit 4. (S2134). Then, the display position of the mark information and the pattern near the display position are temporarily stored. If the displayed mark information is the mark information of the last coordinate included in the trajectory information, the process ends (S2135).

  When the displayed landmark information is not the landmark information of the last coordinate included in the trajectory information, after a predetermined time (for example, 1 second) has elapsed in S2136, the landmark information of the next coordinate is read from the received trajectory information (S2137). Then, the display control unit 12 is instructed to move and display the mark, and the mark is displayed on the display unit 4 (S2138). Thereafter, the process returns to S2135, and it is determined whether or not the displayed landmark information is landmark information of the last coordinate included in the trajectory information.

  The display instruction to move the mark to the display control unit 12 in S2138 is to delete the mark already displayed and display the mark at a new coordinate position. You may display the mark at the new coordinate position without erasing it. Further, the mode of the mark may be changed according to the mode of the mark included in the input operation information including the received trajectory information, or the mark mode may be set in a fixed manner in advance on the multi-function TV 10T on the receiving side. The mark mode may be changed according to the moving direction and the moving distance from the coordinate position where the mark is displayed immediately before, or of course, the mark mode may not be changed. An embodiment in which the mode of the mark is changed according to the moving direction and the moving distance from the coordinate position where the mark is displayed immediately before will be described in detail later.

  If the processing as described above is performed, the landmark moves in an animation manner on the receiving-side multifunction TV 10T, so that a route guidance is realized. Moreover, since the transmission / reception of the input operation information is performed after the start point to the arrival point is determined, the number of communication processes can be reduced.

(Other examples of mark display mode)
FIGS. 40A to 40E show examples of display screens when the display mode of the mark is changed when the mark is moved and displayed. In this example, the display mode of the mark is changed according to the moving direction and the moving distance of the mark. As an example, anthropomorphic characters are used as the display mode of the mark.

  The reception-side multifunction TV 10T receives input operation information including trajectory information from the transmission-side multifunction TV 10T. Then, in the multi-function TV 10T on the receiving side, the landmark information movement control unit 14 first marks the first coordinate information as shown in FIG. 40A according to the received trajectory information. Instruct to display. At this time, a picture in which anthropomorphic characters are stopped is used as a mark display mode. Hereinafter, the movement display of the mark is performed by an instruction to the display control unit 12 by the mark information movement control unit 14. Next, in FIG. 40B, marks are displayed at the coordinates moved short distance upward with respect to the coordinate position of FIG. At this time, a picture in which the anthropomorphic character is walking upward is used as the display mode of the mark. In this case, since the moving direction is upward, a picture that is moving upward is selected, and since the moving distance is short, a picture that is walking is selected.

  Next, in FIG. 40C, marks are displayed at the coordinates moved a long distance in the right direction with respect to the coordinate positions of FIG. At this time, a picture in which the anthropomorphic character is running in the right direction is used as the display mode of the mark. This is because the moving direction is the right direction, so the picture moving toward the right is selected, and the moving picture is selected because the moving distance is long. Hereinafter, also in FIG. 40D and FIG. 40E, according to the mark trajectory information, a picture of anthropomorphic character as a mark display mode is selected according to the moving direction and moving distance from the immediately preceding coordinates. . Thereby, the movement of the landmark for route guidance is displayed in a more easily understandable manner for the user.

  The object of the present invention is achieved not only by the mobile phone 10 or the multi-function TV 10T equipped with the communication function in the first, second, and third embodiments described above, but each functional block provided in the control unit 1 is provided. It can also be achieved as a terminal control program which is software to be realized.

  Another object of the present invention is to supply a recording medium in which a program code of a program which is software for realizing the functions described above is recorded so as to be readable by a computer, to the system or apparatus, and the computer (or CPU, CPU) of the system or apparatus This can also be achieved by the MPU) reading and executing the program code recorded on the recording medium. In this case, the program code itself read from the recording medium realizes the above-described function, and the recording medium on which the program code is recorded constitutes the present invention.

  The recording medium may be a magnetic tape, a cassette tape, a floppy (registered trademark) disk, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM / MO / MD / DVD / CD-R, an IC card (memory card). Or a semiconductor memory such as a mask ROM / EPROM / EEPROM / flash ROM or the like.

  In the mobile phone 10 or the multi-function TV 10T according to each of the embodiments described above, the type and shape of the mark are changed in the absolute position designation mode, and the size of the mark is changed in the relative position designation mode. It is not limited to this. For example, in either mode, the type, shape, and size of the mark may be changed, and the line type and color of the mark may be changed. Further, buttons other than the dial buttons may be used for each operation.

  In each of the above embodiments, the display mode such as the line type and density of the mark is changed in order to indicate that the absolute position designation mode, the relative position designation mode, the confirmation, or the coordinate designation is in progress or during coordinate designation. However, the present invention is not limited to this, and the color, type, shape, and size of the mark may be changed.

  In each of the above embodiments, the case where the present invention is applied to a mobile phone or a multi-function TV 10T has been described. However, the present invention is not particularly limited to these, and for example, a telephone with a display, a display The present invention can also be applied to a fax machine with a cord and a cordless cordless handset with a display.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  The present invention also provides an information communication terminal that communicates information that causes another information communication terminal to perform display linked to a pointing display, which is generated by a self-input input operation, in a plurality of network information communication terminals. The area on the display screen is made to correspond to the same position as the key, and the means for designating the display area by pressing the key, the means for displaying the mark indicating the position of the designated area, and other information An information communication terminal characterized in that the communication terminal has means for transmitting at least one transmission information among the elements constituting the area designation information or landmark information for designating the designated display area. Good.

  Further, the present invention is an information communication terminal having a function capable of designating an area on a display screen to be divided into at least one or more, at least of information specifying a received area or information about a mark indicating the area. Based on any of the above, it is possible to express an information communication terminal characterized by displaying a mark indicating the position of the area in the area.

  The present invention provides a computer that controls an information communication terminal that communicates information that causes another information communication terminal to perform display linked to pointing display, which is generated by a self-input input operation, in a plurality of network information communication terminals. A storage medium storing a program to be executed, the area on the display screen corresponding to the same key layout position, and the function of designating the display area by pressing the key, and the position of the designated area A function of displaying a mark, and transmitting to the other information communication terminal at least one transmission information among the area designating information designating the designated display area or elements constituting the mark information It may be a recording medium that records a terminal control program to be executed by a computer.

  Further, the present invention is a storage medium storing a program to be executed by a computer controlling an information communication terminal having a function capable of specifying an area on a display screen to be divided into at least one or more, and specifying the received area A terminal control program for causing a computer to execute the display of the mark indicating the position of the area in the area based on at least one of the information to be performed or the information on the mark indicating the area It may be a storage medium.

  Since the information communication terminal according to the present invention is effective when sharing some content with the information communication terminal of the communication destination, in addition to the mobile phone and the multi-function TV having the communication function, for example, the communication function It can also be applied to computers (including desktop type, notebook type, PDA (Personal Digital Assistant) type, etc.).

1 is a functional block diagram of a mobile phone showing an embodiment of the present invention. It is a figure which shows the external appearance of the portable telephone of FIG. (A), (b) is a flowchart which shows the whole operation | movement of the portable telephone of a transmission side and a reception side. 6 is a flowchart showing an example of processing when the mobile phone of FIG. 1 is used as a transmission side. FIG. 5 is a flowchart showing a processing example subsequent to FIG. 4 when the mobile phone of FIG. 1 is used as a transmission side. (A)-(e) is a figure which shows an example of the information required for pointing operation in the portable telephone of FIG. (A)-(d) is a figure which shows the operation example in the case of being set to the sequential transmission mode by the portable telephone which concerns on one Embodiment of this invention. (A)-(d) is a figure which shows the operation example in the case of setting to sequential transmission mode similarly to FIG. It is a figure which shows the outline | summary of operation | movement when the resolution of the display screen which the portable telephone of a transmission side and a receiving side has differs. It is a figure which shows the change transition of the kind of mark information which the portable telephone of FIG. 1 uses, and a shape. It is a flowchart which shows an example of the process by the side of reception of the portable telephone which concerns on one Embodiment of this invention. 12 is a flowchart showing an example of processing following FIG. 11 on the receiving side of the mobile phone according to the embodiment of the present invention. (A)-(d) is a figure which shows the operation example in the case where it is not set to the sequential transmission mode by the portable telephone which concerns on one Embodiment of this invention. (A)-(d) is a figure which shows the operation example in case it is not set to sequential transmission mode similarly to FIG. It is a flowchart which shows an example of the process of the transmission side of the portable telephone which concerns on other embodiment of this invention. FIG. 16 is a flowchart showing a processing example subsequent to FIG. 15 on the transmitting side of the mobile phone according to another embodiment of the present invention. FIG. (A)-(g) is a figure which shows the other example of information required for pointing operation which the portable telephone of FIG. 1 uses. (A)-(d) is a figure which shows an example of the operation | movement in the case of being set to the sequential transmission mode by the portable telephone which concerns on other embodiment of this invention. (A)-(d) is a figure which shows an example of an operation | movement in the case of being set to sequential transmission mode similarly to FIG. It is a flowchart which shows the process of the receiving side in the portable telephone which concerns on other embodiment of this invention. (A)-(d) is a figure which shows an example of the operation | movement when not set to the sequential transmission mode by the portable telephone which concerns on other embodiment of this invention. (A)-(c) is a figure which shows an example of an operation | movement when not setting to sequential transmission mode similarly to FIG. It is a figure which shows the outline | summary of operation | movement when the resolution of the display screen which the portable telephone of a transmission side and a receiving side has differs. It is a block diagram which shows schematic structure of the multifunctional television which concerns on one Embodiment of this invention. (A) is a front view which shows the external appearance of the said multifunction TV, (b) is a top view which shows the external appearance of the remote control as an input part which the said multifunction TV has. (A)-(c) is a display screen figure which shows transition of the pointing process in the said multifunctional television. FIG. 11 is a display screen diagram illustrating an example of a state where pointing is performed in a state where a television program is displayed in the multi-function television. In the example of sharing a television program, (a) is a flowchart showing the flow of processing in the multifunction TV 10T on the transmission side, and (b) is a flowchart showing the flow of processing in the multifunction TV 10T on the reception side. FIG. 11 is a display screen diagram illustrating an example of a state in which pointing is performed in a state where a Web page is displayed on the multi-function television. In an example of sharing a Web page, (a) is a flowchart showing a process flow in the multifunction TV 10T on the transmission side, and (b) is a flowchart showing a process flow in the multifunction TV 10T on the reception side. FIG. 11 is a display screen diagram illustrating an example of a state where pointing is performed in a state where a moving image is displayed in the multi-function television. In the example of sharing moving image data on the network, (a) is a flowchart showing the flow of processing in the multifunction TV 10T on the transmission side, and (b) is a flowchart showing the flow of processing in the multifunction TV 10T on the reception side. . In another example of sharing moving image data on a network, (a) is a flowchart showing a process flow in the multi-function TV 10T on the transmission side, and (b) is a flowchart showing a process flow in the multi-function TV 10T on the reception side. It is. FIGS. 7A to 7E are display screen diagrams showing display examples when the mark is moved in accordance with the moving image in the multi-function TV 10T. In the example of the process of deleting the mark, (a) is a flowchart showing a process flow in the multi-function TV 10T on the transmission side, and (b) is a flowchart showing a process flow in the multi-function TV 10T on the reception side. In another example of the processing for deleting the mark, (a) is a flowchart showing the flow of processing in the multifunction TV 10T on the transmission side, and (b) is a flowchart showing the flow of processing in the multifunction TV 10T on the reception side. . It is a display screen figure which shows the example of a display at the time of displaying the locus | trajectory of the movement of a mark in the form of a broken line arrow. It is a figure which shows the example which communicates the movement of a landmark by sequential transmission mode. It is a figure which shows the example which communicates the movement of a mark by fixed information transmission mode. FIGS. 4A to 4E are display screen diagrams showing display examples when the display mode of the mark is changed according to the moving direction and moving distance of the mark. In the multi-function TV on the receiving side, a flowchart showing a flow of processing for recognizing an object indicated by the mark information first instructed from the transmitting side, and then following the mark based on the image recognition result. is there. It is a flowchart which shows the flow of a process in multifunctional television 10T of the receiving side in the case of displaying a mark based on locus | trajectory information. (A)-(e) is a display screen figure which shows the example of a display when the mark is moved according to a moving image in the said multifunctional television 10T.

Explanation of symbols

1 Control unit 2 ROM
3 RAM
4 Display section 4a Effective display area 5 Input section (input reception section)
5a Dial button 6 Voice processing unit 6a Reception unit 6b Transmission unit 7 Communication unit 7a Antenna 10 Portable telephone (information communication terminal)
10T Multi-function TV (information communication terminal)
11. Mark information creation part (mark information creation means)
12 Display control unit (display control means)
13 Communication control unit (communication control means)
14 Mark Information Movement Control Unit (Mark Information Movement Control Unit)
20a Display unit (transmission side)
20b Display unit (receiving side)
21b Effective display area (receiving side)
21a Effective display area (transmission side)
22 Dial button 23a Mark (Sender)
23b Placement (receiving side)
31 Arrow (Mark)
32 Cross (Mark)
33 Circle (marker)
34 Square (Mark)
70a Display section (transmission side)
71a Mark (Sender)
72a Divided grid line 70b Display section (receiving side)
71b Placement (receiving side)
80a Display section (transmission side)
81a Mark (Sender)
82a Divided grid line 80b Display unit (receiving side)
81b Mark (receiving side)
120a Display unit (transmission side)
121a Placemark (Sender)
122a Divided grid line 120b Display unit (receiving side)
121b Placement (receiving side)
130a Display unit (transmission side)
131a Mark (Sender)
132a Divided grid line 130b Display unit (receiving side)
131b Placement (receiving side)
201 TV broadcast receiving unit 202 Camera 203 Channel setting unit (channel setting means)
204 Network content receiving unit (network content receiving means)
205 Image information storage unit 206 Image information storage unit

Claims (29)

Information is communicated between a display unit that displays an image based on image information on a display screen, a key input receiving unit having a plurality of key input operators that receive input operations by a user, and another information communication terminal. An information communication terminal comprising a communication unit,
Each of the plurality of key input operators is associated with each area obtained by dividing a specific area in the display screen.
Mark information creating means for creating, as mark information, area designation information indicating an area obtained by dividing the specific area associated with the key input operator that has received an input from the user;
An information communication terminal comprising: communication control means for controlling the communication unit so as to transmit the mark information to another information communication terminal.   The apparatus further comprises display control means for controlling the display unit so as to display a mark in an area obtained by dividing the specific area associated with the key input operator that has received an input from the user. The information communication terminal according to claim 1.   The information communication terminal according to claim 1, wherein the area designation information is input operation information that is information indicating a key input operator that has received an input from the user.   3. The information communication terminal according to claim 1, wherein the area designation information is coordinate information that is information indicating a display position of the mark. The landmark information creation means creates landmark mode information that is a display mode of the landmark,
5. The communication unit according to claim 1, wherein the communication control unit controls the communication unit to transmit the mark mode information as mark information to another information communication terminal. Information communication terminal. The landmark information creation means creates landmark mode information that is a display mode of the landmark,
The communication control means controls the communication unit to transmit the mark mode information as mark information to another information communication terminal,
When the key input receiving unit receives an input to a predetermined key input operator included in the key input operator,
The mark information creating means changes the display mode of the mark,
The information communication terminal according to claim 2, wherein the display control unit displays a mark whose display mode has been changed on the display screen. When the key input receiving unit receives an input to a predetermined key input operator included in the key input operator,
The landmark information creating means determines the display mode of the landmark,
The information communication terminal according to claim 6, wherein the display control means displays a mark whose display mode is determined on the display screen. The input to the key input operator can be further switched between a function for designating an area for displaying the mark and a function for moving the display position of the mark.
Mark information movement control means for moving the position of the mark by the operation of the key input operator of the user;
The communication control means controls the communication unit so as to transmit mark movement information indicating movement of the position of the mark as mark information to another information communication terminal. The information communication terminal according to any one of the above.   The mark movement amount is switched in stages for each input when the key input receiving unit receives an input to a predetermined key input operator included in the key input operator. The information communication terminal described in 1. The input to the key input operator can be further switched between a function for designating an area for displaying the mark and a function for moving the display position of the mark.
Mark information movement control means for moving the position of the mark by the operation of the key input operator of the user;
The communication control means controls the communication unit so as to transmit to the other information communication terminal, as mark information, mark movement information indicating movement of the position of the mark,
The information communication terminal according to claim 2, wherein the display control means switches the display mode of the mark when the input to the key input operator is switched to the mark moving function.   11. The information according to claim 1, wherein the communication control unit has a sequential transmission mode in which the mark information is transmitted each time the key input operator is pressed. Communication terminal.   The information communication terminal according to claim 1, wherein the communication control unit has a confirmation information transmission mode in which the landmark information is transmitted after the landmark information is confirmed.   The information communication terminal according to any one of claims 1 to 12, wherein the communication control means transmits the mark information together with voice data of a call.   The information communication terminal according to any one of claims 1 to 12, wherein the communication control means transmits the mark information using a DTMF signal.   The information communication terminal according to any one of claims 1 to 12, wherein the communication control means transmits the mark information as data consisting of voice.   The information communication terminal according to claim 2, wherein the display control means displays a divided grid line on the display screen.   When the mark information creating means performs the input operation of the key input operator by the user, an area obtained by dividing the specific area associated with the input key input operator is set as a first divided area. In addition, when the key input operator is input by the user, the first divided area is set as the specific area, and the area associated with the input key input operator is divided into the second area. The information communication terminal according to any one of claims 1 to 16, wherein the information communication terminal is set as an area, and area designation information indicating the second divided area is created as landmark information. A display unit that displays an image based on image information on a display screen, an input receiving unit that includes an input operator that receives an input operation by a user, and a communication unit that communicates information with other information communication terminals. An information communication terminal provided,
Display control means for controlling the display unit so as to display a mark on the display screen;
Mark information movement control means for moving the position of the mark based on the input operation received by the input receiving unit;
Mark information generating means for generating, as mark information, locus information indicating the locus of the display position of the mark moved by the mark information movement control means, and mark aspect information indicating the display aspect of the mark,
An information communication terminal comprising: communication control means for controlling the communication unit so as to transmit the mark information to another information communication terminal. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive landmark information from the information communication terminal according to any one of claims 1 to 18,
An information communication terminal comprising: a display control unit configured to control the display unit so as to display a mark on the display screen based on the received mark information.   When the display control means displays a mark based on the mark information received from the information communication terminal on the transmission side via the communication unit, the display control means also receives information on display conditions in the information communication terminal on the transmission side. The information communication terminal according to claim 17, wherein the display position of the mark is adjusted. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive landmark information from the information communication terminal according to claim 6;
Based on the area designation information in the received mark information on the display screen, the display unit is controlled to display the mark in the corresponding area, and based on the mark mode information in the received mark information, the mark of the corresponding mode An information communication terminal comprising display control means for controlling the display unit so as to display a message. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive landmark information from the information communication terminal according to claim 8;
When the received landmark information is area designation information, the display section is controlled to display the landmark in the corresponding area on the display screen based on the area designation information, and the received landmark information is the landmark designation information. In the case of movement information, the display screen is provided with display control means for controlling the display unit so as to display a mark in a corresponding area based on the mark movement information. Communication terminal. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive landmark information from the information communication terminal according to claim 9;
When the received landmark information is area designation information, the display section is controlled to display the landmark in the corresponding area on the display screen based on the area designation information, and the received landmark information is the landmark designation information. In the case of movement information, the display screen is provided with display control means for controlling the display unit so as to display the mark in the corresponding area based on the mark movement information and the movement amount of the mark. An information communication terminal characterized by. An information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with other information communication terminals,
Communication control means for controlling the communication unit so as to receive landmark information from the information communication terminal according to claim 18;
Based on the trajectory information in the received landmark information, the display unit is controlled to move and display the landmark on the display screen, and the landmark of the corresponding aspect is displayed based on the landmark aspect information in the received landmark information. An information communication terminal comprising display control means for controlling the display unit as described above.   The display control means controls the display unit to change and display the display mode of the mark according to the moving direction and / or the moving amount of the mark indicated by the trajectory information. Item 25. The information communication terminal according to Item 24. Information is communicated between a display unit that displays an image based on image information on a display screen, a key input receiving unit having a plurality of key input operators that receive input operations by a user, and another information communication terminal. A terminal control method for an information communication terminal comprising a communication unit,
Each of the plurality of key input operators is associated with each area obtained by dividing a specific area in the display screen.
Mark information creating means, as mark information, creating area designation information indicating an area obtained by dividing the specific area associated with the key input operator that has received an input from the user;
And a step of controlling the communication unit so that the communication control means transmits the mark information to another information communication terminal. A terminal control method for an information communication terminal comprising: a display unit that displays an image based on image information on a display screen; and a communication unit that communicates information with another information communication terminal.
A step of controlling the communication unit so that the communication control means receives the landmark information from the information communication terminal according to any one of claims 1 to 18;
A display control means comprising: a step of controlling the display unit so as to display a mark on the display screen based on the received mark information. A terminal control program for operating the information communication terminal according to any one of claims 1 to 25,
A terminal control program for causing a computer to realize the above means.   A computer-readable recording medium on which the terminal control program according to claim 28 is recorded.

Images