JP2006085721A - Virtual operation system for lunar surface probe - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a virtual operation system executing a virtual operation of a lunar surface probe through the Internet from a home personal computer. <P>SOLUTION: This lunar surface probe 800 is provided with: a traveling part 801; a vehicle body 802; a sensor pole 803 visual sensor 804, an arm 805 for sampling; a sample storing part 806; and an antenna 807. An imaging device 619 is provided in a position where the lunar surface probe 800 is shot. An image by the imaging device is displayed on a virtual operation screen 900. Various manual operation buttons are arranged in a virtual operation window, and an operation signal thereof operates the lunar surface probe 800 by remote control through a server 610. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

The present invention relates to a lunar explorer virtual operation technique for operating a lunar explorer via a network such as the Internet.

In recent years, online sales systems such as mail order systems using the Internet have appeared, and various types of merchandise are being traded.
In mail order sales using the Internet, you can specify the URL of a mail order site established by an online mail order company from a user terminal and select a product category option on a Web page displayed on the terminal. Etc. are displayed, and the user can order a desired product. The product displayed on the terminal is made up of photographs taken from various angles, and depending on the product (for example, an electronic device), an operation method or a display example may be displayed.

In addition, the home appliances are simulated on the homepage using the Internet, and the simulated operations of the home appliances are simulated on the homepage according to the operation of the consumer. There is what was made to perform (for example, refer to patent documents 1).

  On the other hand, there is a remote control (remote control technique) as a technique for operating a device or the like from a remote place without touching it directly. The remote control system steers the steered device by an operator's remote operation by wired, wireless or mechanical transmission, and directly operates the device. In other words, you can start and stop the steered device directly by remote control (for example, TV switch, channel selection, video tape fast forward, rewind, manufacturing of goods, etc.), run or transport from the outside. In addition, it is possible to perform shooting, and further, it is possible to correct the orbit of the artificial satellite by jetting a rocket from a remote place or to operate the robot.

In addition, the vehicle body, two shafts that support the vehicle body, and the centers of the shafts are attached to both ends, four arms that can be rotated around the shaft by a built-in motor, and attached to the tips of the arms, Proposed lunar exploration vehicles that each have 8 built-in motors with built-in motors and can be driven independently, and can travel on slopes, steps, and sand that are difficult to drive with only the drive wheels. (For example, refer to Patent Document 2).
JP 2002-74086 A JP 09-272473 A

However, product display on online shopping and virtual malls is only for indirectly displaying products, and customers look at products from a desired angle or touch the actual product as in normal store sales. Since it is not a thing, there is a problem that the user can recognize the shape and color of the product, but cannot perceive the function and operation of the product sensuously.

The present invention has been made to solve the above-mentioned problems, and is a virtual operation system capable of virtually operating the lunar surface probe as if the real object was touched or moved from a personal computer at home via the Internet. The purpose is to provide

In order to solve the above-mentioned problem, the invention according to claim 1 is a virtual operation system in which a plurality of users can virtually operate a lunar explorer operable on the moon or an exhibition hall, The operation data of the lunar explorer and the imaging device are received via the communication network and the probe and output operation instruction signals of the lunar explorer and the imaging device, and the lunar explorer that operates based on the operation instruction signal A server that acquires video data and audio data and transmits it to the user terminal, an imaging device that images the lunar surface probe based on an operation instruction signal from the server, and transmits the video data acquired by the imaging to the server; The operation data of the lunar probe is transmitted to the server via the communication network, and the image of the lunar probe that operates according to the operation data is displayed and the sound accompanying the operation of the lunar probe is output. A lunar explorer having a drive unit that operates based on an operation instruction signal from the server, and the server from a user terminal that performs a virtual operation of the lunar explorer Operation data receiving means for receiving the transmitted operation data of the lunar explorer, operation instruction signal means for outputting operation instruction signals of the lunar explorer and the imaging device based on the received operation data, and the operation instructions A data acquisition means for acquiring video data and acoustic data of a lunar explorer that operates based on the signal; and a data transmission means for transmitting the acquired video data and acoustic data to the user terminal. The operation data transmitting means for transmitting operation data of the lunar probe to the server, the receiving means for receiving video data and acoustic data of the lunar probe transmitted from the server, and the received video Operation data, display means for displaying the image of the lunar probe based on the data, and sound output means for outputting sound accompanying the operation of the lunar probe based on the received acoustic data. The transmission means includes means for transmitting operation data to the server based on the operation result of the operation instruction key by the user, and the display means includes a video display area for displaying the image of the lunar surface explorer and the lunar surface explorer. A screen having an operation instruction area for displaying a plurality of operation instruction keys, a means for displaying an image of a lunar explorer operating by a virtual operation by a user terminal, and a virtual lunar explorer Means for displaying an image of a lunar explorer operating by operation of another user terminal when the operation is performed by another user terminal. A virtual operation system .
This makes it possible to operate a lunar explorer that many people want to operate, but in reality it is rare and has limited opportunities for operation from a terminal such as a personal computer at home via the Internet. Can be widely introduced by methods other than the method of use that is displayed at museums and exhibition halls, and can contribute to the understanding of the operation of the lunar search machine and the state of the lunar surface for more people.
In addition, since the user terminal displays the image of the lunar surface probe on a part of the screen and displays the operation instruction keys etc. on other parts of the screen, the user can view the image of the lunar surface probe and operate it. Key operations can be performed while listening to the accompanying sound, so the user can virtually operate the lunar explorer as if it were moving.
In addition, since it is possible to display the image of the lunar probe that is operating by the operation of other user terminals, it is possible to view the operation status of the lunar probe on the terminal side that competes for access, Dissatisfaction is resolved and access rush can be mitigated.

  Further, in the invention according to claim 2, the server includes means for receiving operation data of the lunar explorer transmitted from a terminal other than the terminal performing the virtual operation of the lunar explorer, 2. The virtual operation system according to claim 1, wherein the data transmission unit includes a broadcast transmission unit that broadcasts the video data and the audio data acquired by the data acquisition unit to another terminal. .
As a result, the video and audio of the lunar explorer operating from the server to the competing terminal are broadcast to the competing terminal that has accessed, and the operational status of the lunar explorer is viewed on the competing terminal. Therefore, the waiting dissatisfaction is solved and the access rush can be eased.

  Further, in the invention according to claim 3, the user terminal further includes a virtual lunar explorer using its own user terminal when a virtual operation of the lunar explorer is performed by another user terminal. 2. The virtual operation system according to claim 1, further comprising competition state notification means for notifying the order and waiting time until the operation becomes possible.
As a result, the waiting information such as the order and waiting time can be notified on the competing terminal side, so the user of the competing terminal can browse the atmospheric information and decide whether to wait or to stop and access again later As a result, access rush can be further eased, and competition between terminals can be avoided.

According to the present invention, a lunar explorer that is intended to be operated by many people but is rare in reality and has limited installation locations, such as limited installation opportunities, can be used to connect the Internet to a home or the like. Since the virtual operation can be performed from a terminal such as a personal computer, the lunar explorer can be widely introduced, and more people can understand the device.

[Embodiment (1)]
FIG. 1 is a diagram showing an example of the configuration of an online sales system according to the present invention.
The mail order site 1 is provided on the server 10, and the user 3 browses and selects products displayed in the (virtual) exhibition corner of the mail order site 1 on the terminal 30 from the terminal 30 connected to the Internet 2.・ You can place an order. At this time, the user 3 can perform an operation simulation of the product displayed on the desired display corner by an operation from the terminal 30.

  When the user 3 performs an ordering operation from the terminal 30, the mail-order sales site 1 confirms the stock, and if there is a stock, the user 3 receives an order for the user 3 and issues a delivery instruction to the distribution center 5. The delivery center 5 delivers the ordered product to the delivery destination designated by the user 3 (actually entrusts the delivery to the shipping company). If there is no stock, a reservation is accepted.

  The server 10 is a server computer provided with a mail-order sales site 1 according to the present invention, and is operated by a mail-order company or a contractor that performs mail-order sales. The server 10 performs membership registration processing for mail order service member registration applicants, receives mail order product display requests from the terminal 30 via the Internet 2 by the mail order service user 3, and product operations based on the received operation requests. Control, display of transaction conditions, order processing of ordered products, inventory confirmation, shipping instruction, etc. are performed.

  The terminal 30 includes a personal digital (data) assistant (PDA) such as a personal computer or a mobile phone, and includes a display device so that it can be connected to the Internet 2. The terminal 30 may be a stationary terminal for virtual experience installed in a convenience store or the like.

  Further, in the embodiment, Internet browser software (WWW browser) is installed in the terminal 30, and the operation state of the product displayed by the information sent from the server 10 or the product operated by the virtual operation instruction is displayed by the WWW browser. You can browse. Further, the terminal 30 can be dial-up connected to the server 10 via the Internet 2 simply by selecting the “mail order service” home page.

  Further, the bank 4 notifies the mail order site 1 of the payment result of the sales price by facsimile or electronic mail. The distribution center 5 includes a terminal connected to the server 10 via the Internet 2 or a dedicated line, and transmits necessary information to the server 10 in response to an inventory check request or inquiry (transmission request) from the server 10. In addition, a credit company and a mail order site can be connected via a network so that credit can be sold.

  Further, the distribution center 5 receives a shipping instruction from the server 10 at a terminal via the Internet 2 or by a facsimile machine. Further, when the goods and the price are exchanged at the time of delivery, that is, in the case of cash on delivery, the cash received by the deliverer is collectively transferred to the account of the mail order site operator at the delivery center 5.

  The server 10 has a countermeasure such as a firewall against leakage of information or hacking, and has a high security and privacy protection function. Further, it is configured to prevent spoofing in the transmission / reception of information between the server 10 and the terminal 30.

  FIG. 2 is a diagram illustrating a configuration example of each function and database of the server, and FIG. 3 is a diagram illustrating a configuration example of records stored in each file stored in the database.

  The server 10 includes a control unit 11 and peripheral devices, and exchanges data with a terminal connected to the Internet 2 and other computers via the Internet 2. As a function for executing the mail order service of the present invention, As shown in FIG. 2 (a), a terminal connected to the Internet 2 and a communication control means 20 for controlling transmission / reception of data via the Internet 2 and an HTML file for controlling transmission of an HTML file to the terminal The transmission control means 21, CGI (Common Gateway Interface) 22 which passes operation data received from the WWW browser to the application below the product-specific simulation means 23 and returns the processing result of the application such as the product-specific simulation means 23 to the WWW browser, the user 3 Based on the operation of the terminal 30 of Product simulation means 23 (23-1 to 23-n) for simulating the operation and the like of the products displayed on the trust sales site 1, member registration means 24 for setting user registration for mail order service, and authenticating the user Authentication means 25, merchandise management means 26 for managing the number of merchandise in stock and sales by product, sales management means 27 for managing sales by member, deposit processing means 28 for performing deposit processing by member, and distribution center 5. Delivery instruction means 29 for giving delivery instructions and the like are provided.

  Each means is constituted by a program and is stored in a program storage memory (not shown) of the server 10 and is taken out and controlled by the control unit 11 to execute each process.

  Further, the server 10 includes a database 12, and the database 12 has initial conditions, threshold values, limit values, and operations for each product for each product simulation means 23-1 to 23-n, as shown in FIG. An operation setting file 41 (41-1 to 41-) in which buttons, drive signal input units or signal input terminals are associated with operation buttons, drive signal input units or signal input unit positions (or numbers) provided in the HTML file. n) Membership registration file for registering product-specific HTML file group 42 (42-1 to 42-n) in which SSI (Server Side Include) is embedded, user information acquired by member registration means 24, authentication code, and the like 43, a product management file 44 for managing the number of stocks of each product and the sales amount by product, a sales management file 45 for storing sales status and payment status for each member, members Separately, a transaction data file 46 storing individual product sales and reservation results for each member, a simulation data file 47 (47-1 to 47-m) storing simulation data such as stereo music data, etc. Storing.

  The operation setting file 41 is accessed by the product simulation unit 23 described above, and the product simulation unit 23 takes in the operation setting data corresponding to the product and sets it as an initial value.

  The SSI embedded in the product-specific HTML file 42 is executed and controlled by the control unit 11 before transmission of the HTML file group 42 to the terminal 30, and the result is embedded in the product-specific HTML file group 42 and transmitted to the terminal 30. It is displayed with 30 WWW browsers.

    The member registration file 43 is accessed by the member registration unit 24, the authentication unit 25, and the delivery instruction unit 29. The product management file 44 is accessed by the product management means 26. The sales management file 45 is accessed by the sales management means 27 and the deposit processing means 28. Further, the transaction data file 46 is accessed by the sales management means 27 to store the order result, and is accessed by the deposit processing means 28 and the delivery instruction means 29.

FIG. 3 is a diagram showing a configuration example of records of each file stored in the database 12.
As shown in FIG. 3A, the operation setting file 41 includes a product identification code 411 composed of a product type code and a number, if there is simulation data, the start address 412 of the data file, and the set value 413-1 for each product. An operation setting record 410 storing 413-n is stored.

  The product type code is, for example, a code for identifying a product such as “digital camera”, “stereo”, or “computer”, and the number is a number assigned to identify the manufacturer or model of the product. The product type code and the number (that is, the product identification code 412) are internal codes. When there is no simulation data, a space is stored at the position of the start address 412 of the simulation data file. Further, the number n of the set values 413-1 to 413-n varies depending on the product. In the embodiment, the fixed-length record is set to n ≦ 15, but the present invention is not limited to this. In the case of n <15, blanks (spaces) are stored at positions after n + 1.

  As shown in FIG. 3B, the member registration file 43 includes a member registration record 430 storing a member registration number 431, basic information 432 such as a member's name and address, an authentication code (password) 433, and an email address 434. Remember me.

  Further, as shown in FIG. 3C, the product management file 44 includes a product identification code 441, a transaction unit 442, a unit price 443, an inventory quantity 444, an order backlog 445, a reservation quantity 446, a product name 447, a delivery date 448, and the like. It stores a product management record 440 that stores product management information.

  As shown in FIG. 3D, the sales management file 45 stores a sales management record 450 that stores a member registration number 451, a management month 452, the number of sales 453, a sales amount 454, a deposit amount 455, an accounts receivable 456, and the like. It becomes. Further, as shown in FIG. 3 (e), the transaction data file 46 includes a member registration number 461, a transaction classification 462 for sorting orders, reservations, and sales, transaction dates (in the case of sales, the order date, in the case of reservation, the reservation date). 463, the transaction data 460 storing the product identification code 464, the number 465, the unit price 466 and the sales amount 467, the delivery cost 468, the delivery date 469, the delivery location 470, etc. of the product that has been sold or reserved.

  Also, the simulation data file 47 not shown in FIG. 3 is an input content necessary for the operation when the product is operated by the product simulation means 23, for example, an LP board or CD required when the player is operated. Music data such as the above, and image data exemplified when image processing is performed on a personal computer. The simulation data file 47 may be unnecessary depending on the product or common to the product (that is, It is not necessarily a one-to-one correspondence with each product). The format is defined by the type of data, and the product simulation means 23-i using the simulation data file 47-i individually defines the format of the simulation data file within the program.

 FIG. 4 is a process chart showing the basic operation of the online sales system by the virtual transaction site of the present invention, and FIG. 5 is a view showing an embodiment of the online sales Web page displayed on the user's terminal.

Process P1: (Homepage display)
When a connection request to the “online sales site” is issued from the user terminal 30 by URL input or link button operation to the “online sales” site, and the terminal 30 and the server 10 are connected via the Internet 2, the server 10 The HTML file transmission control means 21 transmits the homepage HTML file to the terminal 30.
The WWW browser of the terminal 30 receives the homepage HTML file from the server 10, displays the homepage 150 as shown in FIG. 5A, and encourages new users to join a network mail order member. The user is prompted to click the new registration button 151. In addition, the registered member is urged to click the button 152 to shift to the authentication screen.

Process P2: (screen display for new member registration and new member registration)
When the user clicks the button 151, the WWW browser transmits corresponding data to the server 10. The CGI 22 passes the data received by the server 10 to the HTML file transmission control unit 21, and the HTML file transmission control unit 21 transmits the HTML file for new member registration Web page to the terminal 30.
The WWW browser of the terminal 30 receives the HTML file for new member registration Web page from the server 10 and displays a new member registration Web page 160 as shown in FIG. The input is prompted, and when the input is completed, the input data is transmitted to the server 10.

  The CGI 22 passes the member registration input data received by the server 10 to the member registration unit 24, and the member registration unit 24 generates a member registration record 430 based on the input data and registers (stores) it in the member registration file 43. Further, the member registration means 24 passes the member number stored in the member registration record 430 to the CGI 22, and the CGI 22 transmits the member number to the terminal 30.

The WWW browser of the terminal 30 displays the member registration number from the server 10 on the new member registration Web page 160, prompts a new user's memo and confirmation input, and transitions to P3 when the confirmation input ends.
In addition to the personal identification number, the member registration information input by the new user includes basic information such as the person's address, name, phone number, and e-mail address.

Process P3: (Member authentication screen display and authentication)
When the confirmation input in the process P2 is completed, the WWW browser of the terminal 30 transmits registration confirmation data to the server 10. The CGI 22 passes the registration confirmation data received by the server 10 to the HTML file transmission control unit 21, and the HTML file transmission control unit 21 transmits the HTML file for the member authentication Web page to the terminal 30.
The WWW browser of the terminal 30 receives the HTML file for the member authentication Web page from the server 10, displays the member authentication Web page 170 as shown in FIG. 5C, and prompts for the input of the member registration number and the password. When the input is completed, the input data is transmitted to the server 10.
The CGI 22 of the server 10 passes the received input data for member authentication to the authentication unit 25. The authentication unit 25 searches the member registration file 43 based on the member registration number in the input data, and the authentication code 433 of the hit record. And the password number in the input data are compared, and if they match, the process proceeds to P4. If they do not match, a message indicating failure of authentication is passed to the CGI 22, and the CGI 22 transmits a message indicating failure of authentication to the terminal 30.

Process P4: (Exhibition of merchandise group and merchandise group selection)
When the member is authenticated in the process P 3, the authentication unit 25 passes control to the HTML file transmission control unit 21, and the HTML file transmission control unit 21 transmits the handling product group exhibition Web page HTML file to the terminal 30.
The WWW browser of the terminal 30 receives the HTML file for the handling product group display Web page from the server 10 and displays the handling product group display Web page 180 as shown in FIG. When the selection is completed, the product type code of the selected product group is transmitted to the server 10.

  Here, a product group is a product type such as a personal computer, digital camera, word processor, stereo, bicycle, furniture, clothing, cosmetics, etc. In the case of a camera, it means a display product of a product group such as a digital camera, and is indicated by characters, images (representative product images) or illustrations (indicated by characters in the example of FIG. 5D). At this time, the number of types of products and the manufacturer may also be displayed. In addition, in the handling product group exhibition Web page, a product type code is associated with each representative product, and when the product group name (or image or illustration) is clicked, the WWW browser displays the product type code of the representative product on the server 10. Send to. When the end button 181 is clicked, the screen is closed and the process is terminated.

Process P5: (Product display in group and selection of individual products)
When the server 10 receives the product type code transmitted from the terminal 30 in the process P4, the CGI 22 passes the product type code to the HTML file transmission control unit 21, and the HTML file transmission control unit 21 corresponds to the product type code. An HTML file for in-group product display Web page that can display the product group is transmitted to the terminal 30.

  The WWW browser of the terminal 30 receives the HTML file for in-group product display Web page from the server 10 and displays the in-group product display Web page 190 as shown in FIG. Prompts the user to select an individual product. When the selection is completed, the product identification code of the selected product is transmitted to the server 10. Clicking the return button 191 returns to P4, and clicking the end button 192 closes the screen and ends the process.

  Here, the products in the product group to be displayed are indicated by characters (product names), images, illustrations, or the like (in the example of FIG. 5E, they are indicated by characters). At this time, the number of items in stock, the price, etc. may be displayed. In addition, a product identification code is internally associated with each product, and when the product name is clicked, the WWW browser transmits the product identification code of the product to the server 10.

Process P6: (Exhibition of selected product and selection of virtual motion, etc.)
When the server 10 receives the product identification code transmitted from the terminal 30 in the process P5, the CGI 22 passes the product identification code to the HTML file transmission control unit 21, and the HTML file transmission control unit 21 corresponds to the product type code. The individual product display Web page HTML file for displaying the product is extracted from the product-specific HTML file group 42 in the database 12 and transmitted to the terminal 30.

  When the WWW browser of the terminal 30 receives the HTML file for the individual product display Web page from the server 10, the individual product display Web page 200 (stereo in this example) as shown in FIG. 5F is displayed and displayed. The necessity of virtual operation, the availability of product ordering, etc. are selected for the product being sold.

  In FIG. 5 (f), reference numeral 201 denotes an order button, 202 denotes a virtual action selection button, 203 denotes a return button, and 204 denotes an end button. When the user clicks the order button 201, a transition is made to P7, and virtual When the operation selection button 202 is clicked, the process transits to P11, when the return button 203 is clicked, the process returns to P5, and when the end button 204 is clicked, the processing of the mail order system is ended and the screen is closed (however, the end button is displayed in the virtual operation of the process P12) If 204 is clicked, it returns to this process (P6)).

  The product is displayed as an image, and the manufacturer, standard, function, price, installation condition, delivery condition, etc. are displayed in a window. Further, at this time, when the user clicks on a part of the product, the name of the part, the operation method, etc. are displayed or output as audio. The product is displayed as an image, and the manufacturer, standard, function, price, installation condition, delivery condition, etc. are displayed in a window.

Process P7: (Order screen display)
When the order button 201 is clicked in the process P6, the WWW browser transmits order determination data including the member registration number and the product identification code to the server 10.

  When the server 10 receives the order determination data, the CGI 22 first passes control to the HTML file transmission control means 21, and the HTML file transmission control means 21 transmits the product ordering Web page HTML file to the terminal 30. The WWW browser of the terminal 30 receives the product ordering Web page HTML file from the server 10 and displays a product ordering Web page 210 as shown in FIG.

Next, the CGI 22 passes the product identification code of the received order determination data to the product management means 26 and passes the member registration number to the sales management means 27.
The merchandise management means 26 searches the merchandise management file using the merchandise identification code as a key, and checks the inventory quantity 444 of the hit merchandise management record 440. The unit price 443 is passed to the CGI 22, and the CGI 22 passes control to the sales management means 27. Further, when the number of stocks 444 = 0, a message asking that the stock is insufficient and whether reservation is possible is passed to the CGI 22, and the CGI 22 passes control to the sales management means 27.

  The sales management means 27 searches the member registration file 43 based on the member registration number, extracts the address from the basic information 432 of the hit member registration record 430, and passes it to the CGI 22. The CGI 22 transmits the message and the orderer's address to the terminal 30. Note that when the stock quantity 444> 0, the stock quantity may be passed to the CGI 22 and transmitted to the terminal 30.

  The WWW browser of the terminal 30 displays the received message and the orderer's address, transaction unit, and unit price on the product ordering Web page 210, and prompts a purchase contract (ordering = purchase application) operation for the selected product.

In the product ordering Web page 210, reference numeral 211 denotes an order quantity input field, and reference numeral 212 denotes a payment method designation field. The user clicks and selects either bank transfer or cash on delivery. In addition, you may comprise so that credit payment can be selected. In this case, however, it is necessary to provide a step for checking the credit number and the like in the next process P8 by providing a credit number and password input field on the product ordering Web page 210.
Reference numeral 213 denotes a delivery location input field, which displays the user's address received from the server 10, but can be changed by the user. Reference numeral 214 denotes a desired delivery date input field, and reference numeral 215 denotes a delivery date display field. When delivery is not possible on the input delivery date, a delivery date is displayed. Reference numeral 216 denotes a message display field. Reference numeral 217 denotes a confirmation button. When the user clicks after the input to each input field is completed, the ordering data is transmitted to the server 10. Reference numeral 218 denotes a reservation button, and when clicked, the process proceeds to process P10. Reference numeral 219 denotes a return button, which is clicked to return to the individual product display Web page 200 of the process P6. Reference numeral 220 denotes an end button which, when clicked, ends the mail order system processing and closes the screen.

Process P8: (Order (purchase) processing)
When the user clicks the confirmation button 217 after completing the input in each input field, the WWW browser sends the ordering data including the member registration number, the product identification code of the ordered product, the ordered quantity, the delivery location, and the desired delivery date to the server 10. Send. In this case, the product ordering Web page 210 is not cleared, and the display of each input column and display column is retained.

The CGI 22 passes the product identification code, the order quantity (= order quantity) and the desired delivery date of the order data received by the server 10 to the product management means 26 and the member registration number to the sales management means 27.
The merchandise management means 26 searches the merchandise management file using the merchandise identification code as a key, compares the stock quantity 444 of the hit merchandise management record 440 with the order quantity (= order quantity), and if the stock quantity 444 ≧ order quantity, the current quantity The desired delivery period (number of days) is calculated from the date of delivery and the desired delivery date, and compared with the delivery date 448. If the delivery date ≥ the desired delivery period, the order message and confirmation request message are sent to the CGI 22 as delivery date = desired delivery date. Then, the CGI 22 transmits a message addressed to the terminal 30. Note that the order data is held in the server 10.

If the number of delivery days <the desired delivery period, the delivery date is calculated, a delivery date change request message including the delivery date is passed to the CGI 22, and the CGI 22 sends a message to the terminal 30. Similarly, the order data is held in the server 10.
Further, when the stock quantity 444 <order quantity received, the shortage quantity order quantity−the stock quantity 444 is calculated, whether the stock shortage, the stock quantity, the message including the shortage quantity, and the stock quantity are ordered and whether the shortage quantity is reserved. The CGI 22 sends a message asking the terminal 30 to the terminal 30.

Process P9: (Order confirmation and order processing)
The WWW browser of the terminal 30 displays the received message in the message display field 216 of the contract condition Web page 210 (however, the delivery date is displayed in the delivery date display field 215) and prompts an operation corresponding to the message.
When the user clicks the confirmation button 217, the WWW browser transmits order confirmation data to the server 10. In addition, when the user clicks a delivery date displayed in the delivery date display field 215 or inputs a delivery desired date later than the delivery possible date and then clicks the confirmation button 217, the WWW browser displays the delivery date (desired delivery date). ) Is sent to the server 10. Further, when the user corrects the order quantity and clicks the confirmation button 217, the WWW browser transmits correction data including the order quantity to the server 10. Further, when the reservation button 218 is clicked, a transition is made to P10.

  When the server 10 receives the order confirmation data, the CGI 22 passes the product identification code and the order quantity (= order quantity) out of the order data held in the server 10 to the merchandise management means 26, and the member registration number and the merchandise of the ordered merchandise. The identification code, order quantity, delivery location, and delivery date are passed to the sales management means 27.

  The merchandise management means 26 searches the merchandise management file using the merchandise identification code as a key, updates the inventory quantity by subtracting the order quantity from the inventory quantity 444 of the hit merchandise management record 440, retrieves the unit price 443, and stores it in the memory. Control is passed to the sales management means 27.

  The sales management means 27 receives the member registration number as the member registration number 461, the code indicating “sales” as the transaction classification 462, the current date as the transaction date 463, the received product identification code as the product identification code 464, and the received order. Transaction with quantity 465, unit price held in memory unit price 466, quantity 465 × unit price 466 as order value 467, received delivery date and delivery location as delivery date 469, delivery location 470, and delivery cost 468 added Data is generated and stored in the transaction data file 46, and necessary information such as completion of the order and a cooling off period is passed to the CGI 22. The CGI 22 transmits a message and necessary information to the terminal 30.

  The WWW browser of the terminal 30 displays the received message and necessary information in the message display field 216 of the contract condition Web page 210. When the user clicks the return button 219, the process returns to the individual product display Web page 200 of process P6. When the end button 220 is clicked, the mail order system processing is ended and the screen is closed.

Process P10: (reservation process)
When the user clicks the reservation button 218 after inputting in the input fields in step P7 or P9, the WWW browser of the terminal 30 includes the member registration number, the product identification code of the ordered product, the ordered quantity, the delivery location, and the desired delivery date. The reservation data is transmitted to the server 10.

  When the server 10 receives the reservation confirmation data, the CGI 22 passes the member registration number, the product identification code of the ordered product, the ordered quantity, the delivery location, and the desired delivery date to the sales management means 27.

  The sales management means 27 receives the member registration number as the member registration number 461, the code indicating “reservation” as the transaction classification 462, the current date as the transaction date 463, the received product identification code as the product identification code 464, and the received order. Transaction with quantity 465, unit price held in memory unit price 466, quantity 465 × unit price 466 is reserved amount 467, received delivery date and delivery location are delivery date 469, delivery location 470, and delivery cost 468 is added Data is generated and stored in the transaction data file 46, and necessary information such as the completion of the reservation, the reservation valid period, and the cancellation fee is passed to the CGI 22. The CGI 22 transmits a message and necessary information to the terminal 30.

The WWW browser of the terminal 30 displays the received message and necessary information in the message display field 216 of the contract condition Web page 210. When the user clicks the return button 219, the process returns to the individual product display Web page 200 of process P6. Also, when the end button 220 is clicked, the mail order system processing is ended and the screen is closed.
In addition, when the reserved product arrives (or when it can be secured), the server 10 separately sends an e-mail to the member who reserved the product and receives an order confirmation e-mail, and then sends it to the distribution center 5. Instruct the product to be shipped.

Process P11: (Virtual operation operation guidance message display, etc.)
When the user clicks the virtual operation selection button 202 in the process P6, the WWW browser of the terminal 30 transmits virtual instruction data including the product identification number to the server 10.

When the server 10 receives the virtual instruction data, the CGI 22 retrieves the product identification code and searches the operation setting file 41 using the product identification code as a key. If there is no operation setting record 410 that hits, the CGI 22 passes a virtual operation disabling message to the CGI 22. The CGI 22 transmits a message to the terminal 30.
If there is a hit operation setting record 410, the corresponding product simulation means 23-j (1 ≦ j ≦ n) is extracted based on the product type code in the product identification code, and the product simulation means 23-j is activated. To do.

  The product simulation means 23-j takes out the necessary setting value 413 from the operation setting file 41 and sets it as an initial setting value, and then passes a virtual operation operation guidance message necessary for virtual operation of the product to the CGI 22, and the CGI 22 An operation operation guidance message is transmitted to the terminal 30.

  The WWW browser of the terminal 30 displays the received message in the message column of the individual merchandise display Web page 200 (or audio output). If the displayed message is a virtual operation impossible message, clicking the return button 203 returns to P5, and clicking the end button 204 ends the mail-order system processing and closes the screen.

The virtual operation method varies depending on the product group. However, when a virtual operation operation guidance message is received, the user operates an operation button (for example, a power switch, volume button, shutter, etc.) displayed on the screen with a pointing device such as a mouse. Buttons, strobe light buttons, etc.), instructing the user to select a medium (such as a CD or LP board in the case of a stereo) or material and place it in the product receiving port, For example, it is possible to indicate a destination of movement (in the case of a bicycle or a robot). It is also possible to operate the product by inputting quantitative data and instructions from the keyboard of the terminal 30.
In addition, products are displayed as images, and manufacturers, standards, functions, prices, installation conditions, delivery conditions, etc. are displayed in windows. Further, at this time, when the user clicks on a part of the product, the name of the part, the operation method, etc. are displayed or output as audio.

Process P12: (Virtual operation of product)
When the user performs an operation from a pointing device such as a mouse provided on the terminal 30 or a keyboard based on the virtual operation operation guidance message as described above, the WWW browser displays the element number and the position of the operation target part at each predetermined operation timing. And virtual operation data including operation results (vector amount consisting of moving direction and distance, amount of rotation of push times, scalar amount such as numerical values, position information such as coordinates, codes such as characters and instructions), and the like are transmitted to the server 10.

  The CGI 22 passes the virtual operation data received by the server 10 to the product simulation means 23-j. The product simulation means 23-j performs an operation simulation of the product based on the received virtual operation data as will be described later, and the simulation result (image data during or after the operation by the simulation, display data based on the operation, or audio output data) Etc.) to the CGI 22, and the CGI 22 transmits the simulation result to the terminal 30.

  Based on the simulation result received from the server 10, the WWW browser of the terminal 30 operates the product displayed on the individual product display Web page 200 to display or output the sound.

  The operation of this process (P12) is repeated until the user performs an ordering operation, a return operation, or a virtual operation end operation (that is, until the order button 201, the return button 203 or the end button 204 is clicked). When the button is clicked, the process transits to P7, when the return button 203 is clicked, the process returns to P6, and when the end button 204 is clicked, the processing of the mail order system is terminated and the screen is closed.

When the order button 201, the return button 203, or the end button 204 is clicked, the WWW browser of the terminal 30 transmits virtual instruction data including the product identification number to the server 10, and the CGI 22 receives the virtual instruction data from the server 10. Then, the virtual operation end data is passed to the product simulation means 23-j to end the virtual operation.
FIG. 6 is a flowchart showing the basic operation of the product simulation means. A virtual operation taking stereo as an example will be described with reference to FIG.

(Basic operation of product simulation means)
The product simulation means may be provided for each product, but there are usually many types of products for mail order sales, and it is difficult to limit the types of popular products. In addition, since popular products often change, it is not realistic to provide individual product simulation means. Therefore, in the embodiment, a general-purpose simulation means for each product group is provided for each product group (for example, a product group having the same basic operation such as a portable CD stereo, a notebook computer, a desktop computer, a digital camera,...) Differences in performance and functions of individual products within the product group are set by taking in initial values stored in the operation setting file 410 (FIG. 3A), and user input values from the terminal are set as parameters (variables) of each operation element. ) And processing by each general-purpose simulation to simulate the operation of individual products.

Step S1: (Initial value setting)
In FIG. 6, when the product simulation means 23-j is activated, the product simulation means 23-j takes out the necessary setting values 413-1 to 413-n from the operation setting file 41 and writes them in the internal initial setting area. initialize.
The operation setting file 41 is given initial values for each functional element or operation element of each product. The set value is different for each normal product, and for the options in the products in the product group, the setting item is turned off when there is no option.
As the setting values, for example, in the stereo example of FIG. 7, the state of the main switch (setting value = OFF), the state of the CD tray switch (setting value = OFF), the volume level (setting value = V5), etc. In a personal computer, there are OS type and status, switch status, screen status, printer connection status and switch status, other optional connection status and on / off status, presence / absence of application, and startup status.

Step S2: (delivery of operation guidance message)
The product simulation means 23-j passes the operation guidance message stored in the constant area to the CGI 22, and waits for delivery of the virtual operation data transmitted from the user terminal by the CGI 22.

Step S3: (Reception of operation input value and determination of motion element)
When the virtual operation data transmitted from the user terminal is received from the CGI 22, the product simulation unit 23-j corresponds to each element constituting the product simulation unit 23-j based on the element number included in the virtual operation data. Transition to the operation module corresponding to the element number. When the virtual operation data received from the CGI 22 is operation end instruction data, the process proceeds to step S5.

Step S4: (Simulation for each element and output of results)
When the element number is Ej-i, the operation module Ej-i performs an operation simulation of the element, and the simulation result corresponding to the input value included in the virtual operation data (during or after the operation of the element Ej-i part of the product) Image data, display data based on the operation of the element Ej-i of the product, or audio output data) is passed to the CGI 22, and the process returns to S3. As a result, the CGI 22 transmits the simulation result to the terminal 30, and as shown in FIG. 8, an image of the displayed element Ej-i of the displayed product is displayed on the terminal 30 side. It seems that the element Ej-i part of the product is activated. As a result of the operation, it is felt that content such as a dictionary is displayed or music is output.

Step S5: (Virtual operation end process)
Upon receiving the virtual operation end data from the CGI 22, the product simulation means 23-j takes out the setting values 413-1 to 413-n that are the same as the setting values extracted in step S1, writes them into the initial setting area, and initializes each element. Are sequentially simulated with the initial setting values by the corresponding operation modules, and the result, that is, the data for reproducing the initial state of each element is sequentially passed to the CGI 22 to complete the processing. Thereby, since CGI22 transmits the simulation result by an initial setting value to the terminal 30, the terminal 30 side reproduces the initial state where the operation is completed.

(Virtual operation using stereo as an example)
7 is an initial value of the operation setting file taking stereo as an example, and FIG. 8 is an explanatory diagram of a stereo virtual operation by the stereo simulation means.
In FIG. 7, set values 413-1 to 413-8 are associated with elements Ej-i (i = 1 to 8). For example, the initial setting value of the stereo element Ej-1 (main switch) is OFF, the initial setting value of the element Ej-2 (CD tray switch) is OFF, and the initial setting value of the element Ej-4 (volume volume) is Level V5.

  When the user clicks on the main switch (element Ej-1) of the stereo 300 with the mouse to perform an ON operation, the product simulation means 23-j uses the operation module Ej-1 to execute FIG. As shown in a), display data (a set of image data and display position data, the same applies hereinafter) indicating that the main switch 301 of the stereo 300 is pushed and lit is generated and passed to the CGI 22. As a result, an image in which the main switch 301 of the stereo 300 on the screen of the terminal 30 is lit is displayed superimposed on the image of the stereo 300. As a result of the user turning on the main switch 301 of the stereo 300, the main switch 301 is turned on. Appears to light up.

  Next, when the user clicks on the CD tray switch (element Ej-2) of the stereo 300 with the mouse to perform an ON operation, the product simulation means 23-j causes the operation module Ej-2 to perform the operation as shown in FIG. Then, display data indicating that the CD main switch 302 is pushed and lit and display data of the tray 303 pushed out to the outside are generated and passed to the CGI 22. As a result, the switch 302 that is lit and the image of the tray 303 protruding to the outside are superimposed and displayed on the stereo 300 on the screen of the terminal 30, so that the user can turn on the tray 303 when the CD tray switch 302 of the stereo 300 is turned on. Looks like it has come.

  When the user selects the second CD (selection value = “2”) in the CD selection column 310 (element Ej-7) by clicking with the mouse, the product simulation means 23-j uses the operation module Ej-7 to As shown in FIG. 8C, the display data of the arrow indicating the trajectory of the CD that is taken out from the CD selection column 310 and directed to the CD tray, and the second CD (song title “OOXX”) set in the CD tray are displayed. Display data is generated and passed to the CGI 22. As a result, the display data of the arrow 304 taken out from the CD selection field 310 and directed to the tray 303 and the image of the second CD 305 set on the tray 303 are superimposed on the image of the stereo 300 on the screen of the terminal 30. It seems to the user that the selected second CD 305 is set on the tray 303.

  Next, when the user turns off the stereo CD tray switch (element Ej-2), the product simulation means 23-j pushes the CD tray switch again as shown in FIG. 8D by the operation module Ej-2. The display data indicating the state of being turned off and the display data of the front of the tray stored in the stereo are generated and passed to the CGI 22. As a result, the switch 302 that has been turned off and the front image of the tray 303 housed in the stereo are superimposed and displayed on the stereo 300 on the screen of the terminal 30, so that the CD tray switch 302 of the stereo 300 is turned off to the user. It appears that the tray 303 is housed inside the stereo together with the CD 305.

  Next, when the user clicks the play button 306 (element Ej-3) with the mouse to turn it on, the product simulation means 23-j is lit when the play button 306 of the stereo 300 is pushed by the operation module Ej-3. Is generated and transferred to the CGI 22, and the start address of the simulation data file of the operation setting record 410 corresponding to this product, that is, the start address of the stereo CD music file is extracted and stored in the MP3 format. The second music data (song name “OOXX”) is taken out and passed to the CGI 22.

  As a result, an image in which the play button 306 of the stereo 300 on the screen of the terminal 30 is lit is superimposed and displayed on the stereo 300, and the music of the song title “OOXX” is heard from the speaker. When the play button 306 is pressed, it is felt that the song name “OOXX” stored in the set CD 305 is reproduced.

  When the user clicks the “+” part or the “−” (minus) part of the stereo volume control button (element Ej-4), the product simulation means 23-j uses the operation module Ej-4 to Data (signal) for controlling the volume of the speaker to be large or small is generated and passed to the CGI 22. As a result, the output volume from the speaker of the terminal 30 is controlled, so that the user feels that the volume has been adjusted by operating the volume adjustment button 307.

  When the user clicks the “+” part or the “−” (minus) part of the stereo balance adjustment buttons L and R (elements Ej-5 and 6), the product simulation means 23-j operates the operation module Ej-5. 6, data (signal) for finely adjusting the volume of the left and right speakers of the terminal 30 is generated and passed to the CGI 22. As a result, the output volume from the left and right speakers 312 and 313 of the terminal 30 is controlled, so that the user feels that the left and right balance adjustment has been performed by operating the balance adjustment button 308 or 309.

  As described above, when the user points the operation element (operation button or the like) of the product displayed on the terminal 30 by using a mouse or the like, the result is displayed or output as the operation of the product. You can experience the operation of the product selected in.

  In the above embodiment, stereo is taken as an example, but virtual operation by simulation is performed on the terminal side for products that operate by operation such as electronic devices such as personal computers, digital cameras, electronic memos, mobile phones, bicycles, power tools, robots, etc. Since it can display and / or output, it is possible to visually and audibly confirm the operation and status of various products such as electronic devices, electrical products, motors, and human-powered machines, so mail order sales A contribution to promotion can be expected.

[Embodiment (2)]
In the above embodiment (1), the virtual operation of the product is simulated on the server side based on the operation data by the input operation on the terminal side, the result is returned to the terminal side, and the simulation result is displayed on the terminal side. However, the present invention is not limited to this. That is, in the present embodiment (2), the product can be actually operated by the operation instruction from the terminal 30 and the operation state can be displayed on the terminal 30. Specifically, the virtual operation of the product is signal-processed on the server side based on the operation data by the input operation on the terminal side, and the signal processing result (drive signal) is input to the product input terminal via the cable. Alternatively, the product is operated by transmitting a drive signal, a control signal, etc. wirelessly, and the state is photographed by an imaging device such as an electronic camera, and the output acoustic signal is captured, and the result of photographing (a digitized video signal) And a sound signal) are input to the server, transmitted from the server to the terminal via the Internet, and reproduced and displayed on the terminal side.

  Here, the configuration of the online sales system 100 only needs to replace the server 10 with the server 10 '. Further, as shown in FIG. 9, the server 10 ′ adapts the signal processed by the control unit 11 ′ and peripheral device (not shown), the database 12 ′ and the control unit 11 ′ to the product input terminal standard. And an image pickup device 19 for picking up a product and inputting a video signal to the server 10 '. In the example of FIG. 9, the adapter 15 and the input terminal of the product 400 are connected by a cable, but the product 400 may be remotely controlled. In this case, the adapter 15 is provided with a wireless control unit and a signal transmission / reception unit, or a remote control device is provided between the adapter 15 and the product 400.

  The server 10 ′ exchanges data with a terminal connected to the Internet 2 and other computers via the Internet 2. As a function for executing the mail order service of the present invention, the server 10 ′ is as shown in FIG. In addition, a communication control means 20 that controls connection with a terminal connected to the Internet 2 and other computers and data transmission / reception via the Internet 2, an HTML file transmission control means 21 that controls transmission of an HTML file addressed to the terminal, a user The operation data received from the WWW browser based on the operation of the terminal 30 of 3 is transferred to the application below the product-specific signal processing means 231 and the temporarily stored video signal and / or audio signal is received from the CGI 22 and CGI 22 which are returned to the WWW browser of the terminal. Input terminal of the target product (operation Signal-based signal processing means 231 (231-1 to 231 -x) for generating signals (drive signals, control signals, data, etc.) to be input to the signal), and the signals generated by the product-specific signal processing means 231 are cable or wireless. Signal output means 232 for giving to the target product via the terminal, video / audio signal processing means 233 for compressing and temporarily storing the video signal and / or audio signal of the target product in the memory, and the same product from another terminal during the product operation 2, a conflict processing unit 234 for avoiding a terminal competition state when there is an access to operate the user, a member registration unit 24, an authentication unit 25, a product management unit 26, a sales management unit 27, and a deposit as in FIG. A processing unit 28, a delivery instruction unit 29, and the like are included.

  In addition, when the server 10 ′ operates the product, the contention processing unit 234 accesses the server 10 ′ so as to operate the same product, and counts the number of terminals. Waiting time calculation means for calculating the expected waiting time during which the product can actually be operated, and waiting information for transmitting the number of waiting terminals counted by the counting means and the expected waiting time calculated by the waiting time calculation means to the terminal Transmitting means (not shown).

  Each of the above means is constituted by a program and stored in a program storage memory (not shown) of the server 10, and is taken out and controlled by the control unit 11 'in a timely manner to execute each of the above processes. The product-specific signal processing means 231 (231-1 to 231-x) may be configured by a hardware module such as a signal conversion device for each product.

  The server 10 ′ includes a database 12 ′. As shown in FIG. 10B, the database 12 ′ has the same member registration file 43, product management file 44, sales management file 45, and transaction data file 46 as in FIG. Is stored.

  The basic operation of the online sales system is the same as that shown in the process chart of FIG. 4 except for the processes P11 and P12. In this embodiment, the description of the processes P11 and P12 is replaced as follows.

(Process P11):
“When the user clicks the virtual action selection button 202 in the process P6, the WWW browser of the terminal 30 transmits virtual instruction data including the product identification number to the server 10 ′. When the CGI 22 of the server 10 ′ receives the virtual instruction data, The corresponding product-specific signal processing means 231 is activated, and the product-specific signal processing means 231-j passes a virtual motion operation guidance message and product video data necessary for virtual operation of the product to the CGI 22, and the CGI 22 performs a virtual motion operation. The guidance message and product video data are transmitted to the terminal 30.

The WWW browser of the terminal 30 displays the received message and the video of the product in the message column of the individual product display Web page 200 (or audio output). If the displayed message is a virtual operation impossible message, clicking the return button 203 returns to P5, and clicking the end button 204 ends the processing of the mail order system and closes the screen. "
(Process P12):
“When the user performs an operation from a pointing device such as a mouse provided on the terminal 30 or a keyboard based on the virtual operation operation guidance message as described above, the WWW browser displays the element number and the part to be operated at every predetermined operation timing. Virtual operation data including position and operation results (vector amount consisting of movement direction and distance, amount of rotation of push times, scalar amount such as numerical values, position information such as coordinates, codes such as characters and commands), etc. are transmitted to the server 10 ′ To do.

  The CGI 22 passes the virtual operation data received by the server 10 ′ to the product-specific signal processing means 231. The product-specific signal processing means 231 performs signal processing such as signal conversion and command conversion on the received virtual operation data as will be described later, and the processing result is sent to the operation terminal (operation element of the target product via the signal output means 232 and the adapter 15. ).

  Among the operation results of the product, the acoustic output signal is passed to the server 10 'via a cable (in the case of wireless, a signal transmission / reception unit), and the display state and physical operation are photographed by the imaging device 19 such as a TV camera or a digital camera. Then, the photographing result (digitalized video signal) is passed to the server 10 ′. The server 10 ′ passes the received video signal and / or audio signal to the CGI 22, and the CGI 22 transmits the received video signal and / or audio signal to the terminal 30.

  The WWW browser of the terminal 30 displays the received video signal and / or audio signal received from the server 10 'on the screen of the terminal 30, and reproduces and outputs the audio signal from the speaker.

  The operation of this process (P12) is repeated until the user performs an ordering operation, a return operation, or a virtual operation end operation (that is, until the order button 201, the return button 203 or the end button 204 is clicked). When the button is clicked, the process transits to P7, when the return button 203 is clicked, the process returns to P6, and when the end button 204 is clicked, the processing of the mail order system is terminated and the screen is closed.

  When the order button 201, the return button 203, or the end button 204 is clicked, the WWW browser of the terminal 30 transmits virtual instruction data including the product identification number to the server 10 ′, and the CGI 22 is transmitted to the virtual instruction data by the server 10 ′. Is received, the virtual operation end data is passed to the product-specific signal processing means 231-j to end the virtual operation.

  In addition, when a virtual experience operation is being performed by a user with the selected product, the virtual experience operation by the user who is currently experiencing the virtual experience is shown to the other users who wish to experience the virtual experience. It broadcasts to users who wish to experience these virtual experiences. "

(Virtual operation of products by signal control)
The signal processing means for each product may be provided for each product, but usually there are many types of mail-order products, and it is difficult to limit the types of best-selling products. Providing the product-specific signal processing means is not realistic. Therefore, in this embodiment, general-purpose signal processing means for each product group common to each product group (for example, a product group having the same basic operation such as portable CD stereo, notebook computer, desktop computer, digital camera,...) Is provided. Provided, the difference in performance and function of individual products in the product group is set by the initial value set in the adapter 15, and the user input value from the terminal is taken as a parameter (variable) of each operation element to perform signal processing for each product An operation signal and a control signal for an individual product are generated by processing by means.

  Also, when there is a rush of virtual experience requests for a certain product, such as a newly released product, the applicants compete and create a queue. In this case, if the waiting time is too long, the user loses interest in the virtual experience and loses the opportunity to introduce the product.

  In order to solve such an inconvenience, a plurality of actual displayed products are provided, and especially for new products, if the number of exhibits is increased from that of ordinary products, congestion will be solved to some extent. However, from a management standpoint, this increases inventory and is the most undesirable solution. In addition, it is usually difficult to prepare a plurality of new products for display. Therefore, in this embodiment, when a plurality of users B2, B3,... Select a virtual experience in the process chart of FIG. 4 described above, the selected product is in a virtual experience operation by the user B1. , B2, B3,... Indicate the waiting time and the waiting order, and the virtual experience operation by the user B1 can be broadcast to the users B2, B3,.

  FIG. 11 is a flowchart showing an embodiment of a virtual operation of a product by signal control. 11A shows the basic operation, and FIGS. 11B and 11C show the operation when a plurality of users select a virtual experience, that is, when the virtual experience applicants compete. And operates in parallel with the basic operation of FIG. In this example, it is assumed that a virtual experience request for the product h is made in this order from a plurality of terminals 30-1, 30-2, 30-3,. That is, the user of the terminals 30-2, 30-3,... Selects the product h selected by the user of the terminal 30-1 in the process P6 of FIG. To do.

<Basic operation>
Step T1: (Determining whether virtual operation is in progress)
In FIG. 11A, when the product-specific signal processing unit 231-h is activated, the product-specific signal processing unit 231-h sets the user terminal 30-g (g is the maximum number of user terminals to n). (Any value of 1 to n in the case) The standby counter is examined. If the value of the standby counter is zero, it is determined that the virtual operation is not being performed, and the process proceeds to step T2. If the value of the standby counter is 1 or more, the process proceeds to step U1 (contention process 1) in FIG. 11B (in this case, an interrupt is applied).

Step T2: (Storing virtual operation data in the standby area)
In FIG. 11A, when receiving the virtual operation data transmitted from the user terminal 30-g from the CGI 22, the product-specific signal processing means 231-h sends the operation guidance message stored in the constant area to the CGI 22. At the same time, the imaging device 19 is instructed to shoot the target product, the shooting result (video data signal) is captured and transferred to the CGI 22, and the virtual operation data transmitted from the user terminal 30-g is awaited to be transferred by the CGI 22.

Step T3: (delivery of operation guidance message and product video data)
When the virtual operation data transmitted from the user terminal 30-g is received from the CGI 22, the product-specific signal processing means 231-h is based on the element number included in the virtual operation data, and the product-specific signal processing means 231-h. Transition to the operation module corresponding to the element number among the operation modules corresponding to each element constituting the. When the virtual operation data of the terminal 30-g received from the CGI 22 is operation end instruction data, the process proceeds to step T9.

Step T4: (element signal processing and result output)
When the element number is Eh-k, the operation module Eh-k performs signal conversion processing corresponding to the element, and performs signal conversion processing corresponding to the input value included in the virtual operation data (operation signal and control signal of the element Eh-k). , Data, etc.) are output to the adapter 15 via the signal output means 232.

Step T5: (Input of drive signal etc. to the product side input terminal)
The adapter 15 inputs the drive signal received from the operation module Eh-k to the input terminal of the individual product. When an analog signal is input on the product side, it is input to the analog input terminal after performing D / A conversion.

Step T6: (Product operation, etc.)
When an input signal from the input terminal is obtained in step T5, the target product performs an operation according to the input signal or changes the state of display or the like.

Step T7: (Product action shooting and data output, etc.)
The state of display and operation on the product is photographed by the imaging device 19. The imaging result (video signal) is digitized by the imaging device 19 and transmitted to the server 10, compressed by the video / audio signal processing means 233 and temporarily stored in the memory. When there is an acoustic output as a result of the operation, an acoustic signal is transmitted to the server 10 ′ via a cable (or wireless), compressed by the video / audio signal processing means 233, and temporarily stored in the memory.

Step T8: (Transmission of operation result to terminal)
When the video / audio signal processing means 233 stores video data (compressed data) or audio data (compressed data) stored in the memory for one packet, the video / audio signal processing means 233 transfers the data to the CGI 22 and returns to step T7 for the product-specific signal processing means 231. -D is repeated until the next virtual operation data is received or the operation ends, and the process returns to step T3. As a result, the CGI 22 transmits the operation result (video data and / or audio data) to the terminal 30. As shown in FIG. 13, the terminal 30-g displays the photographed product in real time, and the terminal 30- The user of g can actually confirm the operation of the product by the operation input from the terminal.

Step T9: (Whether or not there is a standby terminal (standby))
Upon receipt of the virtual operation end data from the CGI 22, the product-specific signal processing means 231-d checks the value of the standby counter. If the value of the standby counter is 1 or more, step U6 in FIG. Transition to.

Step T10: (Virtual operation end process)
When the value of the standby counter is zero, an operation end signal for setting the target product to an initial state is output and passed to the switch control signal input terminal of the target product via the signal output means 232 and the adapter 15, and the video signal And the delivery of the acoustic signal to the CGI 22 ends. Thereby, the terminal 30 side ends the displayed video display and the sound output during output.

<Competitive processing operation 1>
Step U1: (Notification of standby state)
When the value of the standby counter is 1 or more at step T1 in FIG. 11A, the contention processing means 234 passes the message, the waiting number (contents of the standby counter), and the waiting time to the CGI 22, If the value is 0, a message indicating that there is one user in the virtual experience and a waiting time are passed to the CGI 22, and virtual operation data (waiting instruction (broadcasting instruction or simple waiting) is transmitted from the user terminal 30-g. Instructions)) or wait for termination instructions. The waiting time can be calculated by, for example, {number of waiting persons + 1 (currently executing user)} × average waiting time. Moreover, the average waiting time can be initially set internally based on experience, and can be learned in the subsequent use state.

Step U2: (Standby terminal registration)
When the virtual operation data transmitted from the user terminal 30-g is received from the CGI 22, the contention processing means 234 checks the instruction content of the virtual operation data, and if the instruction from the user terminal 30-g is a standby instruction, 1 is added, and the address of the user terminal 30-g is extracted from the virtual operation data and stored in the area 50 (f) of the standby area 50 as shown in FIG. Here, the standby area 50 is a first-in first-out storage area, and consists of m (m ≦ n) fixed-length storage areas. That is, the waiting area 50 (f) indicates that the waiting order is number f. When the address of the terminal stored in the standby area 50 (1) is taken out, the address of the terminal stored in the standby area 50 (f) is stored in the standby area 50 (f-1) (actually stored). The contents may be moved, or the contents of the standby area position counter may be shifted).

Step U3: (Broadcast instruction presence / absence determination)
Next, the contention processing unit 234 checks the standby instruction content of the virtual operation data, and when the standby instruction content is a broadcast instruction, the process proceeds to U4. If there is no broadcast instruction, the process returns to T1 in FIG.

Step U4: (Broadcast)
When the video / audio signal processing means 233 stores the video data (compressed data) or the audio data (compressed data) stored in the memory at step T7 in FIG. To CGI22. At this time, the contention processing unit 234 broadcasts the CGI 22 so that the CGI 22 transmits the operation result (video data and / or audio data) to the terminal currently executing the virtual operation and the terminal having the address stored in the standby area 50. The execution module is switched, and this operation is repeated until a broadcast stop instruction (end operation of the terminal 30-g) is received from the user terminal 30-g. If there is a broadcast stop instruction, the process transits to U5.
Thereby, the user of the waiting terminal can see the operation of the product in virtual operation in real time. At this time, a message (a text message, a voice message, an arrow indicating an operation part, etc.) notifying the waiting person of what operation the operator is currently performing is transmitted to the waiting terminal. Also good.

Step U5: (Determining whether the terminal can be released from standby)
When there is a standby release instruction from the CGI 22 from the user terminal 30-g (end operation of the terminal 30-g or broadcast stop instruction in the above step U4), the contention processing unit 234 addresses the terminal that has issued the standby release instruction. , The address of the standby area (for example, standby area 50 (d)) is deleted, the terminal address stored after that standby area is shifted forward, and 1 is subtracted from the value of the standby counter, The process proceeds to step T1 in FIG. At this time, the execution module of the CGI 22 is switched so that the waiting number (contents of the standby counter) and the waiting time are broadcast to all the terminals having the addresses stored in the standby area 50. Restore the execution module.

(Competition processing operation 2)
Step U6: (Virtual experience notification and standby area update)
In FIG. 11 (c), when there is a transition from step T9 in FIG. 11 (a), the contention processing means 234 sends a virtual experience to the user terminal 30-c at the address stored in the standby area 50 (1). A message indicating that it has become possible is passed to the CGI 22, and virtual operation data (broadcast instruction or end instruction) transmitted from the user terminal 30-g is awaited. At this time, the execution module of the CGI 22 is switched so that the waiting number (contents of the standby counter) and the waiting time are broadcast to all the terminals having the addresses stored in the standby area 50. Restore the execution module.

Step U7: (Determining whether or not virtual experience is possible)
The contention processing means 234 examines the instruction content of the virtual operation data. If the instruction from the user terminal 30-g is a virtual experience instruction, the process proceeds to step T3 in FIG. ) To step T1.

(Virtual operation using a personal computer as an example)
FIG. 13 is an explanatory diagram of a virtual operation of a personal computer by signal control.
When the user clicks the virtual operation selection button 202 of the notebook computer in the process P6 of FIG. 4 described above, the WWW browser of the terminal 30 transmits the virtual instruction data of the notebook computer to the server 10 ′. When the server 10 ′ receives the virtual instruction data, the CGI 22 activates the notebook personal computer signal processing means 231-d.

  In this case, if the virtual operation of the notebook computer 500 is already being experienced by another user, the product-specific signal processing means 231-d passes this message, the waiting number and waiting time data to the CGI 22, and the CGI 22 The message, the waiting number and waiting time data are transmitted to the terminal 30. As a result, a waiting request message 601, waiting number of people 602, waiting time 603 and instruction buttons 611 to 614 as shown in FIG. 13A are displayed on the screen of the terminal 30, and the user clicks the broadcast button 611. Then, an image of the notebook personal computer 500 that is currently being experienced by another user as shown in FIG. 13B is displayed. When the standby button 612 is clicked, the process returns to the process P5 in FIG. 4 and can wait while viewing other products. When the return button 613 is clicked, the process returns to the process P5 in FIG. 4 without waiting. Also, when the end button 614 is clicked, the mail order system processing is ended and the screen is closed.

  Further, when the virtual operation of the notebook computer 500 is not performed by another user, the product-specific signal processing means 231-d outputs a virtual operation operation guidance message and product video data necessary for virtual operation of the product. The CGI 22 transmits the virtual motion operation guidance message and the product video data to the terminal 30. As a result, an operation guidance message 501 and an image of the notebook computer 500 as shown in FIG. 13B are displayed on the screen of the terminal 30.

  Next, when the user clicks on the main switch 502 with the mouse, the operation data including the value of the main switch ON (= “1”) is sent to the server 10 ′, and the CGI 22 of the server 10 ′ uses the received operation data as the product. It passes to another signal processing means 213-d.

  The product-specific signal processing means 231-d generates a main switch ON signal of the notebook computer 500 and inputs it to the switch signal input terminal of the notebook computer 500 via the output means 232 and the adapter 15. As a result, the notebook computer 500 is activated and an application selection screen is displayed on the screen of the notebook computer 500 (not shown).

  The imaging device 19 shoots from the start of the notebook computer 500 to the display of the application selection screen and transmits the video data to the server 10 ′. The server 10 ′ compresses the video data by the video / audio signal processing means 233 and passes it to the CGI 22. . In addition, the CGI 22 transmits video data to the terminal 30. Thus, the operation (mainly screen change) of the notebook personal computer 500 from activation to display of the application selection screen is sequentially displayed on the terminal 30.

  Further, when the user inputs and selects an application number from the “painting hall browsing application” keyboard in the application display in the image of the notebook computer 500, operation data including the application number is sent to the server 10 ′. The CGI 22 'passes the received operation data to the product-specific signal processing means 231-d. The product-specific signal processing means 231-d generates an application selection command for the notebook computer 500 and inputs it to the notebook computer via the output means 232 and the adapter 15. As a result, the “Painting Gallery Browse” application is activated, the contents of “Painting Gallery” are captured, and the content (painting) 503 is displayed on the personal computer 500.

  The imaging device 19 photographs the notebook computer 500 and transmits the video data to the server 10 ′. The server 10 ′ compresses the video data by the video / audio signal processing means 233 and passes it to the CGI 22. In addition, the CGI 22 transmits video data to the terminal 30. As a result, the personal computer 500 and the painting 503 stored on the screen thereof are displayed on the terminal 30, so that the user can browse the painting 503 stored in the painting museum on the notebook computer 500 by operating the terminal 30. The response speed of the notebook computer 500, the degree of color of the display image, and the like can be confirmed with the actual video.

  In this way, the user can check the operation of the product with the video by operating the terminal 30, and check the speed, response message, hue, sound, etc. in the same way as when operating the real thing. Can do. In addition, even if there is a virtual experience applicant for the same product, the waiting number and waiting time are displayed, and each operation of the product that is currently being virtual operated by another user can be broadcast to the waiting user. So, during the broadcast, you can perform the operations that are being performed by other users, so users can virtually know the operation of the product as if they were at the product demonstration venue. Satisfy your desire for knowledge and resolve your waiting dissatisfaction. Therefore, even if it is a popular product, it is not necessary to prepare several identical products.

  In addition, during the broadcast, from the user who is watching, to the user who is operating virtual, such as chat in the email system, operation advice, requests for other operation attempts, encouragement, You may make it transmit a message and audio | voices, such as evaluation, a tribute, an impression. By doing so, the sense of reality is further increased, and the dissatisfaction of waiting is eliminated.

  In the above embodiment, a notebook computer is used as an example, but the operation and status of various products such as electronic devices such as digital cameras and mobile phones, audio devices, automobiles, bicycles, etc. can be confirmed with the same feeling. Can be expected to contribute to the sales promotion of mail order sales.

  In this way, the present embodiment does not directly operate the steered device by remote operation, but instead interprets the operation instruction result of the terminal once by the server connected to the Internet, and further sends a control signal to the adapter. Various technologies and signal converters related to the Internet between user terminals and products that cannot be solved by the conventional remote control technology as it is configured to generate drive signals and operate products (devices) indirectly And transmission / reception devices can be controlled.

[Embodiment (3)]
In the above-described embodiment, a virtual product is operated on an exhibition product from the terminal via the Internet and a server for online mail order sales, and an image of the operating state of the product is transmitted to the terminal via the server and the Internet (or a plurality of products). The system is configured to deepen understanding of the product and contribute to sales by displaying the operation of the product in real time, but the scope of the present invention is a virtual experience at online mail order sales. It is not limited to only.

  For example, many people would like to operate the lunar explorer described below, a device that has only one in the world, a high-performance work robot, a slot machine in Las Vegas, but in reality it is rare. Or by operating a virtual device from a terminal such as a personal computer via the Internet, where the installation location of the device is limited and the opportunity for operation is limited. It can also be displayed on the terminal 630. At this time, it is possible to configure a virtual operation system that charges based on time or the number of operations.

FIG. 14 is a diagram illustrating a configuration example of the virtual operation system of the present invention. The virtual operation system 600 includes a virtual experience site 605 provided on the Internet 2 and a plurality of terminals 630-1 and 630-connected to the Internet 2. 2, ... 630-n.
The virtual experience site 605 is provided in the server 610, and a user can display a device (hereinafter, referred to as a virtual experience site 605) displayed in a virtual experience corner of the virtual experience site 605 from a terminal 630-i (1 ≦ i ≦ n) connected to the Internet 2. (Operated device) can be virtually operated.

Here, the server 610 is a server computer that virtual experience site 605 is provided, the server 610 includes a control unit 611 and the peripheral device as shown in FIG. 9 (not shown), a database 612 and controller 611 An adapter 615 including a transmission / reception device, a signal conversion device, or the like that transmits the processed signal to the operation device side in conformity with the signal transmission / reception unit or the input terminal standard of the operation device is provided . Further, the adapter 615 and the operated device may be remotely controlled. In this case, the adapter 615 is provided with a wireless control unit and a signal transmission / reception unit, and a control signal and a drive signal are sent to the operated device, or a remote control device is provided between the adapter 615 and the operated device. A signal is sent to the remote control device to control the operated device remotely.

  The server 610 exchanges data with the terminal 630 connected to the Internet 2 via the Internet 2. As shown in FIG. 15, the communication control means 620, HTML file are provided as functions for executing the virtual experience service of the present invention. A transmission unit 621, CGI 622, signal processing unit 6231, signal output unit 6232, video / audio signal processing unit 6233, competition processing unit 6234, user registration unit 624, and billing unit 625 are provided.

  Here, the functions of the communication control unit 620, the HTML file transmission unit 621, the CGI 622, and the contention processing unit 6234 are the functions of the communication control unit 20, the HTML file transmission unit 21, the CGI 22, and the contention processing unit 6234 shown in FIG. It is the same. Further, the signal output means 6232 and the video / audio signal processing means 6233 may be replaced with the signal output means 232 and the video / audio signal processing means 233 shown in FIG. Same as function.

Further, the signal processing means 6231 generates a signal (drive signal, control signal, data, etc.) to be input to the input terminal (operation element) of the operated device based on the operation data received from the CGI 622. Also, the user registration means 624 registers items necessary for collecting usage charges, such as a user's e-mail address, address, and name, for operating the operated device virtually using the virtual operation system. The charging unit 625 charges the user according to the time or number of times that the operated device is virtually operated.

Each of the above means is constituted by a program, stored in a program storage memory (not shown) of the server 610, and taken out by the control unit 611 in a timely manner and controlled to execute the above processes. The signal processing means 6231 may be configured by a hardware module such as a signal conversion device for an operated device that is operated by a virtual operation.

  The server 610 includes a database 612. The database 612 stores a user registration file for registering a user by the user registration unit 624, a billing amount billed by the billing unit 625, a billing file for recording a user and the like (not shown). Etc.) are stored.

The terminal 630 (630-1, 630-2,..., 630-n) includes a PDA such as a personal computer or a mobile phone, and includes a display device so that it can be connected to the Internet 2. Note that the terminal 630 may be a stationary terminal for virtual experience installed in a convenience store or the like.

In the embodiment, the terminal 630 and internet browser software (WWW browser) is installed, WWW operation, etc. of the operating device operated by the operation device and virtual operation exhibited by the information sent from the server 610 It can be viewed with a browser. The terminal 630 can be dial-up connected to the server 610 via the Internet 2 by selecting a home page on which various “virtual operated devices” are posted.

FIG. 16 is a process chart showing the basic operation of the virtual operation system of the present invention.
Process Q1: (Homepage display)
When a connection request to the “virtual experience” site 605 is issued from the user terminal 630 by URL input or link button operation to the “virtual experience” site 605, and the terminal 630 and the server 610 connect via the Internet 2, In step 610, the HTML file transmission control unit 621 transmits the home page HTML file to the terminal 630.
The WWW browser of the terminal 630 receives the HTML file for the home page from the server 610, displays the virtual experience home page (not shown), displays a guidance message, a price list, etc. The input field shown is displayed to prompt the user to input.

Process Q2: (Virtual operation screen display)
When the user inputs registration items such as the name of a user who wishes to use and clicks a confirmation button, the WWW browser of the terminal 630 transmits virtual instruction data to the server 610. When the server 610 receives the virtual instruction data, the HTML file transmission control means 621 transmits a virtual operation screen HTML file to the terminal 630.
Also, the CGI 622 of the server 610 activates the signal processing means 6231. The signal processing means 6231 passes the virtual motion operation guidance message and the video data of the operated device necessary for virtual operation of the operated device to the CGI 622, and the CGI 622 sends the virtual motion operation guidance message and the video data of the operated device to the terminal 630. Send.
The WWW browser of the terminal 630 displays a virtual operation screen 900 as shown in FIG. 18 based on the received virtual operation screen HTML file, and displays a received message and an image of the operated device.

Process Q3: (virtual operation etc.)
When a user performs an operation from a pointing device such as a mouse provided on the terminal 630 or a keyboard, the WWW browser receives virtual operation data including the element number, the position of the operation target portion, the operation result, and the like at each predetermined operation timing. Send to.

  The CGI 622 passes the virtual operation data received by the server 610 to the signal processing unit 6231. As will be described later, the signal processing means 6231 performs signal processing such as signal conversion and command conversion on the received virtual operation data, and the processing result is an operation terminal (operation element) of the operated device via the signal output means 6232 and the adapter 615. Is input.

  Among the operation results of the operated device, an acoustic output signal is passed to the server 610 via a cable (in the case of wireless, a signal transmission / reception unit), and a display state and physical operation are captured by an imaging device 619 such as a television camera or a digital camera. Then, the photographing result (digitalized video signal) is passed to the server 610. The server 610 passes the received video signal and / or audio signal to the CGI 622, and the CGI 622 transmits the received video signal and / or audio signal to the terminal 630.

The WWW browser of the terminal 630 displays the video received from the server 610 on the screen of the terminal 630 and reproduces and outputs the sound signal from the speaker.

The operation of this process (Q3) is repeated until the user performs a virtual operation end operation.
In addition, when a virtual operation is being performed by a user with a selected device to be operated, a virtual experience by a user who is currently experiencing a virtual experience is shown to other users who wish to experience the virtual experience and the waiting time and waiting order are indicated. The operation can be broadcast to those users who wish to experience virtual experiences.
The details of the operation of the process Q3 are the same as those in the flowchart of FIG. 11 described above when “product” is read as “operated device”.

Process Q4: (billing)
The server 610 uses the charging unit 625 to count the time from when the user operates the operated device until the user ends the operation, calculates the usage fee, and writes it in a charging file (not shown) in the database 612. Note that the user may be charged based on the number of user operations (the number of button operations on the terminal).

(Specific example (1))
FIG. 17 is a diagram showing an embodiment (a lunar surface probe) of the operated device operated by the virtual operation system.
In FIG. 17, the lunar probe 800 may actually be on the moon or may be displayed in an exhibition hall such as a space museum. Further, it is assumed that the lunar surface probe 800 is prepared to be operable and filled with necessary energy.

  The lunar probe 800 is attached to a traveling part 801 for moving the probe 800, a vehicle body 802, a sensor pole 803 that can move up and down and rotate in the horizontal direction, and a sensor pole 803, and rotates up and down. A visual sensor 804, a sample collection arm 805 provided at the front portion of the vehicle body 802, a sample storage portion 806 provided at a side portion of the vehicle body 802, and an antenna 807 are provided.

  An imaging device 619 is installed at a position where the lunar probe 800 can be photographed, and a remote control device (not shown) for remotely controlling the lunar probe 800 and the imaging device 619 is installed. Yes.

  FIG. 18 is a diagram showing an embodiment of a virtual operation screen. In FIG. 18, the virtual operation screen 900 is a virtual operation using a video window 910 for displaying the image of the lunar explorer 800 and a pointing device such as a mouse. A possible virtual operation window 920 is shown.

  A center button of the virtual operation window 920 is provided with a start button 930, a handle 931 for traveling operation, a forward button 932, a stop button 933, a reverse button 934, a virtual operation end button 939, a broadcast button 940, and the like on the left side. A button group 935 for sensor operation and a headlamp button 937 are provided, and a button group 936 for sample collection arm operation is provided on the right side.

  When the start button of the virtual operation window 920 is clicked in the process Q3 of FIG. 16 described above, the WWW browser of the terminal 630 transmits the virtual instruction data of the lunar explorer 800 to the server 610. The CGI 622 activates the signal processing means 6231 when the server 610 receives the virtual instruction data.

If the lunar probe 800 is already in a virtual experience by another user, the signal processing means 6231 passes the message, waiting number and waiting time data to the CGI 622, and the CGI 622 sends the message, waiting number and waiting time data. Is transmitted to the terminal 630. As a result, a waiting request message, the number of waiting people, waiting time and each instruction button (not shown) are displayed on the screen 900, and when the user clicks the broadcast button, the moon surface that other users are currently experiencing An image of the probe 800 is displayed.

In addition, when the virtual motion of the lunar explorer 800 is not performed by another user, the signal processing means 6231 sends a virtual motion operation guidance message necessary for virtual operation of the lunar explorer 800 and the lunar explorer . The video data is transferred to the CGI 622, and the CGI 622 transmits the virtual motion operation guidance message and the video data of the lunar explorer 800 to the terminal 630. Thereby, the image of the lunar explorer 800 is displayed on the screen 900 of the terminal 630. Also, the virtual motion operation guidance message is output as a voice.

  Next, when the user clicks forward button 932 with a mouse, operation data including drive data of traveling unit 801 is sent to server 610 via Internet 2, and CGI 622 of server 610 uses the received operation data as signal processing means. To 6231.

  The signal processing means 6231 generates a control signal for driving the traveling unit 801 of the lunar explorer 800 forward, and supplies the control signal to the adapter 615 via the output means 6232. The adapter 615 generates a forward driving signal for the traveling unit 801 to control the remote controller. Give to the device. The remote control device remotely controls the traveling unit of the lunar probe 800 to move the lunar probe 800 forward.

  Similarly, when the user clicks on the stop button 933, the lunar probe 800 can be stopped, and when the user clicks on the backward button 934, the lunar probe 800 can be stopped. Further, when the right side of the handle 931 is clicked, the handle rotates in the right direction, and when the left side is clicked, the handle rotates in the left direction.

  Also, when the ↑ (up) button is clicked in the left sensor operation button group 935, operation data including sensor pole driving data is sent to the server 610 via the Internet 2, and the CGI 622 of the server 610 receives it. The manipulated data is passed to the signal processing means 6231.

  The signal processing means 6231 generates a control signal for driving the sensor pole 803 of the lunar explorer 800 up and down, and supplies it to the adapter 615 via the output means 6232. The adapter 615 generates an ascending drive signal for the sensor pole 803 to control the remote controller. Give to the device. The remote control device remotely controls the sensor pole 803 of the lunar probe 800 and extends the sensor pole 803 upward.

  Similarly, when the user clicks the ↓ (down) button, the sensor pole can be lowered. You can also turn the sensor pole left and right by clicking the left (←) or right (→) button. When the recording button is clicked, the video captured by the visual sensor 804 can be recorded.

  In addition, when the ↑ (up) button is clicked in the right sample collection arm operation button group 936, operation data including arm drive data is sent to the server 610 via the Internet 2, and the CGI 622 of the server 610 The received operation data is passed to the signal processing means 6231.

 The signal processing means 6231 generates a control signal for driving the arm 805 of the lunar explorer 800 up and down, and supplies the control signal to the adapter 615 via the output means 6232. The adapter 615 generates an upward drive signal for the arm 805 and sends it to the remote control device. give. The remote control device remotely controls the arm 805 of the lunar probe 800 to move the arm upward.

Similarly, when the user clicks the ↓ (down) button, the arm can be lowered. In addition, when the ← (left) or → (right) button is clicked, the arm 805 can be moved left and right.
In this way, the sample A can be collected by moving the arm 805, approaching the sample A on the ground (or the moon surface) and clicking the close button. When the storage button is clicked, the arm 805 moves so that the tip of the arm 805 comes to the mouth of the storage unit 806, and when the open button is clicked, the sample A can be stored in the storage unit 806.

  In this way, the user can confirm the operation of the lunar probe 800 by video by operating the terminal 630, and the speed, the manner in which the lunar probe 800 moves on the uneven moon surface, The sound and the like can be confirmed in the same manner as when the real object is operated.

(Specific example (2))
FIG. 19 is a diagram showing an embodiment (humanoid robot) of an apparatus operated by a virtual operation system.
In FIG. 19, a plurality of robots 850 may be provided. Further, the robot 850 is provided so as to be operable, and is at least filled with necessary energy.

  The robot 850 includes a head 851 provided with an antenna and capable of rotating left and right and back and forth, an eye 852 including a visual sensor, ears 853-1 and 853-2 including a sound input device (for example, a high performance microphone), A mouth part 854 comprising a sound output device (for example, a speaker), a neck part 855 connecting the body 856 to the head, a body 856, bent to the front and rear, left and right, and supported by arm parts 857 and 858 and arm parts 857 and 858. Palm parts 859 and 860 configured to be able to hold and release objects, leg parts 861 and 862 that can be walked by bending back and forth, energy filling part 863 provided near the center of trunk 856, and the like I have.

  The robot 850 is provided with a brain unit (control unit) including a processor such as a microcomputer, a memory, and a servo mechanism (not shown) inside the body 856, based on a command input from the outside via an antenna. Operates and responds to commands.

  FIG. 20 is a diagram showing an embodiment of the virtual operation screen. In FIG. 20, the virtual operation screen 950 is displayed by using a video window 960 for displaying the video of the robot 850 and input from a keyboard or a pointing device such as a mouse. A virtual operation window 970 configured to be able to perform virtual operations is shown.

  A start button 971, an operation stop button 972, a virtual operation end button 973, and the like are provided on the upper right side of the virtual operation window 970, and an image window 975 for displaying an image within the field of view of the robot 850 is provided in the upper center. The upper left side is used as a part for displaying the usage time and the like.

  Further, a window 976 for displaying a robot operation message (command) input from the keyboard of the terminal 630 is provided on the lower left side. Robot operation messages consist of human action messages that are easy for the user to understand. For example, simple commands such as “walk”, “stop”, “turn left”, “return to the original position”, “replenish energy” There are complicated instructions such as “Search for (object) B” and “Please bring (if there is (object B)”. The user can also create and register a robot operation message on the terminal 630 side using a simple instruction assembly language. Also, robot operation messages classified by behavioral optics (commands (including commands created by the user)) are displayed in the window 976, and the user may select and specify the necessary robot operation messages. Good.

  An energy display lamp is displayed in the lower center portion, and the lamp is turned on when the energy falls below a predetermined value, prompting the user to give an energy charging instruction. Also, a response message display window 977 is provided on the lower left side, and response messages from the robot 850, for example, “I found object B, please indicate”, “There was no object B”, “No energy” Yes, I will go to the energy replenishment station. ”, Etc. and a message from the server 610 are displayed. Instead of providing the robot operation message (command) display window 976 and the response message display window 977, a robot operation message and a response message may be output by voice.

  When the user clicks the start button of the virtual operation window 960 in the process Q3 of FIG. 16 described above, the WWW browser of the terminal 630 transmits the virtual instruction data of the robot 850 to the server 610. The CGI 622 activates the signal processing means 6231 when the server 610 receives the virtual instruction data.

  In this case, if the virtual motion of the robot 850 is already being experienced by another user, the signal processing unit 6231 passes the message, the waiting number and the waiting time data to the CGI 622, and the CGI 622 The waiting time data is transmitted to the terminal 630. As a result, a waiting request message, the number of waiting people, a waiting time, and each instruction button (not shown) are displayed on the screen 950. When the user clicks the broadcast button, the robot 850 currently being experienced by another user. Is displayed.

  If the virtual motion of the robot 850 is not performed by another user, the signal processing unit 6231 passes the virtual motion operation guidance message and the video data of the robot 850 necessary for virtual motion of the robot 850 to the CGI 622, and the CGI 622. Transmits a virtual motion operation guidance message and video data of the robot 850 to the terminal 630. Thereby, the image of the robot 850 is displayed on the screen 950 of the terminal 630. The virtual motion operation guidance message is displayed in window 977.

  Next, when the user inputs a robot operation message “search for (object) B” from the terminal 630, operation data including the robot operation message is sent to the server 610 via the Internet 2, and the CGI 622 of the server 610. Passes the received operation data to the signal processing means 6231.

  The signal processing unit 6231 analyzes the received robot operation message, generates a command for rotating the head 851 of the robot 850 back and forth, and left and right, and a command for starting a visual sensor (camera) of the eye 852, and outputs the command. It is given to the adapter 615 through 6232. The adapter 615 (in this example, a wireless transmission / reception device) converts these commands into wireless signals and wirelessly transmits them to the robot 850.

  When the robot 850 receives the signal from the adapter 615, the robot 850 decodes the signal, gives a control signal to the servo mechanism of the head 851 based on the instruction decoded by the built-in brain, and activates the visual sensor of the eye 852. . As a result, the robot 850 rotates the head from front to back and from side to side and transmits a video data signal within the visual field of the visual sensor to the server 610 side. If there is an object in the field of view, the shape of the object is checked. If it is object B, message data indicating that fact and an instruction request is transmitted to the server 610 side. Send message data that means

  Similarly, when the user inputs the robot operation message “walk”, the robot 850 can be walked. When “turn left” is input, the robot 850 turns left, and when “stop” is input, the walking stops. be able to.

  Similarly, a message “pick up object B” is input to pick up object B, or an indication message such as “please replenish energy” is input by observing lighting of energy display lamp 979 to supply robot 850 with energy. It is possible to walk to a place, hold an energy supply terminal (not shown) of the energy supply station with the palm portion 859 of the arm portion 857, and couple the energy supply terminal to the energy filling portion 863 of the body 856 to charge the energy. . Thus, the user can operate the robot 850 by inputting various robot operation messages from the terminal.

  As described above, the user can confirm the operation of the robot 850 with an image by inputting a message from the terminal 630. In addition, the visual field of the robot 850 can be confirmed, a robot operation message corresponding to the response message from the robot 850 can be input to cause the robot to perform different operations, and the operation sound of the robot can be heard.

  As mentioned above, although several Example of this invention was described, it cannot be overemphasized that this invention is not limited to said each Example, A various deformation | transformation implementation is possible.

It is a figure which shows the structural example of the online sales system of this invention. It is a figure which shows the function of a server which has a mail order site, and the structural example of a database. It is a figure which shows the structural example of the record of each file stored in the database. It is a process chart which shows the basic operation | movement of the online sales system by the virtual transaction site of this invention. It is a figure which shows one Example of the web page for online sales displayed on a user terminal. It is a flowchart which shows the basic operation | movement of the signal processing means classified by goods. It is a figure which shows the initial value set to the operation | movement setting file for stereos. It is explanatory drawing of the stereo virtual operation | movement by the simulation means for stereo. It is a figure which shows the structural example by the side of a server. It is a figure which shows the other structure example of each function and database of a server which has the mail order site of this invention. It is a flowchart which shows the Example of the virtual operation | movement of goods by signal control. It is a figure which shows one Example of a standby area. It is explanatory drawing of the virtual operation | movement of the notebook personal computer by signal control. It is a figure which shows the structural example of the virtual operation system of this invention. It is a figure which shows the other structure example of each function and database of the virtual operation system server of this invention. It is a process chart which shows basic operation | movement of the virtual operation system of this invention. It is a figure which shows one Example (lunar surface probe) of the apparatus operated by a virtual operation system. It is a figure which shows one Example of a virtual operation screen. It is a figure which shows one Example (robot) of the apparatus operated by a virtual operation system. It is a figure which shows one Example of the virtual operation screen of a robot.

Explanation of symbols

1 Mail order site 2 Internet (communication network)
3 User 4 Bank 5 Distribution center 10, 10 ', 610 Server 11, 11', 611 Control unit 12, 12 ', 612 Database 15, 615 Adapter 19, 619 Imaging device 20, 620 Communication control means 21, 621 HTML file Transmission control means 22 CGI
23 Product-specific simulation means (motion control means)
24 Member registration means 25 Authentication means 26 Product management means 27 Sales management means 28 Payment processing means 29 Delivery instruction means 30, 630 Terminal ( user terminal)
41 Operation setting file 42 Product-specific HTML file group 43 Member registration file 44 Product management file 45 Sales management file 46 Transaction data file 47 Simulation data file 100 Online sales system 150 Homepage 151 New registration button 160 New member registration Web page 170 Member authentication Web page 180 Handling product group display Web page 190 In-group product display Web page 200 Individual product display Web page 201 Order button 202 Virtual operation selection button 210 Product order Web page 214 Delivery date input field 215 Delivery date display field 218 Reservation button 231 Product-specific signal processing means (operation control means, product-specific signal output means)
232 Signal output means 233 Video / audio signal processing means (data acquisition means)
234 Contention processing means 300 Stereo 301 Main switch 305 CD
306 Play button 307 Volume adjustment button 308, 309 Balance adjustment button 400 Product 410 Operation setting record 411 Product identification code 413-1 to 413-n Setting value 430 Member registration record 431 Member registration number 432 Basic information 433 Authentication code (password)
434 E-mail address 440 Product management record 450 Sales management record 460 Transaction data 462 Transaction classification 500 Notebook computer (product)
501 and 504 Operation guidance message 502 Main switch 503 Content 605 Virtual experience site 622 CGI (operation data transmission means)
6231 Signal processing means (operation control means, signal output means)
6232 Signal output means 6233 Video / audio signal processing means (data acquisition means)
6234 Competitive processing means 800 Lunar probe (operated device)
801 Traveling part (driving part)
803 Sensor pole (drive unit)
805 Arm (drive unit)
850 Robot (operated device)
900, 950 Virtual operation screens 910, 960 Video window ( video display area)
920, 970 Virtual operation window ( operation instruction area)
930, 971 Start button 931 Handle for traveling operation 932 Advance button 933, 972 Stop button 934 Reverse button 940 Broadcast button 935 Button group for sensor operation 936 Button group for sample collection arm operation 973 End button 976 Message for robot operation (Command) Display window 977 Response message display window A Document B Object

Claims (16)

An online sales method in which a server system and a terminal are connected via the Internet,
Preparing a plurality of products on the server system side on the server side, and sending images of the products to the terminal via the Internet;
Selecting a product from a group of products displayed on the terminal on the terminal side;
Displaying a video of the selected product on the terminal side on the terminal;
Inputting operation data of the product displayed on the terminal on the terminal side from the terminal;
Transmitting the operation data to the server on the terminal side;
A step of actually operating the product based on the operation data under control of the server that has received the operation data on the server side;
Transmitting operation data of the product and / or video of the operated product on the server side to the terminal;
Receiving the operation data and the video of the product operated on the terminal side at the terminal side, and displaying or outputting the operation state of the product;
An online sales method characterized by including:   Including a step of detecting access to operate the same product from a plurality of terminals on the server side, and a step of avoiding competition between other terminals when the access is detected. The online sales method according to claim 1.   The step of detecting the access on the server side includes the step of the server receiving operation data of the product transmitted from a terminal other than the terminal accessing the active product, and avoiding the conflict The server transmits the operation data of the product and / or the video of the operated product to the other terminal that has accessed, and the other terminal side that has accessed the server The method according to claim 2, further comprising: receiving operation data and an image of an operated product, and displaying or outputting an operation state of the product.   Transmitting the standby information of the other terminal accessed at the terminal side to the other terminal; receiving the standby information at the other terminal side accessed; and displaying or outputting the standby information; The online sales method according to claim 3, further comprising: An online sales system in which a server system and a terminal are connected via the Internet,
For a plurality of products prepared on the server system side on the server side, means for sending video of each product to the terminal via the Internet;
Means for selecting a product from a group of products displayed on the terminal on the terminal side;
Means for displaying video of the selected product on the terminal side on the terminal;
Means for inputting operation data of products displayed on the terminal on the terminal side from the terminal;
Means for transmitting the operation data to the server on the terminal side;
Means for actually operating the product based on the operation data under control of the server that has received the operation data on the server side;
Means for transmitting operation data of the product and / or video of the operated product to the terminal on the server side;
Means for receiving at the terminal side the operation data and video of the product operated on the terminal side, and displaying or outputting the operation state of the product;
An online sales system characterized by including: On the server side, the display product corresponding to the product handled on the online sales site, and an imaging device for photographing the display product,
The means for actually operating the product is product-specific signal output means for outputting a signal for operating the displayed product corresponding to the product selected on the online sales site based on the received operation data. The online sales system according to claim 5.   The product-specific signal output means is a signal generation means common to a product group including an adapter provided for each product group, and the characteristics of individual products in the product group are values set in the adapter for each product. 7. The online sales system according to claim 6, wherein the online sales system is discriminated by the following.   The server side includes means for broadcasting the operation data and / or video data to the other terminal when the operation data of the product transmitted from the other terminal other than the terminal is received. The online sales system according to claim 5. On the server side, counting means for counting the number of terminals that have transmitted operation data for operating the product to the server among the other terminals, and an expected waiting time until the other terminal can actually access the product. A waiting time calculating means for calculating; a waiting information transmitting means for transmitting the waiting terminal count counted by the counting means and the expected waiting time calculated by the waiting time calculating means to the other terminal;
9. The online sales system according to claim 8, wherein the terminal that has transmitted the operation data to the server on the terminal side receives and displays the number of standby terminals and the estimated waiting time from the server. A plurality of terminals connected to the server via the Internet, and operated devices prepared on the server system side,
The server
Operation data receiving means for receiving operation data when the operation data for the device is transmitted from the terminal;
Operation control means for operating the apparatus based on the received operation data;
Data acquisition means for acquiring operation data of the apparatus and status data of the apparatus by the operation control means;
Data transmission means for transmitting operation data and status data acquired by the data acquisition means to the terminal;
The terminal
Receiving operation data and status data from the server and displaying the operation and status of the device;
A virtual operation system characterized by that. An imaging device for photographing the device;
The operation control means is a signal output means for outputting a signal for operating the apparatus based on the received operation data, and the operation data and state data acquired by the data acquisition means are images captured by the imaging apparatus. The virtual operation system according to claim 10, further comprising data.   The virtual operation system according to claim 11, wherein the signal output unit is a signal generation / amplification unit including an adapter.   The operation data receiving means includes means for receiving operation data of the apparatus transmitted from another terminal other than the terminal when the apparatus is actually operating, and the data transmission means includes the data acquisition The virtual operation system according to claim 10, further comprising broadcast transmission means for broadcasting the operation data and the status data acquired by the means to the other terminal. Among the other terminals, counting means for counting the number of terminals that have transmitted operation data for operating the device to the server, and waiting time calculation for calculating an expected waiting time until the other terminal can access the device. Means, and standby information transmitting means for transmitting the number of standby terminals counted by the counting means and the expected waiting time calculated by the waiting time calculating means to the other terminals,
The virtual operation system according to claim 13, wherein the terminal that has transmitted the operation data to the server receives and displays the number of standby terminals and the expected waiting time from the server.   The virtual operation system according to claim 10, wherein the operated device is a lunar explorer or a robot.   The virtual operation system according to claim 10, wherein the server includes a charging unit that charges the terminal.

Images