WO2015113365A1

WO2015113365A1 - System and method to recognize object's id, orientation and location relative to interactive surface

Info

Publication number: WO2015113365A1
Application number: PCT/CN2014/080495
Authority: WO
Inventors: Zheng Shi
Original assignee: Zheng Shi
Priority date: 2014-01-30
Filing date: 2014-06-23
Publication date: 2015-08-06
Also published as: EP3100148A1; WO2015113440A1; EP3100142A1; WO2015113446A1; WO2015113431A1

Abstract

A system and method relates to a cost effective manner to identify the ID, location and orientation of objects such as playing cards relative to an interactive surface. The system and method uses a distinct pattern of conductive dots embedded on the surface of an object that is arranged in such a manner that they electrically couple with an array of conductive dots embedded on the interactive surface to generate a second pattern. The system and method also uses a RFID chip with a unique identification code embedded as an electrically conductive dot.

Description

System and Method to Recognize an Object's ID, Orientation and Location Relative to an Interactive Surface

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation in part of International Patent Application No. PCT/CN2014/079892, entitled "System and Method for Identifying an Object's ID and Location Relative to an Interactive Surface," filed on June 13, 2014, which is a continuation of International Patent Application No. PCT/CN2014/072961, entitled "System and Method for Identifying an Object's ID and Location Relative to an Interactive Surface," filed on March 6, 2014, which is a continuation in part of International Patent Application No. PCT/CN2014/071850, entitled "System and Method for Identifying an Object's ID and Location Relative to an Interactive Board," filed on January 30, 2014; which is a continuation in part of International Patent Application No. PCT/CN2013/072481, entitled "System and Method for Interactive Board," filed on March 12, 2013. The entire disclosures of each of the above applications are incorporated herein by reference.

TECHNICAL FIELD

The present invention relates to interactive surfaces, and more particularly, to detection of identification, position and orientation of objects placed on an interactive surface using an array of conductive dots embedded on both the surface of the objects and the interactive surface.

BACKGROUND

The recent abundance of inexpensive computer processors has greatly influenced games, toys, books, musical instruments and the like. Increasingly, games use embedded sensors coupled with computer systems linked to sensory accessories such as audio and video devices to enrich the interactive experience of the player.

Typically, computerized games provide players with a visual display of the game activity through an electronic display system such as a pixilated flat panel display or a touch screen. Unfortunately, such displays lack a three-dimensional nature and do not allow the physical interaction inherent in traditional board-based games. For example, a traditional board game may use one or more movable game pieces that players (especially young ones) find more "natural" and easier to interact with during their play experience. On the other hand, traditional board games often lack audio and/or visual interaction that computerized game play can offer to players. Therefore, a method that combines both computerized technology and physical play will enhance gamers' play experience.

Thus, it is desirable to develop a system and method that allows physical objects to be identified and located in a physically bounded environment by means of a computerized system. For example, allowing a computerized system to recognize both the ID of a game board piece and its location and orientation upon the game board can effectively enhance a player's experience by allowing their physical actions to be interpreted by the computer system so as to provide real-time feedback to the player in the form of a multitude of sensorial accessories such as video and/or audio outputs.

While a number of object identification and locating systems built into a board already exist, severe drawbacks prevent more advanced use. For example, many systems use low-resolution cameras with limited fields of view, severely restricting the detectable range of objects. Location and tracking inaccuracies may also occur when objects overlap or become obscured from the camera view. Furthermore, objects that tend to blend into the background or appear like other objects, such as similarly colored objects or identical objects, may be difficult to track accurately. Consequently, it may be difficult to implement interactive surface systems where objects are moving or partially obscured.

Accordingly, there is a need to overcome the drawbacks and deficiencies in the art by providing accurate object recognition, such that its ID, location and orientation information can be incorporated to generate a compelling experience for the user with physical objects.

SUMMARY OF INVENTION

A system and method to recognize the ID, position and orientation of one or more objects placed on the surface of an interactive surface such as game boards, chess boards and bulletin boards are disclosed. The system is composed of an interactive surface (mainly comprising an array of electrically conductive dots, a micro-computer unit) and one or more objects (comprising of an array of electrically conductive dots embedded on one or more of its surfaces, and in some embodiments, an RFID chip that also serves as an electrically conductive dot). The position of objects placed on the board's surface are recognized by means of the electric coupling of the objects' electrically conductive dots and the electrically conductive dots of the interactive surface. The ID of the objects placed on the interactive surface are identified by means of the design patterns of dots embedded on the objects' surface(s), or by means of RF communication between the RFID chip and the interactive surface. The orientation of the objects placed on the board's surface is identified by means of the design patterns of dots embedded on the objects' surface(s).

More specifically, the object(s) are embedded with a first pattern of electrically conductive dots upon one or more of its surfaces. The first pattern of electrically conductive dots is unique in the sense that other objects as well as other surfaces of the same object (but with differing ID codes) will be embedded with patterns of electrically conductive dots that are substantially different. Each of these electrically conductive dot patterns is designed in such a manner that the ID, position as well as the orientation of the object relative to the board can be identified.

In some embodiments, a radio frequency identification (RFID) chip is incorporated into the object as one of the electrically conductive dot. The RFID chip is similar to a simple electrically conductive dot in that it is capable of being coupled to one or more electrically conductive dot on the interactive surface, and gives rise to a unique pattern of coupling. The RFID chip is different from a simple electrically conductive dot in that it can be read by a radio frequency antenna embedded in the interactive surface from which the UID of the object can be detected.

The interactive surface is embedded with an array of electrically conductive dots that are operatively linked to the interactive surface's micro-computer unit(s) and CPU system, and in some embodiments, a radio frequency antenna that is also operatively linked to the board's micro-computer unit(s) and CPU system.

The object(s) is placed on the surface of the interactive surface and the position of the object relative to the board is determined through the electric coupling of the object's electrically conductive dots and the board's electrically conductive dots. Once electric coupling is achieved between these sets of dots the data is sent to the board's CPU system (via the micro-computer chip(s)) for processing. The identification of the object's ID and its orientation is simultaneously determined through the identification of the first pattern design of conductive dots embedded on the surface of the object, or the detection of the RFID chip by the RF antenna in the interactive surface. As with identification of the position of the object(s) relative to the board, once electric coupling between the object(s) electrically conductive dots and the electrically conductive dots of the interactive surface is achieved, the data pertaining to the pattern design of conductive dots embedded in the object will be identified and sent to the interactive surface's CPU system (via the micro-computer chip(s)) for processing.

Once the location, orientation and ID of an object is identified and processed by the interactive surface's computer system, proper feedback is fed back through a number of potential vessels (e.g. audio feedback, visual feedback, vibration... etc.) according to a user-defined program (i.e. based on whatever the software dictates) running on the computer system.

A major advantage of the embodiments of the present invention is that they enable a cost-effective solution to the identification of the location, orientation as well as the ID of objects relative to the board. This is due to the fact that only the interactive surface uses an electronic system connected to a computer system. The object(s) in itself contains no such specific hardware as they only make use of simple conductive dots (e.g. inexpensive metals such as copper or even conductive inks, and RFID chip) arranged on its surface. Therefore, the embodiments of the present invention provide a system and method that greatly simplifies the manufacturing process as well as significantly reduces the cost of production.

BRIEF DESCRIPTION OF THE DRAWINGS

Fig. 1 is an exemplary schematic diagram illustrating the interactive surface and the objects in accordance with one embodiment of the present invention.

Fig. 2 is an exemplary schematic diagram illustrating the interactive surface in accordance with another embodiment of the present invention.

Fig. 3 is an exemplary schematic diagram illustrating an object using a 3*3 array design in accordance with yet another embodiment of the present invention.

Fig. 4 is an exemplary schematic diagram illustrating an object using an RFID chip in accordance with yet another embodiment of the present invention.

Fig. 5A and Fig. 5B are exemplary schematic diagrams illustrating the determination of the orientation of an object using a 3*3 array design in accordance with yet another embodiment of the present invention.

Fig. 6 A and Fig. 6B are exemplary schematic diagrams illustrating the spatial orientations of the object using an RFID chip placed on the interactive surface, and how to recognize the orientation in accordance with yet another embodiment of the present invention.

Fig. 7 is an exemplary schematic diagram illustrating the unique ID identification of an object using a 3*3 array design with four corners of the 3*3 array being reserved for orientation determination in accordance with yet another embodiment of the present invention.

Fig. 8 is an exemplary schematic diagram illustrating all possible unique ID's for an object using a 3*3 array design with four corners of the 3*3 array being reserved for orientation determination in accordance with yet another embodiment of the present invention.

Fig. 9 is an exemplary schematic diagram illustrating the communication flow in accordance with yet another embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

While the present invention will be described in using specific embodiments, the invention is not limited to these embodiments. People skilled in the art will recognize that the system and method of the present invention may be used in many other applications.

For example, although the notion of 'surface' or 'board' is repeatedly used throughout this document, it is understood that this in no way is a restriction of the invention and its accompanying claims. In fact the present invention can easily be applicable upon a 3D surface whereby objects are placed on the side of at the bottom of the interactive surface (e.g. using magnets to get the objects to stick to a vertical or upside down surface). Nevertheless, for the sake of simplicity, this document will be written in a format that uses only a simple surface design.

In addition, the present invention makes use of a specific board embodiment for the sake of illustration it is understood that other surfaces with different conductive dot matrix designs are also applicable within the scope of the present invention. Furthermore, although the present invention uses objects that only have one planer surface with conductive dots embedded to one of its sides, it is understood that the same principle is applicable to multi-planar objects whereby two (such as both front and the back of a card) or more (such as all 6 faces of a cube) are embedded with a matrix of conductive dots. The above embodiments are also included within the scope of the present invention's claims.

The present invention may be better understood and its numerous objects and advantages will become apparent to those skilled in the art by reference to the accompanying drawings.

Fig. 1 is an exemplary schematic diagram illustrating the interactive surface and the objects in accordance with one embodiment of the present invention. The interactive surface 101 comprises of an operating surface area 102 whereby any object 103 placed upon that operating surface area 102 has its unique ID, location and orientation instantly determined by the interactive surface's CPU system 104. This is achieved because the surface of the object 103 in direct contact with the operating surface area 102 is embedded with a first pattern of electrically conductive dots. The contact between the operating surface area 102 (itself embedded with a matrix of conductive dots) and the object's electrically conductive dots will induce electric coupling between the two. The interactive surface 101 is designed to detect when and where electric coupling occurs across its operating surface area 102 and thus the object's 103 location relative to the operating surface area 102 can easily be determined.

Fig. 2 is an exemplary schematic diagram illustrating the interactive surface in accordance with one embodiment of the present invention. In this embodiment, the operating surface area 201 comprises of a matrix of electrically conductive dots 202 that are aligned in columns and rows. Fig. 2 also graphically depicts a pattern of electrically conductive dots 203 that are embedded on the surface of an object and in physical contact with the interactive surface's 101 operating surface area 201.

Fig. 3 is an exemplary schematic diagram illustrating an object using a 3*3 array design in accordance with yet another embodiment of the present invention. In this case the base of the object 301 is embedded with a pattern of electrically conductive dots 302 (marked as the bolded dots labeled 1, 3 and 9) and non-electrically conductive dots 303 (marked as the clear dots labeled 2, 4, 5, 6, 7 and 8). The non-electrically conductive dots generally consist of the same material as the substrate (e.g., plastic, wood, paper, etc.) and thus require no actual work during the item's production.

The pattern of electrically conductive dots 302 and non-electrically conductive dots 303 serve two major functions, to determine the object's orientation relative to the operating surface area 201 as well as to determine the object's unique ID.

An RFID chip can also serve as an electrically conductive dot in some embodiments. Fig. 4 is an exemplary schematic diagram illustrating an object using an RFID chip placed on the interactive surface's 101 operating surface area 401 in accordance with one embodiment. In this embodiment, the operating surface area 401 comprises of a matrix of electrically conductive dots 402 that are aligned in columns and rows. Fig. 4 also graphically depicts the object 405 embedded with the RFID chip 403 that serves as an electrically conductive dot as well as several electrically conductive dots 404. The surface areas of these dots 403, 404 are big enough so as to keep each of them in direct physical contact with one cluster of electrically conductive dots 402 embedded in the interactive surface's 101 operating surface area 401.

The pattern of the electrically conductive dots 403, 404 can be used to determine the object's orientation relative to the operating surface area 401, and the object's unique ID can be detected when the RFID chip is read by a radio frequency antenna embedded in the interactive surface 101.

Object Orientation Determination:

The method by which the relative orientation of an object is determined is by allowing for a specific pattern of conductive dots embedded on the surface of the object to be fixed for all identifiable objects regardless of differing object IDs.

The following embodiment is used as an illustration of the abovementioned concept but should not be considered as a restriction on the scope of the present invention.

Fig.5A and Fig. 5B are exemplary schematic diagrams graphically illustrating how the orientation of an object is determined once it is placed upon the interactive surface's 101 operating surface area 501. Firstly, referring to Fig. 5 A, one can see the operating surface area 501 and its accompanying electrically conductive dots 502. An object 505 embedded with electrically conductive dots 503 is placed upon the operating surface area 501 which causes electric coupling of the objects' electrically conductive dots 503 with the operating surface area's electrically conductive dots 502. The interactive surface's CPU system detects which of the operating surface's dots have been activated. In this particular example, this would consist of the operating surface area's electrically conductive dots 502 that are in physical contact with the object's three electrically conductive dots 503.

The orientation of the object is determined as follows; the four dots that corner the matrix (labeled 503 and 504) keep exactly the same electrically conductive/non-conductive pattern for all objects of differing IDs. In the embodiment illustrated in Fig. 5A all three dots labeled 503 are in bold which signifies that these dots have been embedded with electrically conductive materials whereas the fourth dot 504 is clear which signifies that this is a dot that has not been embedded with electrically conductive material. The presence and absence of the electrically conductive dots on the object, namely 503 and 504, and which form a first pattern, generate the presence and absence of coupling for the corresponding electrically conductive dots 502 on the interactive surface, and forms a second pattern. The interactive surface's CPU system is programmed to recognize the second pattern, and that the only clear (i.e. the only electrically non-conductive corner) of this 3*3 matrix object corresponds to the bottom left side of the object.

Fig. 5B now illustrates what happens when the same object is rotated 90 degrees clockwise. In this example, the only clear (i.e. non-electrically conductive) corner dot is now aligned top left of the operating surface area. Given that the clear corner dot 504 corresponds to the bottom left side of the object, the interactive surface's CPU system can, through a simple induction process, deduce that the object has been rotated 90 degrees clockwise.

An RFID chip can also serve as an electrically conductive dot in some embodiments. The following embodiment is used as an illustration of the abovementioned concept but should in no way be understood as a restriction on the invention.

Fig. 6A and Fig. 6 B are exemplary schematic diagrams graphically illustrating how the orientation of an object using an RFID chip is determined once it is placed upon the interactive surface's 101 operating surface area 601. Firstly, referring to Fig. 6 A, one can see the operating surface area 601 and its accompanying electrically conductive dots 602. An object 605 embedded with an RFID chip 603, which serves as an electrically conductive dot, and two other electrically conductive dots 604 is placed upon the operating surface area 601 which causes electric coupling of the objects' electrically conductive dots 603, 604 and the operating surface's several clusters of electrically conductive dots 602. The surface areas of the electrically conductive dots 603, 604 are big enough to enable each of them to be in direct physical contact with multiple electrically conductive dots 602 embedded on the operating surface area. The interactive surface's CPU system detects which of the operating surface area's dots 602 have been activated. In this particular example, this would consist of three clusters of electrically conductive dots 602 embedded in the operating surface area 601 and in physical contact with the object's RFID chip 603 and two other electrically conductive dots 604.

The orientation of the object is determined as follows; a specific pattern is fixed for the RFID chip 603 and two other electrically conductive dots 604 and the shape of the triangle formed by the three dots keeping exactly the same for all objects of differing IDs. In the embodiment illustrated in Fig. 6A, the RFID chip 603 and two other electrically conductive dots 604 form a triangle. The interactive surface's CPU system is programmed to recognize the triangle and thus determine the orientation of the object (note that in order for this system to work the distance between the three points of the triangle cannot be equal).

Fig. 6B now illustrates what happens when the same object is rotated with a certain angle (approximately 60 degrees). It should be noted that, because surface areas of the RFID chip as well as other electrically conductive dots are big enough to enable each of them to be coupled with multiple electrically conductive dots embedded on the operating surface, a wide range of orientations of the object can be determined in this embodiment.

Object Unique ID Determination:

The unique ID of an object is determined by allowing for patterns of conductive/non-conductive dots for each separate object to be identified.

The following embodiment of a 3*3 array is used as an illustration of the abovementioned concept but should in no way be understood as a restriction of the invention. In order to determine the unique ID of an object, various combinations of electrically conductive dots and non-conductive dots are used across the five other dots embedded on the surface of the object which is in direct contact with operating board.

Fig. 7 is an exemplary schematic diagram illustrating the unique ID identification of an object using a 3*3 array design with four corners of the 3*3 array being reserved for orientation determination in accordance with yet another embodiment of the present invention. An object's electrically conductive surface 701 is embedded with a unique design of electrically conductive dots and non-electrically conductive dots arranged in a 3*3 array. As discussed previously, the arrangement of electrically conductive dots 702 and the non-electrically conductive dot 703 that comprise the four corners of the objects' electrically conductive surface 701 are fixed and are not related to the determination of the unique ID of the object. The other five dots on the object's electrically conductive surface that comprise a 'cross' are the dots that determine the unique ID of that object. Various combinations of electrically conductive dots 704 and non-electrically conductive dots 705 will determine the unique ID of the object through a simple process of induction made by the interactive surface's CPU system.

In the case that an RFID chip is embedded in the object, it can be read by a radio frequency antenna embedded in the interactive surface from which the unique ID of the object can be detected.

Fig. 8 is an exemplary schematic diagram illustrating all possible unique ID's for an object using a 3*3 array design with four corners of the 3*3 array being reserved for orientation determination in accordance with yet another embodiment of the present invention. Fig. 8 is a table that depicts all the potential combinations of electrically conductive and non-conductive dots across a 3*3 matrix. Referring back to Fig. 8, one can see that a total of 32 unique IDs are achievable.

Fig. 9 is an exemplary schematic diagram illustrating the communication flow in accordance with yet another embodiment of the present invention, which helps to illustrate the process of the present invention. As shown in Fig. 9, a user 901 places an object 902 upon the interactive surface 903. This causes the interactive surface 903 to detect the presence of the object 902 on its operating surface area and send the data pertaining to the ID, location as well as orientation of the object 902 to the computer system 904 to be processed. Depending on the data at hand, the computer system 904 will provide feedback to the user 901 according to a user-defined program running on the computer system.

Claims

1. A system for identifying the identification, location and orientation of an object placed on or near an interactive surface, said system comprising:

an object with a plurality of electrically conductive dots arranged in a first pattern and embedded on or near a surface of the object;

an interactive surface with an array of electrically conductive dots embedded on or near the interactive surface; and

a computer system operatively linked to the interactive surface;

wherein, upon the object is placed on or near the interactive surface, the interactive surface is configured to detect the coupling of the electrically conductive dots embedded in the interactive surface with the electrically conductive dots embedded in the object to generate a second pattern, and transmit the second pattern to the computer system.

2. The system of claim 1, wherein a micro-computer unit is operatively linked to an electrically conductive dot embedded in the interactive surface for the detection of the coupling of the electrically conductive dot with an electrically conductive dot embedded in an object.

3. The system of claim 1, wherein the computer system is configured to identify an ID of the object through analyzing the second pattern wherein the presence and absence of a coupling is denoted as "1" and "0" respectively.

4. The system of claim 1, further comprising a radio frequency antenna embedded in the interactive surface, and a radio frequency ID chip embedded in an electrically conductive dot embedded in an object, wherein the computer system is configured to identify an ID of the object through radio frequency communication between the a radio frequency antenna and a radio frequency ID chip.

5. The system of claim 1, wherein the computer system is configured to derive location information of the object relative to the interactive surface from the second pattern.

6. The system of claim 1, wherein the computer system is configured to derive a spatial orientation of the object relative to the interactive surface from the second pattern.

7. The system of claim 1, wherein the first pattern is embedded on more than one surfaces of the object.

8. The system of claim 1, further comprising a sensory accessory selected from a group consisting of LED lights, audio devices, video devices, camera devices and vibration generator devices.

9. A method for identifying the identification, location and orientation of an object placed on or near an interactive surface, said method comprising: placing an object with a plurality of electrically conductive dots arranged in a first pattern and embedded on or near a surface of the object upon an interactive surface with an array of electrically conductive dots embedded on or near the interactive surface; detecting, by the interactive surface, the coupling of the electrically conductive dots embedded in the interactive surface with the electrically conductive dots embedded in the object to generate a second pattern; and transmitting the second pattern to a computer system.

10. The method of claim 9, further comprising detecting the coupling of an electrically conductive dot embedded in the interactive surface with an electrically conductive dot embedded in the object by a micro-computer unit operatively linked to the electrically conductive dot embedded in the interactive surface.

11. The method of claim 9, further comprising identifying by the computer system an ID of the object through analyzing the second pattern wherein the presence and absence of a coupling is denoted as "1" and "0" respectively.

12. The method of claim 9, further comprising identifying by the computer system an ID of the object through radio frequency communication between a radio frequency antenna embedded in the interactive surface and a radio frequency ID chip embedded in an electrically conductive dot embedded in the object.

13. The method of claim 9, further comprising deriving by the computer system location information of the object relative to the interactive surface from the second pattern.

14. The method of claim 9, further comprising deriving by the computer system a spatial orientation of the object relative to the interactive surface from the second pattern.

15. The method of claim 9, wherein the first pattern is embedded on more than one surfaces of the object.

16. The method of claim 9, further comprising providing a feedback through a sensory accessory selected from a group consisting of LED lights, audio devices, video devices, camera devices and vibration generator devices.