CN111672089A - An electronic scoring system and implementation method for multiplayer confrontation projects - Google Patents

Abstract

The invention discloses an electronic scoring system and a realization method for a multi-person confrontation project, wherein the system comprises a motion capture system for positioning motion capture devices of all body parts of a competitor, and a scoring machine for receiving positioning information, establishing a 3D virtual human body model, judging whether collision occurs or not and scoring; the implementation method comprises the steps of wearing the motion capture device by a competitor, establishing a 3D virtual human body model of the competitor, obtaining positioning information obtained by the motion capture device, judging a collision event in real time, calculating scores in real time and the like. The invention can be suitable for various match rules, reduces the cost of wearable equipment, increases the wearing comfort level, can fully restore the match situation by the scoring system and the scoring method, can increase the match scoring accuracy, and reduces the occurrence of misjudgment situations.

Description

An electronic scoring system and implementation method for multiplayer confrontation projects

technical field

The invention relates to a scoring system for fighting competitions, in particular to an electronic scoring system and an implementation method for multiplayer confrontation projects.

Background technique

In fighting martial arts competitions, real judges are used on the scene to judge the scores with the naked eye, or the competitors are incapacitated. For example, the short-arms scoring system of the Chinese Wushu Association uses several real referees holding wireless integrators for real-time scoring, and finally obtains the final result through score comparison. This scoring method consumes a lot of labor costs. At the same time, due to the difficulty of observing the attack with the naked eye, it is difficult to obtain very accurate results for the speed, position, and whether the actual impact and damage of the attack are made. sentence.

Wearable sensor-based wearable devices used in other competitive competitions (such as fencing, taekwondo competitions), these wearable devices based on impact, light-sensing, force-sensing devices, and pressure-sensing devices are installed on the body. The sensors in each part conduct strike induction, and then make strike judgment, and finally carry out the scoring system scheme of the referee's score.

However, such scoring devices and methods are based on different competition rules, and different sensor devices need to be worn for different competitions, so the scoring systems for different competitions cannot be unified. In addition, according to the rules of different competitions, the wearable device needs to be fixed on the participant's limb, and the shape characteristics of the sensor need to be taken into account in the design of the competition clothing, and since the sensor needs to directly feel the attack of the attacker, the wearable device also needs to be considered. The protection of the sensor in turn increases the material and structural constraints on the garment. This undoubtedly increases the complexity and high cost of the wearable device, which is difficult to promote.

The above shortcomings are worth solving.

SUMMARY OF THE INVENTION

In order to overcome the deficiencies of the prior art, the present invention provides an electronic scoring system and an implementation method for multiplayer confrontation items.

The technical scheme of the present invention is as follows:

On the one hand, an electronic scoring system for multiplayer confrontation projects, characterized in that it includes:

The motion capture system is used to locate the motion capture device of each body part of the contestant;

and a scoring machine, the scoring machine receives the positioning information sent by the motion capture system in real time, and obtains the 3D virtual human body model of the corresponding contestant through the positioning information, and judges whether an effective collision occurs through the 3D virtual human body model. The scoring machine is scored according to the type of valid collision and the predefined scoring rules.

The present invention according to the above solution is characterized in that the motion capture system includes a motion capture sensor and the motion capture device, the motion capture sensor is wired/wireless connected to the motion capture device, and the motion capture device Wear it on different parts of the contestant.

The present invention according to the above solution is characterized in that a vibration sensor is provided in the motion capture device.

The present invention according to the above solution is characterized in that the motion capture device is worn on one or more parts of the head, chest, arms, hands, thighs, knee joints, feet, wearing weapons of the human body or on the weapon.

The present invention according to the above solution is characterized in that each limb or weapon wearing the motion capture device is configured with one or more attributes respectively.

The present invention according to the above solution is characterized in that the motion capture system is used to detect orientation and coordinate data of six degrees of freedom, or nine degrees of freedom, or ten degrees of freedom.

Further, the motion capture system includes a motion sensing system based on active or passive optical capture, an inertial sensor system based on inertial motion capture, a structural sensing system based on mechanical motion capture, and an electromagnetic induction based on electromagnetic motion capture. One or more of a system, a thermal and/or thermal sensing system, an accelerometer.

The present invention according to the above solution is characterized in that the motion capture device is fixed on the limb or weapon of the contestant through a wearable device.

Further, the wearable device includes one or more of a bundled fixing device, an adhesive fixing device, a mechanical and/or structural fixing device, and a magnetic fixing device.

The present invention according to the above scheme is characterized in that the scoring machine comprises:

a communication device, configured to receive the positioning information sent by the motion capture system in real time;

and a computing device, the computing device obtains the 3D virtual human body model of the corresponding contestant according to the positioning information received by the communication device, judges that a suspected collision occurs by judging the volume intersection of the 3D virtual human body models relative to the two contestants, and passes Judging the strength of the suspected collision incident and the rules of the game to get the scoring result.

Further, the communication device is wirelessly connected to the motion capture system.

Further, the computing device includes:

an operation interface for controlling the operation of the computing device through interface operation;

A motion capture system calibration module, used for calibrating each of the motion capture devices connected to the scoring machine according to the human body structure, forming a 3D virtual human body model of the contestant, and defining attributes of each of the motion capture devices;

The original parameter and scoring rule setting module is used to set the judgment parameters in the collision event judgment process, and set the rules for the integration of collision results;

The scoring operation module is used to determine whether a collision occurs according to the original parameters, and to score the real collision events;

A data connection establishment module is used to establish a connection relationship between the communication device and the motion capture system.

Furthermore, the volume of the 3D virtual human body model generated by the motion capture system calibration module is larger than that of the actual contestant.

Further, the scoring operation module includes:

The collision event determination unit is used to obtain the real-time orientation, posture and motion trajectory of the participant's limbs according to the participant's 3D virtual human body model, and to determine and obtain the virtual collision event;

The collision strength determination unit judges whether the collision reaches the set threshold according to the strength index when the virtual collision event occurs, and the virtual collision events that reach different set thresholds get different scores.

Furthermore, the collision event determination unit determines whether the motion capture device worn by the contestant vibrates after obtaining the real-time orientation, posture and motion trajectory of the contestant's limbs, and if a vibration occurs, it is determined as a real collision event.

Further, the scoring machine further includes an output device, the output device includes a display output, the display output is connected to a display, and the scoring machine displays the scoring result and scoring data on the display through the display output. superior.

Furthermore, the computing device further includes an information export setting module, configured to export the scoring results and scoring data counted by the scoring operation module, and send them to the output device.

Further, the output device further includes an audio output, the audio output is connected to a speaker, and the scoring machine plays the collected audio data to the speaker through the audio output.

Further, the scoring machine further includes a sound pickup device, the sound pickup device receives the audio information of the pickup and sends it to the computing device, and the computing device sends the audio information to the communication device through the communication device. In the contestant's motion capture device that can play audio.

On the other hand, a kind of realization method of the electronic scoring system for the multi-person confrontation class project as above, is characterized in that, comprises the following steps:

S100. The contestants wear different limb positions according to different attributes of each motion capture device;

S200, establish a connection between the scoring machine and the motion capture system, and establish a 3D virtual human body model of the contestant;

S300, the scoring machine obtains the positioning information obtained by the motion capture device in real time;

S400, the scoring machine determines the collision event in real time according to the 3D virtual human body models of different contestants and the original parameters initially set;

S500. The scoring machine calculates the scores of the contestants in real time according to the scoring rules.

The present invention according to the above scheme is characterized in that step S400 specifically includes: judging whether a suspected collision has occurred according to the volume intersection of the 3D virtual human body models of different contestants, and on the basis of judging that a suspected collision has occurred, judging whether the collision strength exceeds a predetermined amount Threshold, if it exceeds the predetermined threshold, it is determined as a real collision event.

The present invention according to the above scheme is characterized in that, in step S500, the real-time scoring process includes:

(1) According to the movement speed and trajectory of the competitor's body before the collision, the collision strength parameter is obtained;

(2) Identify the specific body parts where the competitor collided, and obtain the attacked and attacked parts;

(3) Real-time scoring is performed based on scoring rules through the determination of real collision events.

The present invention according to the above scheme has the beneficial effect that the present invention performs dynamic collision detection on the contestants based on the motion capture system, and scores points in combination with different competition rules. The modification of clothing reduces the corresponding cost of the wearable device; in addition, the scoring system and scoring method of the present invention can fully restore the game situation, increase the accuracy of the game scoring, and reduce the occurrence of misjudgment.

Description of drawings

Figure 1 is a system block diagram of an electronic scoring system for multiplayer confrontation items.

FIG. 2 is a schematic diagram of an electronic scoring system for multiplayer confrontation items.

Figure 3 is a schematic diagram of a contestant wearing a motion capture device.

FIG. 4 is a schematic structural diagram of a computing device.

FIG. 5 is a schematic diagram of a 3D virtual human body model.

FIG. 6 is a schematic diagram of the relationship between the head and the head motion capture device in the 3D virtual human body model.

Figure 7 is a schematic diagram of the comparison between the actual movements of the contestants and the 3D virtual human body model.

FIG. 8 is a flow chart of the implementation of the present invention.

In the figure, 1, motion capture device; 11, head motion capture device; 12, arm motion capture device; 13, hand motion capture device; 14, chest motion capture device; 15, leg motion capture device; 16, Knee joint motion capture device; 17. Foot motion capture device;

2. Motion capture sensor;

3. Scoring machine; 31. Head geometry label; 32. Arm geometry label; 33. Hand geometry label; 34. Chest geometry label; 35. Leg geometry label; 36. Knee geometry label; 37. Foot geometry label;

4. Display;

5. Contestants;

6. Competition venue;

7. Geometric data coordinate system.

Detailed ways

The present invention will be further described below in conjunction with the accompanying drawings and embodiments:

As shown in Figures 1 to 7, an electronic scoring system for multi-player confrontation items includes: a motion capture system and a scoring machine. The motion capture system is used to locate the motion capture devices of each body part of the contestant; the scoring machine receives the positioning information sent by the motion capture system in real time, and obtains the 3D virtual human body model corresponding to the contestant through the positioning information. To judge whether a valid collision has occurred, the scoring machine will score according to the type of valid collision and the predefined scoring rules.

1. Motion Capture System

As shown in Figure 1, Figure 2, and Figure 3, the motion capture system is used to detect orientation and coordinate data with 3 degrees of freedom (3-axis accelerometer and 3-axis gyroscope), or 9 degrees of freedom, or 10 degrees of freedom. It includes motion sensing systems based on active or passive optical capture, inertial sensor systems based on inertial motion capture, structural sensing systems based on mechanical motion capture, electromagnetic sensing systems based on electromagnetic motion capture, thermal and/or thermal One or more of a sensing system, an accelerometer.

The motion capture system includes a motion capture sensor 1 and a motion capture device 2 .

1. Motion capture sensor

The motion capture sensor 2 is located outside (or at the edge of) the playing field 6 and is wired/wireless connected to the motion capture device 1 . The motion capture sensor 2 places the contestant 5 on a certain number of motion capture devices 1 on various parts of the body to perform motion capture.

2. Motion capture device

(1) The motion capture device 1 is worn on different body parts or weapons of the contestant 5, and it is used as the basis for effective scoring by recording whether different body parts are attacked and/or attacked.

(2) The motion capture device is fixed on the participant's limb or weapon through the wearable device. Wearable devices include one or more of bundled fixing devices, adhesive fixing devices, mechanical and/or structural fixing devices, and magnetic fixing devices.

In this embodiment, each limb or weapon wearing the motion capture device 1 is configured with one or more attributes, including attack attribute, defense attribute, and vulnerability attribute, so that the scoring machine can score according to detailed scoring rules. For example, the hand can be defined as an attacking attribute and a defensive attribute, the head can be defined as a vulnerable attribute, etc. The present invention is not limited to the above attribute definitions. For example, in another embodiment, each limb part may not be configured with corresponding attributes, and only valid parts can be defined. During the game, an attack on the chest is scored as a positive score, and an attack on the wrist is scored as zero or negative). Other definitions can also be made in other embodiments, which will not be described in detail here.

Take the configuration of one or more attributes for each limb or weapon of the human body as an example:

The motion capture device is worn on the attacked and/or attacked parts of the human body, specifically including one or more parts of the head, chest, arms, hands, thighs, knee joints, feet, and wearing weapons, thereby forming Head motion capture device 11 , arm motion capture device 12 , hand motion capture device 13 , chest motion capture device 14 , leg motion capture device 15 , knee joint motion capture device 16 , and foot motion capture device 17 .

Preferably, on the premise of meeting the position of the movement measurement and scoring, the motion capture device is worn on the part where the contestant does not directly face the attack, which reduces the complexity of the wearable device and reduces the protection requirements for the device, which can not only meet the needs of various types of The wearing of competition clothing in martial arts competitions also eliminates the restrictions on contestants in terms of clothing, which reduces the overall cost of the program and improves the flexibility of setting scoring standards.

The different motion capture devices worn by the contestants on different body parts matched the initial parameters defined by the scoring machine. For example, the default motion capture device set in the scoring machine is the brain, and the contestant wears the secondary motion capture device on the back of the head.

Preferably, in this embodiment, a vibration sensor is provided in the motion capture device, and the vibration sensor is used to determine whether the position of the motion capture device collides, and to determine the type of collision. In other embodiments, the competitor's weapon or body part is also equipped with sensor devices such as impact, photosensitive, force sensing device and pressure, so that the scoring machine additionally obtains the force parameter data of the sensor and is used to increase the accuracy of judging the collision event. (Force parameter data can replace the estimated data calculated by the scoring device, such as impact judgment and strength judgment), which makes the scoring obtained by the scoring device more accurate and reliable.

Preferably, the contestant also wears impact protection devices such as armor, and uses its anti-piercing and anti-tear properties to protect the wearer from injury caused by impact. These injuries result from hitting, throwing, or other forces applied to the competitor, including force from the competitor falling on or relative to a contact surface (such as the ground, parapets surrounding an arena, fence, or cage), puncturing (such as weapon) or tearing force, and/or the impact of a weapon, body part or any other object (such as the ground) hitting the competitor.

2. Scoring machine

As shown in Figures 4 to 7, the scoring machine is connected to the motion capture system (preferably wireless communication connection), receives the positioning information sent by the motion capture system in real time, and performs real-time scoring operations (including checking, processing, analyzing and Report force parameter data, calculate one or more results (e.g. scores), and display the resulting output.

The scoring machine is one or more of electronic devices such as desktop computers, notebook computers, smart phones, tablet computers, and virtual reality all-in-one machines. It includes a computer system or network (including LAN, WAN, Internet, or cloud) or any other device (such as embedded hardware) that has the processing capacity and the ability to send data to a visual display, including but not limited to real-time or near-real-time data ).

1. The scoring machine includes a communication device.

The communication device is used to receive the positioning information sent by the motion capture system in real time, and is used to communicate with the motion capture device worn on each competitor, so that 6-DOF data can be communicated from each competitor to the scoring machine.

In one embodiment, the communication device is a one-way communication device such that the motion capture system transmits the detected location information of the motion capture device to the scoring machine. In another embodiment, the communication device is a multi-directional communication device, which not only enables the scoring machine to receive the location information sent by the motion capture system, but also transmits the data obtained by the scoring machine (including accumulated scores, or the voice from the coach). data) back to the competitor's motion capture device. Preferably, the communication device is single-channel or multi-channel, multi-channel communication enabling simultaneous transmission of communications and/or simultaneous reception of communications.

In a preferred embodiment, the wearable device further includes an earphone and a microphone on the competitor's head, so that the competitor can receive instructions from the coach on one channel and talk to the coach through the microphone on another channel. If multiple players are participating in the game (ie, a team game), additional channels may be included so that the team players in the arena can communicate with each other.

Preferably, the communication device adopts a wireless communication method, including any suitable wireless communication means, such as Bluetooth, local area network, network cloud, and the like.

2. The scoring machine includes a computing device.

The computing device establishes a link with the orientation data of the motion capture system, and then sets the original parameters; and obtains the 3D virtual human body model of the corresponding contestant according to the positioning information received by the communication device, and judges the relative 3D virtual human body model of the two contestants. The volume cross-judgment of a suspected collision occurs, and the scoring result is obtained by judging the strength of the suspected collision and the rules of the game.

The software system in the computing device is a software module that can run on the scoring machine, and its running environment can be any suitable operating system (such as Windows OS, Linux OS, Mac OS, Android OS, etc.), and its running mode can be Any operation mode, such as local installation operation or cloud computing, etc. According to different operating environments, the software system can be based on different programming languages (including C, C++, C#, PHP, Java, etc.).

After the connection between the computing device and the motion capture system is established, it can transmit azimuth (azimuth with no less than 6 degrees of freedom) data in real time. The real-time orientation data provided by the system is stored in an in-memory database.

As shown in FIG. 4 , the computing device includes an operation interface, a motion capture system calibration module, an original parameter and scoring rule setting module, a scoring operation module, a data connection establishment module, and the like.

(1) Operation interface

The operation interface is used to control the operation of the computing device through the interface operation.

The software user operation interface opened by the computing device after running the scoring software on the computer is usually a virtual operation interface for modifying, establishing, adding, deleting and issuing various instructions for various parameters of the software by using a mouse and a keyboard as input means.

Preferably, the user performs related operations of calibrating the motion capture system, setting the original parameters and scoring rules, and deriving the setting information through the operation interface.

(2) Motion capture system calibration module

The motion capture system calibration module is used to calibrate each motion capture device connected to the scoring machine according to the human body structure, form a 3D virtual human model of the contestant, and define the properties of each motion capture device. specific:

As shown in Figures 3 and 5, the computing device calibrates all connected motion capture devices according to the anatomy, allowing each motion capture device to be assigned a tag whose properties may serve different project rules. Preferably, the computing device identifies the body part of the contestant corresponding to each motion capture device, and sets the corresponding body part label and corresponding attribute.

In this embodiment, the limb part tags include but are not limited to: head geometry tag 31, arm geometry tag 32, hand geometry tag 33, chest geometry tag 34, leg geometry tag 35, knee joint geometry tag 36, feet Geometry tags 37, and weapon tags, etc. Depending on the parts of the limb tag, the attributes of the limb tag include parts that can be attacked (attributes), parts that can be attacked (attributes), vulnerable parts (attributes), and so on.

After the computing device and the motion capture system are connected and calibrated, the geometric data of the limbs corresponding to each motion capture device are obtained, and the corresponding geometric data coordinate system 7 is generated by using the three-dimensional model construction principle to form the 3D virtual human body of the contestant. Model. The geometric data of the limbs specifically includes: head volume geometric data (shape and size) (as shown in Figure 6), chest volume geometric data (shape and size), arm volume geometric data (shape and size), hand volume geometry Data (shape and size), thigh volume geometry (shape and size), calf volume geometry (shape and size), foot volume geometry (shape and size), weapon volume geometry (shape and size).

Since the relative positions of the contestants' limbs and the motion capture device they wear need to be collected and then provided to the computing device, the position in the 3D virtual human body model and the azimuth coordinates provided by the motion capture device are in the same relative position.

Preferably, the motion capture system calibration module can establish the corresponding geometric data coordinate system through the settings of the system debugging, and can also refer to the relevant world average data as the default value. In one embodiment, the relative position is a default value in the software, and the contestant needs to calibrate the wearing position according to this default value when wearing the motion capture device. For example, the default position of the head motion capture device of the computing device is the coordinates of the back of the person's head The center position, so the contestant needs to wear according to this default value; in another embodiment, this relative position can be debugged in the software operation interface, and calibrated according to the actual wearing position of the contestant.

As shown in Figure 7, combine all the calibrated geometric data according to the human body structure to generate a 3D virtual human body model representing the volume, shape and size of the participant's body structure (the shape and volume of the participant's armor and special clothing also correspond to the 3D virtual human body Simulation and reproduction in the model), and store and manage it in the scoring machine in a spatial data structure, allowing the scoring software to call and calculate various information based on this data in real time, such as hitting judgment, scoring judgment, foul judgment, etc. As a result, the volume and shape of this virtual mannequin is exactly or nearly identical to the contestant's real human body.

The orientation and coordinates of each limb of the 3D virtual human body model are updated according to the real-time orientation data provided by the motion capture device, so that the actual limb movements of the contestants are transmitted to the scoring software through the motion capture device and simulated in real time through the 3D virtual human body model. For example, when a contestant wears a motion capture device on the hand and transmits its position data to the scoring machine in real time, the data is read by the scoring software and updated to the position of the virtual human hand in real time, so as to achieve the virtual human hand. The posture of the body is the same or close to the real hand posture of the contestant, and so on to all parts, until the limb movements of the virtual human body can simulate the real-time limb movements of the contestant in real time or near real time. According to the above simulation method, a 3D virtual human body model of each contestant is obtained.

Likewise, the orientation data provided by the motion capture device will calibrate all 3D virtual body models to the true relative positions of the contestants. For example, in a certain embodiment, contestant A and contestant B are standing in the competition site, the distance between the two is 1 meter, and the height is the same, then the generated 3D virtual human body model also has a distance and height of 1 meter. Consistently, the distance between the contestants' avatars will truly reflect the contestant's actual distance in the real world.

In another embodiment, after the contestants use the scoring system to play the game, the scoring device can use the stored spatial structure data to play the entire game by means of CGI, and allow tentative, fast-forward, rewind, etc. operate.

(3) Original parameter and scoring rule setting module

The original parameter and scoring rule setting module is used to set the judgment parameters in the collision event judgment process, and set the rules for the integration of collision results. According to different needs, in one embodiment, the user can modify, add and delete the original parameters and the setting parameters of the scoring rules through the operation interface; in another embodiment, all the original parameters and the setting parameters of the scoring rules The default value is set in the scoring device and cannot be modified, deleted or added in the software operation interface.

The original parameters and scoring rules are a series of preset and/or settable variable values or constant variables in the scoring device, which are used to provide the scoring device in calculating the collision event (determining that a competitor hits another competitor) And the parameters referenced when scoring in real time. Original parameters and scoring rules include but are not limited to:

A. Site tags that can be used for attack.

In one embodiment, the site type may be defined, including blunt, sharp, soft, and the like. In another embodiment, such a label may also be a numerical value, such as a numerical value used to describe the degree of sharpness or a numerical value of hardness.

B. Site tags not available for attack.

C. Attackable site tags.

In one embodiment, the site type may be defined, including normal, fragile, tough, and the like. In another embodiment, such a label may also be a numerical value, such as a numerical value describing a degree of strength or a numerical value of the degree of fragility.

D. Unattackable part tags.

E. Suspected collision threshold (distance units).

F. Valid Speed Threshold (speed units).

G. Collision judgment sensitivity threshold.

H. Vibration Judgment Threshold (Based on Vibration Sensing Device).

I. Scoring rules setting.

(4) Scoring operation module

The scoring operation module is used to determine whether a collision occurs according to the original parameters, and score the real collision events. It includes a collision event judging unit and a collision strength judging unit, and may also include a scoring judging and information deriving unit.

A. Collision event determination unit

The collision event determination unit is used to obtain the real-time orientation, posture and motion trajectory of the participant's limbs according to the participant's 3D virtual human body model, and to determine and obtain the virtual collision event.

In this embodiment, the computing device performs an operation on the positioning information received from the motion capture system each time (each operation of the positioning information is referred to as "one frame"), and each frame reads the latest motion capture device The positioning parameters are updated to the 3D virtual human body models of all participants to reflect the real-time orientation, posture and motion trajectory of the real limbs, and then all the virtual limbs generated are in close to the same orientation as the limbs of all participants in the real world. Movement trajectory and posture.

Based on the above settings, when the real limb of competitor A collides with the real limb of another competitor B in the real world, the virtual limb of competitor A in the computing device should also collide with the virtual limb of competitor B If the collision is the same or close to the same, the virtual collision event is judged. Through the obtained virtual collision event and the motion trajectory and speed transmitted by the motion capture device, the relevant force is interpreted, and the purpose of assisting the scoring of the game is achieved.

The positioning refresh rate of the existing motion capture device does not necessarily fully meet the competitive events with the characteristics of high-speed body movements. When the time of the actual collision occurs in the gap of the refresh rate of the positioning equipment, the actual collision occurs this time. cannot be simulated by virtual limbs. In a specific embodiment, the positioning refresh rate of the motion capture device is 0.02 seconds per frame, and a real collision between contestants occurs in the process of 0.02 seconds after the motion capture device is refreshed, and the next positioning refresh When the real limbs of the two sides are out of the collision state, the virtual limbs of the contestants cannot respond to the impact and lead to errors in the scoring. In order to reduce the occurrence rate of such errors, the computing device of the present invention introduces relevant error control mechanisms and means.

In a preferred embodiment, the motion capture device is provided with a shock sensor, and the shock sensor, as a part of the motion capture system, transmits the shock parameters and positioning parameters to the scoring machine in real time. At the same time, the collision event determination unit performs real-time collision determination for each current frame:

(a) The 3D virtual human body models of all contestants are assigned the corresponding colliders, which fully cover the contestants’ 3D virtual human body models to ensure that the computing device can monitor the contact between the contestants’ 3D virtual human body models. or cross.

On this basis, the volume of the collision body is larger than the actual volume of the contestant through parameter adjustment. This parameter can be set by the system debugger in the initial parameter setting link.

For example, in one case, competitor A's actual waist circumference is 68 cm, which corresponds to a radius of 10.82 cm. When the initial parameter setting value is 2cm, its waist radius is set to 10.82+2=12.82cm, the waist of the virtual limb collider will be set to 80.51cm, and so on to the whole body. In the above example, the waist circumference of the contestant is regarded as a circle. When the shape of the limb is other shapes, different mathematical formulas are used for calculation, and finally the volume of the collision body is larger than that of the actual contestant.

In the real world, when the actual limb of contestant A is 2cm or closer to the actual limb of contestant B, the 3D virtual human body model has already touched the virtual limb collision body of contestant B, and then the virtual limb contact has been obtained. signal of.

(b) After the signal of virtual limb contact is determined to appear, further monitor whether the vibration sensor on the corresponding limb label transmits valid vibration parameters.

If there are valid vibration parameters, it is determined that a collision occurs; if there are no valid vibration parameters, it is not determined that a collision occurs.

In another preferred embodiment, the system debugger can specify the effective speed threshold at which the limb can actively strike other objects. When the speed of the "available for attack" reaches the threshold, it starts recording its movement distance in this state, and starts ray casting every frame.

(a) Difference operation between two samples

The positioning refresh rate of the motion capture device is limited. When the motion speed is extremely fast, the collision may occur between two motion capture samples. In this case, the collision cannot be determined by the model volume contact.

In order to avoid missing collisions due to the limited positioning frequency, the computing device emits rays from the position of the previous frame to the current position based on the object that has reached the motion threshold in each frame to check whether it collides with other physical rigid bodies. If a collision occurs, it is determined that the collision occurs.

(b) Anticipation

The detection frequency of the motion capture device also causes detection lag.

In response to this problem, the computing device emits a ray in the direction of the latest detected velocity based on the current position of the object. If the collision between the ray and the rigid body is detected, and the distance is less than the threshold, it is determined that the collision occurs.

It should be noted that if the accuracy and refresh rate of the selected positioning device meet the project standards, the above two optional error control mechanisms may not be enabled.

B. Collision force determination unit

The collision strength determination unit judges whether the collision reaches a set threshold according to the strength index when the virtual collision event occurs, and virtual collision events that reach different set thresholds get different scores. In the above-mentioned first optional error control mechanism, the collision event determination unit determines whether the motion capture device worn by the contestant vibrates after obtaining the real-time orientation, posture and motion trajectory of the contestant's limbs, and if there is vibration, it is determined to be true collision event.

In a specific embodiment, all colliding limbs are involved during the collision. For example, a collision of a limb of the hand with a limb of the head causes both the hand and the head to be impacted.

(a) Use the collision parameters to determine the strength index

The collision parameters include: the relative travel speed of the limb before the collision (the reduction speed of the distance of the collision limb), and the travel distance of the limb N seconds before the collision.

In this embodiment, the absolute instantaneous velocity will not produce impact; on the other hand, motion will not accumulate energy infinitely due to distance. Therefore, set a threshold of movement distance before collision (eg 0.5 meters). Before reaching this threshold, the impact force increases with the movement distance; after reaching the threshold, the increase in the movement distance will not continue to increase the impact force.

(b) Auxiliary determination of the force index using auxiliary collision parameters

The first category is the type label (or value) of the limb subjected to the force calculation, which includes the vulnerable part (or the value representing the degree of vulnerability), the tough part (or the value of the degree to be toughened), and the ordinary part (or various types of descriptions). status value).

The second category is the type label (or value) of the impacted limb, which includes blunt (value representing the blunt force of the object), sharp (value representing the sharpness of the object), and soft (value representing the softness of the object to be deformed).

In another specific embodiment, the computing machine discriminates "attacker", "defender" or both "blockers", and the factors involved in the discrimination include the label of the limb type of the part involved in the collision, the current absolute speed of the part involved in the collision ( i.e., relative world speed).

(a) When the "attackable part" collides with the "attackable part", it is determined that the attackable part is the attacker, and the attackable part is the defender.

(b) When the "parts that can be used for attack" collide with the "parts that can be used to attack": If the absolute speed of competitor A reaches the threshold and the absolute speed of competitor B does not reach the threshold, it will be judged that competitor A is attacking and competitor B is Defense; if the absolute speed of both parties does not reach the threshold, it is judged as "no collision"; if the absolute speed of both parties hits the threshold, it is judged as a block by both parties.

After determining the attacker, defender, or block, calculate the strength index of the defender.

C. Scoring determination unit

After the collision event is triggered and the strength parameters are calculated, the computing device further scores or punishes fouls according to the pre-designed scoring rules. In the scoring process, it is possible but unnecessary to refer to the relevant initial parameter settings, scoring rule settings, and touch and strength judgment results for real-time calculation to obtain the real-time scores of both contestants.

(5) Data connection establishment module

The data connection establishment module is used to establish the connection relationship between the communication device and the motion capture system.

In a preferred embodiment, the scoring machine is further provided with an installation device, which is used to ensure the communication from the wearable device, so that the data detection of each different motion capture device and the communication to the scoring machine are safe ( For example, to protect against tampering by third parties); and secondly, to secure communications (including watching games and related CGI, accessing associated audio data, including commentary, coach and competitor communications, announcements, music, broadcast transcripts, etc.).

(6) Information export setting module

The information export setting module is used to export the scoring results and scoring data counted by the scoring operation module, and send them to the output device.

3. The scoring machine also includes an output device.

(1) Display output

The output device includes a display output, and the display output is connected to the visual display. The scoring machine displays the scoring results and scoring data on the visual display in the form of CGI images through the display output, so that one of the competitors, the coach or the team leader, and the audience is displayed. or more than one sees (whether in a local arena or watching a game from a distance).

The scoring device derives relevant information and parameters according to the competition rules, specifically including: effective points, accumulative points of contestants, foul events, point deduction information, exporting of winning information, and display of game process information and chronological parameters of the virtual human body.

The CGI images include data visualization and display of the scores of all contestants and the strength index of each effective hit. Further, the visual display also shows a CGI rendering of the competitor's anatomy, showing where the force is being applied. For example, a contestant's presentation shows where the blow occurred (eg, the imprint of a stick, weapon, or other object (eg, a baseball bat hitting the jaw)), adding a multi-dimensional representation of the force and power of the blow.

The "damage value" of a hit can also be expressed as a score for the contestant delivering the hit, one or more deductions for the contestant receiving the hit, or a combination of the two. In one embodiment, the damage value is also represented as a visual representation of the blow, say for example an artistic imprint of a stick or baseball bat hitting the jaw, using a corresponding pressure map showing the relative distribution of forces on the recipient's jaw . The damage value may further be represented as a visual representation of the blow, also as an artistic imprint, for example, but recalibrated to simulate edged weapon strikes (eg, visually replacing a stick with a sword or spear).

The scoring machine includes capabilities for processing computer graphics, including video. In one arrangement, fights can be viewed in real-time or near real-time, with hit data overlays or other displays of hit data, motion replays, and computer-generated graphical displays of hit "injuries" indicating where competitors were hit And the damage value of each hit or cumulative attack to the competitor. CGI devices (eg, software) may additionally include glyphs to enable contextual displays, combat objectives, and other visual display elements for combat playback, modeling, or gameplay.

In one embodiment, the scoring device includes a CGI device (eg, software) to graphically display force parameter data and for multi-dimensional (eg, 2D, 3D, 4D) presentation of game-relevant computer-generated imagery that appears during the competition A graphic overlay on the contestant's video recording, or as a CGI rendering of the contestant. This is useful for real and simulated games, and for combinations of real and simulated games, enhancing the viewer experience when watching games, including interactively and for training and/or entertainment (eg, gaming) purposes, the viewer Can be in real-time, near real-time, or extended into the future, or during action playback.

Preferably, the scoring machine also interprets the results of the blows. For example: it is caused by a sharp weapon (such as a sword or spear) rather than the specific weapon actually used, and using CGI to present the result as an artistic imprint; using a CGI device can provide a simulation of the damage, allowing the viewer or viewer to See the performance of the competitor (eg in real combat), or the level of damage that would have been sustained with a bladed weapon rather than a bladeless weapon; multiple blows or forces (including simultaneous blows or forces) can be Record and view simultaneously, or selectively view on a visual display.

Preferably, the CGI device may be an integral part of the scoring machine or be connected to the scoring machine through any suitable communication means and using any suitable communication protocol.

(2) Audio output

The output device further includes an audio output, the audio output is connected with the speaker, and the scoring machine plays the collected audio data to the speaker through the audio output. Enables the receipt of audio data (such as from a scoring machine or from an externally connected source) through one or more speakers and/or through scoring and its derived audio information (such as scoring instructions or speech) so that the audio data can be Hearing by one or more of the competitor, the coach or team leader, and the audience (including those who are video-watching the game in the local arena and from a distance).

4. The scoring machine also includes a pickup device.

The pickup device receives the audio information of the pickup and sends it to the computing device, and the computing device sends the audio information to the contestant's motion capture device that can play audio through the communication device.

The pickup device enables audio data (such as speech) to be received (such as from a scoring machine or from an externally connected source) through one or more speakers so that the audio data can be used by one or more of the competitors, coaches or leaders, spectators all heard.

In a preferred embodiment, the scoring machine also includes a super slow motion video playback device to enable viewing on a visual display, eg slowing down a recording of 100 frames per second to 1 frame per second.

As shown in Figure 8, an implementation method of an electronic scoring system for multiplayer confrontation projects includes the following steps:

S100. The contestants wear different limb positions according to different attributes of each motion capture device.

Contestants need to fix the positioning equipment on each part of the body, and the specific method of fixation should be consistent with the parameters initially set by the scoring device. If the positioning device is defaulted to be at the back of the contestant's head in the initial setting of the scoring device, the contestant must fix the positioning device to the back of the head according to this setting. And so on.

S200, the scoring machine establishes a connection with the motion capture system (including wired or wireless connection), and establishes a 3D virtual human body model of the contestant.

The positioning and identification of the competitor's whole body or part of the body or the equipment used by the initial setting is formed, and the body structure simulation of the competitor is carried out through the known information. The specific method is as follows: according to the position of the positioning device, corresponding to the contestant and the body part of the contestant matched by the initial setting, the body structure simulation is carried out.

For example, the head locator identified by the initial setting of the scoring machine generates a local area according to its position and orientation to represent the real head size and orientation of the contestant. This area range parameter can be set manually. Or the world average can be used, and the parameters are the length, width, thickness, etc. of the human head. By analogy, the scoring machine will continue to locate the equipment position (optionally including hands, legs, feet, equipment positioning, etc.) according to the chest, and generate a local area range. The area range parameters can be manually set or can be The world average is used, and the parameters are the measurements of the human body, etc. Finally, through the identification of the positioning device in the scoring system software, the limb shapes, positions and orientations of all contestants are simulated in real time.

Preferably, the size of the object in the virtual environment should be slightly larger than the actual size of the corresponding object (for example, the circular virtual collision body of the head should be larger than the actual size of the user's head in the virtual environment). This is to trigger the system scoring mechanism in all cases of suspected collisions, so as to avoid missed collisions.

After the scoring machine is connected to the motion capture system, the motion capture device worn by the contestants needs to be calibrated and identified. Methods of calibration and identification can use manual identification and/or intelligent identification,:

In one embodiment, the operator will manually identify the body part of the contestant corresponding to each motion capture device through the operation interface of the scoring machine; in another embodiment, the scoring machine will pass each motion capture device The location is intelligently identified and the label of the limb is marked, and the label of each motion capture device is specifically identified according to the distribution of the human body structure. For example, the device in the highest position is assigned a head tag, the device below the head tag device is assigned a chest tag, the devices located on both sides of the chest tag device are assigned a hand tag, and so on until all devices are assigned tags.

In another embodiment, the scoring machine first assigns labels through intelligent identification, and then still allows the user to modify through the operation interface.

S300, the scoring machine acquires the positioning information obtained by the motion capture device in real time.

S400, the scoring machine determines the collision event in real time according to the 3D virtual human body models of different contestants and the original parameters initially set.

In order to supplement the problem of insufficient performance of most civilian positioning equipment (the incompleteness of the data collection of participants' limb movements caused by insufficient positioning frequency of specific positioning equipment), the scoring machine is based on the number of participants successfully collected by the positioning system. The limb movement data further uses the trajectory judgment mechanism to predict the advance of the limb movement trajectory, and uses the advance prediction as the data point on which the impact event is detected.

(1) Determine whether a suspected collision has occurred according to the crossover of the volumes of the 3D virtual human models of different contestants.

(2) On the basis of judging the occurrence of a suspected collision, evaluate and score the collision to determine whether the collision intensity exceeds a predetermined threshold. If it exceeds the predetermined threshold, it is determined as a real collision event; if it does not, it is determined as a non-collision. The assessment is scored based on:

A. In the event of a suspected collision, the minimum distance between the objects intersected by the two competitors.

B. When there is a suspected collision, the relative motion state of the object: the distance is reduced as a positive score, and the score increases with the speed of the distance reduction; if the distance increases, it is judged to leave, and it is directly judged as non-collision.

C. Oscillation: The larger the amplitude, the higher the score.

S500. The scoring machine calculates the scores of the contestants in real time according to the scoring rules.

The real-time scoring process includes:

(1) According to the movement speed and trajectory of the competitor's body before the collision, the collision strength parameter is obtained;

(2) Identify the specific body parts where the competitor collided, and obtain the attacked and attacked parts;

(3) Real-time scoring is performed based on scoring rules through the determination of real collision events.

According to the specific competition rules, set the scoring standard by adjusting the software parameters. This implementation method can be applied to short-handed competitions, taekwondo competitions, kendo competitions, western sword competitions and other competition systems. According to different collision parts, collision strength and other parameters, the winner and the loser of the competition are determined.

A. Determine the attacker and the hit party

The side whose volume intersection is a non-attack part such as the body or head becomes the hit side;

The one whose volume intersecting part is the aggressive part such as the hand/equipment and foot becomes the attacking party;

In theory, it is possible to allow both sides to be the attacker or the hit.

B. Calculate the collision force

The strength is calculated based on the movement speed and distance of the attacker's limbs before the collision, and the relative movement speed of the hit part of the hit party.

It should be understood that, for those skilled in the art, improvements or changes can be made according to the above description, and all these improvements and changes should fall within the protection scope of the appended claims of the present invention.

The patent of the present invention has been exemplarily described above in conjunction with the accompanying drawings. Obviously, the realization of the patent of the present invention is not limited by the above methods, as long as various improvements made by the method concept and technical solutions of the patent of the present invention are adopted, or no improvement is made. It is within the protection scope of the present invention to directly apply the concept and technical solution of the patent of the present invention to other occasions.

Claims (10)

1. an electronic scoring system for a multi-person confrontation class project, is characterized in that, comprising: The motion capture system is used to locate the motion capture device of each body part of the contestant; and a scoring machine, the scoring machine receives the positioning information sent by the motion capture system in real time, and obtains the 3D virtual human body model of the corresponding contestant through the positioning information, and judges whether an effective collision occurs through the 3D virtual human body model. The scoring machine is scored according to the type of valid collision and the predefined scoring rules. 2. The electronic scoring system for multiplayer confrontation items according to claim 1, wherein the motion capture system comprises a motion capture sensor and the motion capture device, and the motion capture sensor is associated with all the motion capture sensors. The motion capture device is wired/wireless connected, and the motion capture device is worn on different parts or weapons of the contestant. 3 . The electronic scoring system for multiplayer confrontation items according to claim 1 , wherein one or more attributes are configured for each limb or weapon wearing the motion capture device. 4 . 4. The electronic scoring system for a multi-person confrontation class item according to claim 1, wherein the scoring machine comprises: a communication device, configured to receive the positioning information sent by the motion capture system in real time; and a computing device, the computing device obtains the 3D virtual human body model of the corresponding contestant according to the positioning information received by the communication device, and judges that a suspected collision occurs by judging the crossover of the volumes of the 3D virtual human body models of the two contestants. The intensity of the suspected collision incident and the rules of the game will be scored. 5. The electronic scoring system for multiplayer confrontation items according to claim 4, wherein the computing device comprises: an operation interface for controlling the operation of the computing device through interface operation; A motion capture system calibration module, used for calibrating each of the motion capture devices connected to the scoring machine according to the human body structure, forming a 3D virtual human body model of the contestant, and defining attributes of each of the motion capture devices; The original parameter and scoring rule setting module is used to set the judgment parameters in the collision event judgment process, and set the rules for the integration of collision results; The scoring operation module is used to determine whether a collision occurs according to the original parameters, and to score the real collision events; A data connection establishment module is used to establish a connection relationship between the communication device and the motion capture system. 6. The electronic scoring system for a multi-person confrontation class project according to claim 5, wherein the scoring operation module comprises: The collision event determination unit is used to obtain the real-time orientation, posture and motion trajectory of the participant's limbs according to the participant's 3D virtual human body model, and to determine and obtain the virtual collision event; The collision strength determination unit judges whether the collision reaches the set threshold according to the strength index when the virtual collision event occurs, and the virtual collision events that reach different set thresholds get different scores. 7. The electronic scoring system for a multi-person confrontation class project according to claim 6, wherein the collision event determination unit judges that the contestant wears a Whether the motion capture device vibrates, if there is vibration, it is determined as a real collision event. 8. a method for realizing the electronic scoring system for a multi-person confrontation class item as described in any one of claims 1 to 7, is characterized in that, comprises the following steps: S100. The contestants wear different limb positions according to different attributes of each motion capture device; S200, establish a connection between the scoring machine and the motion capture system, and establish a 3D virtual human body model of the contestant; S300, the scoring machine obtains the positioning information obtained by the motion capture device in real time; S400, the scoring machine determines the collision event in real time according to the 3D virtual human body models of different contestants and the original parameters initially set; S500. The scoring machine calculates the scores of the contestants in real time according to the scoring rules. 9. The method for realizing the electronic scoring system for a multi-player confrontation class project according to claim 8, wherein step S400 specifically comprises: judging whether a suspected collision occurs according to the volume intersection of the 3D virtual human body models of different contestants , on the basis of judging that a suspected collision occurs, it is judged whether the collision intensity exceeds a predetermined threshold, and if it exceeds the predetermined threshold, it is judged as a real collision event. 10. the realization method of the electronic scoring system for multi-person confrontation class item according to claim 8, is characterized in that, in step S500, the process of real-time scoring comprises: (1) According to the movement speed and trajectory of the competitor's body before the collision, the collision strength parameter is obtained; (2) Identify the specific body parts where the competitor collided, and obtain the attacked and attacked parts; (3) Real-time scoring is performed based on scoring rules through the determination of real collision events.

Images