CN116229582B - Logistics unmanned aerial vehicle and man-machine logistics interactive system based on human body gesture recognition - Google Patents
Logistics unmanned aerial vehicle and man-machine logistics interactive system based on human body gesture recognition Download PDFInfo
- Publication number
- CN116229582B CN116229582B CN202310499993.0A CN202310499993A CN116229582B CN 116229582 B CN116229582 B CN 116229582B CN 202310499993 A CN202310499993 A CN 202310499993A CN 116229582 B CN116229582 B CN 116229582B
- Authority
- CN
- China
- Prior art keywords
- owner
- module
- cargo
- goods
- unloading
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Image Analysis (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
本发明属于物流无人机技术领域,具体涉及一种基于人体姿态识别的物流无人机及人机物流交互系统。本发明能够对货主进行人体姿态识别,判断货主是否处于收货姿态,从而来决定落货方式,结合落货参数的设置,使得无人机能够在悬停或者携带货物降落至地面后安全的解除对货物的限制,不仅能够保证货物完好,还能够保证货主在接货时能逐渐适应货物重量,避免货物砸伤货主的情况发生,此过程中,根据货主的动作信息来对其姿态进行预测,实现自主判定落货方式的目的,同时还能够根据预测姿态实时调整无人机的悬停位置,使得货主能够更为便捷的取走货物。
The invention belongs to the technical field of logistics drones, and in particular relates to a logistics drone based on human gesture recognition and a human-machine logistics interaction system. The invention can recognize the human body posture of the cargo owner, judge whether the cargo owner is in the posture of receiving goods, and then determine the way of unloading. Combined with the setting of unloading parameters, the drone can be safely released after hovering or carrying the goods to the ground. The restriction on the goods can not only ensure that the goods are in good condition, but also ensure that the owner can gradually adapt to the weight of the goods when receiving the goods, and avoid the situation where the goods hurt the owner. During this process, the owner's action information is used to predict its posture. Realize the purpose of independently determining the way of unloading goods, and at the same time adjust the hovering position of the drone in real time according to the predicted attitude, so that the owner of the goods can take away the goods more conveniently.
Description
技术领域technical field
本发明属于物流无人机技术领域,具体涉及一种基于人体姿态识别的物流无人机及人机物流交互系统。The invention belongs to the technical field of logistics drones, and in particular relates to a logistics drone based on human gesture recognition and a human-machine logistics interaction system.
背景技术Background technique
随着物流技术的不断发展,人们在对货物进行配送时,已经不仅仅局限于地面配送,对于一些小型的货物而言,已经能够使用无人机进行配送作业,其配送过程相较于地面配送的优点在于能够无视大部分地形,同时其配送速度也要高于地面配送,且在无人机飞行的过程中,当然,为保证货物能够安全送至货主手中,相应的人脸识别系统式必须要配备的,以此来避免货物错送的现象发生。With the continuous development of logistics technology, when people distribute goods, they are not limited to ground distribution. For some small goods, drones can be used for distribution operations. Compared with ground distribution, the distribution process The advantage is that it can ignore most of the terrain, and its delivery speed is also higher than that of the ground delivery, and in the process of flying the drone, of course, in order to ensure that the goods can be safely delivered to the owner, the corresponding face recognition system must be To be equipped, in order to avoid the phenomenon of misdelivery of goods.
现有的物流无人机在配送货物时,多会在核对人脸信息之后,将货物放置到地面,如公开号为CN114220157A的无人机配送中基于人脸转正和人脸识别的收货人识别方法,人脸识别验证通过后,无人机接收到确认指令后,降落到收件人对应的地理坐标位置附近的地面后,释放运送的货物,完成配送任务并起飞返程,不仅送货方式单一,而且送货点的地面环境属于不可控区域,容易导致一些易碎货物破损,此时更适用于货主直接从无人机下方去取走货物,其次,常规的无人机在落货时,需要停机,落货完毕后,需要再次的启动,起飞阶段对无人机电量消耗较大,电池自身的续航能力有一定的影响,基于此,本方案提供了一种基于人体姿态识别、灵活选择落货方式的物流无人机及其交互系统。When the existing logistics drones deliver goods, they usually place the goods on the ground after checking the face information. The identification method, after the face recognition verification is passed, the drone receives the confirmation command, lands on the ground near the geographical coordinates corresponding to the recipient, releases the delivered goods, completes the delivery task and takes off for the return journey, not only the delivery method Single, and the ground environment of the delivery point is an uncontrollable area, which is easy to cause damage to some fragile goods. At this time, it is more suitable for the owner to pick up the goods directly from the drone. Secondly, the conventional drone , it needs to be shut down, and after the unloading is completed, it needs to be started again. The take-off stage consumes a lot of power of the UAV, and the battery's own battery life has a certain impact. The logistics drone and its interactive system that choose the delivery method.
发明内容Contents of the invention
本发明的目的是提供一种基于人体姿态识别的物流无人机及人机物流交互系统,能够对货主进行人体姿态识别,确定无人机悬停位置,还能够根据货主的人体姿态选择地面落货,提高送货方式的灵活性,且无论何种落货方式无人机均不需停机,对电池的影响较小。The purpose of the present invention is to provide a logistics UAV based on human body posture recognition and a human-machine logistics interaction system, which can recognize the human body posture of the cargo owner, determine the hovering position of the drone, and can also select the ground landing position according to the human body posture of the cargo owner. It improves the flexibility of the delivery method, and no matter what the delivery method is, the UAV does not need to be shut down, and the impact on the battery is small.
本发明采取的技术方案具体如下:The technical scheme that the present invention takes is specifically as follows:
一种基于人体姿态识别的人机物流交互系统,包括数据采集模块、特征提取模块、一级判定模块、卸货判定模块、动作捕捉模块、特征分析模块、预测模块、二级判定模块以及中控模块;A human-computer logistics interaction system based on human gesture recognition, including a data acquisition module, a feature extraction module, a primary judgment module, an unloading judgment module, a motion capture module, a feature analysis module, a prediction module, a secondary judgment module, and a central control module ;
所述数据采集模块用于采集货物信息以及货主的人脸图像,并将货主的人脸图像标定为标准图像;The data collection module is used to collect cargo information and the face image of the owner, and mark the face image of the owner as a standard image;
所述特征提取模块用于提取货主的人体图像,其中,所述人体图像包括面部图像和关节图像;The feature extraction module is used to extract the human body image of the cargo owner, wherein the human body image includes a face image and a joint image;
所述一级判定模块用于识别货主的人体图像,并根据识别结果确定落货方式,其中,所述落货方式包括空中悬停接货以及地面落货;The first-level judgment module is used to identify the human body image of the cargo owner, and determine the unloading method according to the recognition result, wherein the unloading method includes hovering in the air to pick up the goods and ground unloading;
所述卸货判定模块用于根据落货方式设定落货参数,并在满足落货参数时,解除对货物的限定;The unloading judgment module is used to set the unloading parameters according to the unloading mode, and when the unloading parameters are satisfied, the restriction on the goods is released;
所述动作捕捉模块用于采集货主的动作信息,并将所述动作信息进行解码处理,输出多帧连续图像,并标定为待分析图像;The motion capture module is used to collect the motion information of the owner, decode the motion information, output multiple frames of continuous images, and mark them as images to be analyzed;
所述特征分析模块用于获取所有待分析图像,并将所述待分析图像输入至趋势分析模型中,输出货主的动作变化趋势;The feature analysis module is used to obtain all the images to be analyzed, and input the images to be analyzed into the trend analysis model, and output the movement trend of the owner;
所述预测模块用于根据所述动作变化趋势预测货主的手臂姿态,并输出为预测姿态;The prediction module is used to predict the arm posture of the cargo owner according to the movement trend, and output it as the predicted posture;
所述二级判定模块用于获取预测姿态,并根据所述预测姿态调整无人机的悬停位置;The secondary judgment module is used to obtain the predicted attitude, and adjust the hovering position of the drone according to the predicted attitude;
所述中控模块用于收发所述数据采集模块、特征提取模块、一级判定模块、动作捕捉模块、特征分析模块、预测模块以及二级判定模块之间的流转信息。The central control module is used to send and receive transfer information among the data collection module, feature extraction module, primary judgment module, motion capture module, feature analysis module, prediction module and secondary judgment module.
在一种优选方案中,还包括通信模块,所述通信模块用于提醒货主选择落货方式;In a preferred solution, it also includes a communication module, which is used to remind the owner of the cargo to choose the delivery method;
若货主选择悬停接货,则无人机悬停于货主的前方;If the cargo owner chooses to hover to pick up the cargo, the drone will hover in front of the cargo owner;
若货主选择地面落货,则无人机将货物放置于地面;If the cargo owner chooses to drop the cargo on the ground, the drone will place the cargo on the ground;
若货主未进行回应,则通过所述一级判定模块识别货主的人体图像,且根据识别结果自动确定落货方式。If the owner of the goods does not respond, the body image of the owner is recognized by the first-level judgment module, and the delivery method is automatically determined according to the recognition result.
在一种优选方案中,所述特征提取模块包括第一执行单元和第二执行单元,所述第一执行单元的执行优先权高于第二执行单元的执行优先权;In a preferred solution, the feature extraction module includes a first execution unit and a second execution unit, and the execution priority of the first execution unit is higher than that of the second execution unit;
所述第一执行单元执行时,捕捉所述货主的面部图像,并将所述面部图像上传至一级判定模块;When the first execution unit executes, it captures the facial image of the cargo owner and uploads the facial image to the primary judgment module;
所述第二执行单元执行时,捕捉所述货主的关节图像,并将所述关节图像上传至一级判定模块,其中,所述关节图像包括肩关节特征、肘关节特征以及腕关节特征。When the second execution unit executes, it captures the joint image of the consignor and uploads the joint image to the primary determination module, wherein the joint image includes shoulder joint features, elbow joint features and wrist joint features.
在一种优选方案中,所述一级判定模块包括第一判定单元和第二判定单元,所述第一判定单元的执行优先权高于第二判定单元的执行优先权;In a preferred solution, the primary judgment module includes a first judgment unit and a second judgment unit, and the execution priority of the first judgment unit is higher than that of the second judgment unit;
所述第一判定单元用于判断所述面部图像是否与标准图像一致;The first judging unit is used to judge whether the facial image is consistent with a standard image;
若一致,则判定所述货主信息准确,并将无人机悬停于货主的正前方;If they are consistent, it is determined that the information of the cargo owner is accurate, and the drone is hovered directly in front of the cargo owner;
若不一致,则判定所述货主信息不符,且不执行第二判定单元;If inconsistent, it is determined that the owner information is inconsistent, and the second determination unit is not executed;
所述第二判定单元用于判断所述肩关节特征、肘关节特征以及腕关节特征的位置关系;The second judging unit is used to judge the positional relationship of the shoulder joint features, elbow joint features and wrist joint features;
若所述腕关节特征位于肘关节特征的上方、肘关节特征位于肩关节特征的上方,则判定货主选择空中悬停接货;If the wrist joint feature is located above the elbow joint feature and the elbow joint feature is located above the shoulder joint feature, it is determined that the cargo owner chooses to hover in the air to pick up the goods;
若所述肩关节特征位于肘关节特征的下方,则判定货主选择地面落货。If the shoulder joint feature is located below the elbow joint feature, it is determined that the cargo owner chooses to drop the cargo on the ground.
在一种优选方案中,所述落货参数设置为货物与无人机之间的压力变化参数,所述压力变化参数依据货物重量设置,其中,压力变化参数的取值大于货物重量的二分之一。In a preferred solution, the unloading parameter is set as a pressure change parameter between the cargo and the UAV, and the pressure change parameter is set according to the weight of the cargo, wherein the value of the pressure change parameter is greater than half of the weight of the cargo one.
在一种优选方案中,所述二级判定模块内预设有标准姿态图像,并在获取预测姿态之后与其进行比较;In a preferred solution, a standard posture image is preset in the secondary judgment module, and is compared with it after obtaining the predicted posture;
若所述预测姿态与标准姿态图像一致,则无人机悬停于指定位置;If the predicted attitude is consistent with the standard attitude image, the UAV hovers at the designated position;
若所述预测姿态与标准姿态图像不一致,则生成偏差距离,并将无人机的悬停位置调整至预测姿态的位置。If the predicted attitude is inconsistent with the standard attitude image, a deviation distance is generated, and the hovering position of the drone is adjusted to the position of the predicted attitude.
在一种优选方案中,还包括语音播报模块,所述语音播报模块用于播放提醒验收语句。In a preferred solution, a voice broadcast module is also included, and the voice broadcast module is used to play reminder acceptance sentences.
本发明还提供了,一种基于人体姿态识别的物流无人机,应用于上述的基于人体姿态识别的人机物流交互系统,包括:The present invention also provides a logistics drone based on human body posture recognition, which is applied to the above-mentioned human-machine logistics interaction system based on human body posture recognition, including:
机身,所述机身下方设置有用于承载货物的夹持机构,所述夹持机构上设置有拉力传感器,所述拉力传感器用于检测夹持机构与所承载货物之间的拉力值;A fuselage, a clamping mechanism for carrying cargo is provided under the fuselage, a tension sensor is provided on the clamping mechanism, and the tension sensor is used to detect the tension value between the clamping mechanism and the loaded cargo;
其中,所述一级判定模块判定落货方式后,所述卸货判定模块根据落货方式设定落货参数,该落货参数为夹持机构与所承载货物之间的压力变化值,当所述拉力传感器检测到夹持机构的受力满足落货参数时,所述夹持机构解除对货物的夹持。Wherein, after the first-level determination module determines the unloading mode, the unloading determination module sets the unloading parameter according to the unloading mode, and the unloading parameter is the pressure change value between the clamping mechanism and the loaded goods. When the tension sensor detects that the force of the clamping mechanism satisfies the delivery parameters, the clamping mechanism releases the clamping of the cargo.
在一种优选方案中,所述夹持机构包括夹持板和双向伸缩杆,所述夹持板设置有两个,两个所述夹持板均设置于机身的下方,所述双向伸缩杆固定安装于机身的底端,且所述双向伸缩杆的两端分别与两个夹持板的顶端固定连接。In a preferred solution, the clamping mechanism includes a clamping plate and a two-way telescopic rod, two clamping plates are provided, both of the two clamping plates are arranged under the fuselage, and the two-way telescopic The rod is fixedly installed at the bottom end of the fuselage, and the two ends of the two-way telescopic rod are respectively fixedly connected with the top ends of the two clamping plates.
在一种优选方案中,所述夹持板均设置为L状,两个所述夹持板之间设置有承载货物外箱体,所述承载货物外箱体的两侧均开设有与夹持板相对应的卡接槽口。In a preferred solution, the clamping plates are all arranged in an L shape, and an outer cargo-carrying box is arranged between the two clamping plates, and a clamping box is provided on both sides of the cargo-carrying outer box. The corresponding snap-in notch of the holding plate.
本发明取得的技术效果为:The technical effect that the present invention obtains is:
本发明能够对货主进行人体姿态识别,判断货主是否处于收货姿态,从而来决定落货方式,结合落货参数的设置,使得无人机能够在悬停或者携带货物降落至地面后安全的解除对货物的限制,不仅能够保证货物完好,还能够保证货主在接货时能逐渐适应货物重量,避免货物砸伤货主的情况发生,此过程中,还能够根据货主的动作信息来对其姿态进行预测,实现自主判定落货方式的目的,同时还能够根据预测姿态实时调整无人机的悬停位置,使得货主能够更为便捷的取走货物,且无论何种落货方式无人机均不需停机,对电池的影响较小。The invention can recognize the human body posture of the cargo owner, judge whether the cargo owner is in the posture of receiving goods, and then determine the way of unloading. Combined with the setting of unloading parameters, the drone can be safely released after hovering or carrying the goods to the ground. The restriction on the goods can not only ensure that the goods are in good condition, but also ensure that the owner of the goods can gradually adapt to the weight of the goods when receiving the goods, and avoid the situation where the goods hurt the owner. Prediction, realizing the purpose of independently determining the delivery method, and at the same time adjusting the hovering position of the drone in real time according to the predicted attitude, so that the owner can take the goods more conveniently, and no matter what the delivery method is, the drone will not Need to shut down, less impact on the battery.
附图说明Description of drawings
图1是本发明所提供的系统模块图;Fig. 1 is a system block diagram provided by the present invention;
图2是本发明所提供的系统运行图;Fig. 2 is a system operation diagram provided by the present invention;
图3是本发明所提供的物流无人机整体结构示意图。Fig. 3 is a schematic diagram of the overall structure of the logistics drone provided by the present invention.
附图中,各标号所代表的部件列表如下:In the accompanying drawings, the list of parts represented by each label is as follows:
机身;body;
夹持机构;201、夹持板;202、双向伸缩杆。Clamping mechanism; 201, clamping plate; 202, two-way telescopic rod.
具体实施方式Detailed ways
为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合说明书附图对本发明的具体实施方式做详细的说明。In order to make the above objects, features and advantages of the present invention more obvious and comprehensible, specific implementations of the present invention will be described in detail below in conjunction with the accompanying drawings.
在下面的描述中阐述了很多具体细节以便于充分理解本发明,但是本发明还可以采用其他不同于在此描述的其它方式来实施,本领域技术人员可以在不违背本发明内涵的情况下做类似推广,因此本发明不受下面公开的具体实施例的限制。In the following description, a lot of specific details are set forth in order to fully understand the present invention, but the present invention can also be implemented in other ways different from those described here, and those skilled in the art can do it without departing from the meaning of the present invention. By analogy, the present invention is therefore not limited to the specific examples disclosed below.
其次,此处所称的“一个实施例”或“实施例”是指可包含于本发明至少一个实现方式中的特定特征、结构或特性。在本说明书中不同地方出现的“在一个较佳的实施方式中”并非均指同一个实施例,也不是单独的或选择性的与其他实施例互相排斥的实施例。Second, "one embodiment" or "an embodiment" referred to herein refers to a specific feature, structure or characteristic that may be included in at least one implementation of the present invention. "In a preferred embodiment" appearing in different places in this specification does not all refer to the same embodiment, nor is it a separate or selective embodiment that is mutually exclusive with other embodiments.
再其次,本发明结合示意图进行详细描述,在详述本发明实施例时,为便于说明,表示器件结构的剖面图会不依一般比例作局部放大,而且所述示意图只是示例,其在此不应限制本发明保护的范围。此外,在实际制作中应包含长度、宽度及深度的三维空间尺寸。Secondly, the present invention is described in detail in conjunction with schematic diagrams. When describing the embodiments of the present invention in detail, for the convenience of explanation, the cross-sectional view showing the structure of the device will not be partially enlarged according to the general scale, and the schematic diagram is only an example, and it should not be used here. Limit the scope of protection of the present invention. In addition, the three-dimensional space dimensions of length, width and depth should be included in actual production.
请参阅图1和图2所示,本发明提供了一种基于人体姿态识别的人机物流交互系统,包括数据采集模块、特征提取模块、一级判定模块、卸货判定模块、动作捕捉模块、特征分析模块、预测模块、二级判定模块以及中控模块;Please refer to Fig. 1 and Fig. 2, the present invention provides a human-computer logistics interaction system based on human gesture recognition, including a data collection module, a feature extraction module, a primary judgment module, an unloading judgment module, a motion capture module, a feature Analysis module, prediction module, secondary judgment module and central control module;
数据采集模块用于采集货物信息以及货主的人脸图像,并将货主的人脸图像标定为标准图像;The data acquisition module is used to collect cargo information and the face image of the owner, and calibrate the face image of the owner as a standard image;
特征提取模块用于提取货主的人体图像,其中,人体图像包括面部图像和关节图像;The feature extraction module is used to extract the human body image of the cargo owner, wherein the human body image includes a face image and a joint image;
一级判定模块用于识别货主的人体图像,并根据识别结果确定落货方式,其中,落货方式包括空中悬停接货以及地面落货;The first-level judgment module is used to identify the human body image of the cargo owner, and determine the delivery method according to the recognition result, wherein the delivery method includes hovering in the air to pick up the goods and ground delivery;
卸货判定模块用于根据落货方式设定落货参数,并在满足落货参数时,解除对货物的限定;The unloading judgment module is used to set the unloading parameters according to the unloading method, and release the restriction on the goods when the unloading parameters are met;
动作捕捉模块用于采集货主的动作信息,并将动作信息进行解码处理,输出多帧连续图像,并标定为待分析图像;The motion capture module is used to collect the motion information of the cargo owner, decode and process the motion information, output multiple frames of continuous images, and calibrate them as images to be analyzed;
特征分析模块用于获取所有待分析图像,并将待分析图像输入至趋势分析模型中,输出货主的动作变化趋势;The feature analysis module is used to obtain all the images to be analyzed, input the images to be analyzed into the trend analysis model, and output the movement trend of the owner;
预测模块用于根据动作变化趋势预测货主的手臂姿态,并输出为预测姿态;The prediction module is used to predict the arm posture of the cargo owner according to the movement trend, and output it as the predicted posture;
二级判定模块用于获取预测姿态,并根据预测姿态调整无人机的悬停位置;The secondary judgment module is used to obtain the predicted attitude, and adjust the hovering position of the drone according to the predicted attitude;
中控模块用于收发数据采集模块、特征提取模块、一级判定模块、动作捕捉模块、特征分析模块、预测模块以及二级判定模块之间的流转信息。The central control module is used to send and receive the transfer information between the data acquisition module, feature extraction module, first-level judgment module, motion capture module, feature analysis module, prediction module and second-level judgment module.
如上述,在物流系统中,传统的配送方式多是采用车辆配送,但是城市道路复杂,从而就会导致货物配送的延迟增加,但随着无人机技术的快速发展,其已经能够对一些小型的货物进行配送,使得货物配送的效率相应增加,同时还能够降低相应的人工成本,无人机在配送货物的过程中,往往需要将货物放置到地面,并且还需要停止其运转,避免无人机的螺旋桨伤害收货人或者发货人,这无疑就会增加无人机的启闭频率,进而便会使得无人机运行能耗增加,降低了无人机的续航能力,基于此,本方案采用对货主进行人体姿态识别的方式,控制无人机悬停在货主的前方,无需停止无人机的运转,降低其能量消耗,首先通过数据采集模块来获取待配送货物的信息,以及该货物对应的货主人脸图像,此人脸图像为后续比对过程用的标准图像,数据采集模块包括录入单元,录入单元用于获取货主主动上传的人脸图像,并将此人脸图像标定为标准图像,货主主动上传的人脸图像上限设置为3~5张,此标准图像均需要明确的展示出人体面部的五官,当然,在货物配送之前,需要先行与收货人进行沟通,以确保货物能够准确的配送至货主手中,同时,还应该明确货主是否更改目的地,此非本领域需要保护的技术要点,在此就不加以过多的阐述,在无人机携带货物到达指定位置之后,首先采集货主的人体图像,该人体图像包括面部图像和关节图像,关节图像为货主的手臂与肩部关节,而后利用一级判定模块判断货主的面部图像是否与标准图像一致,在两者一致的情况下,继续判定其手臂关节与肩部关节的位置关系,根据货主的姿态来确定落货方式,从而来决定是进行地面落货还是悬停接货,而货主在观察到无人机时,做出收货姿态可能存在延迟,为保证货物的配送效率,本实施方式还提供了动作捕捉模块,以此来捕捉货主的动作信息,并结合特征分析模块计算出货主的动作变化趋势,最后利用预测模块来预估货主的预测姿态,之后再将预测姿态与标准姿态图像相比较,并根据比较结果实时调整无人机的悬停点位置,从而完成对货物的配送工作,而在货主未作出收货姿态时,则直接将货物放置到货主前方的地面上,而在解除对货物的夹持状态时,需要利用卸货判定模块来确定货物受力是否满足落货参数,落货参数设置为货物与无人机之间的压力变化参数,压力变化参数依据货物重量设置,其中,压力变化参数的取值大于货物重量的二分之一,其目的旨在于使得货物在接触地面之后不会倾斜,也使得货主在接货时能够适应货物重量,避免货物突然掉落而砸伤货主的现象发生。As mentioned above, in the logistics system, the traditional delivery method is mostly vehicle delivery, but the urban roads are complex, which will lead to increased delays in delivery of goods, but with the rapid development of drone technology, it has been able to deliver to some small The delivery of goods can increase the efficiency of goods delivery accordingly, and can also reduce the corresponding labor costs. In the process of delivering goods, UAVs often need to place the goods on the ground, and also need to stop their operation to avoid unmanned If the propeller of the drone hurts the consignee or consignor, this will undoubtedly increase the frequency of opening and closing of the drone, which will increase the energy consumption of the drone and reduce the endurance of the drone. Based on this, this The scheme adopts the method of human body posture recognition for the cargo owner, and controls the UAV to hover in front of the cargo owner without stopping the operation of the UAV to reduce its energy consumption. First, the data acquisition module is used to obtain the information of the goods to be delivered, and the The face image of the cargo owner corresponding to the cargo, this face image is a standard image used in the subsequent comparison process, the data acquisition module includes an input unit, which is used to obtain the facial image uploaded by the cargo owner, and calibrate the facial image as For standard images, the upper limit of face images uploaded by consignors is set to 3 to 5. This standard image needs to clearly show the facial features of the human body. Of course, before the delivery of the goods, it is necessary to communicate with the consignee first to ensure The goods can be accurately delivered to the owner. At the same time, it should be clear whether the owner changes the destination. This is not a technical point that needs to be protected in this field. I will not elaborate here. After the drone carries the goods to the designated location , first collect the human body image of the cargo owner, the human body image includes a face image and a joint image, the joint image is the arm and shoulder joints of the cargo owner, and then use the first-level judgment module to judge whether the facial image of the cargo owner is consistent with the standard image, and if the two are consistent In this case, continue to determine the positional relationship between the arm joints and the shoulder joints, and determine the delivery method according to the posture of the owner, so as to decide whether to drop the goods on the ground or to pick up the goods by hovering. When the owner observes the drone , there may be a delay in making the gesture of receiving the goods. In order to ensure the delivery efficiency of the goods, this embodiment also provides a motion capture module to capture the action information of the owner of the goods, and combine the feature analysis module to calculate the movement trend of the owner. Finally, the prediction module is used to estimate the predicted attitude of the cargo owner, and then the predicted attitude is compared with the standard attitude image, and the position of the hovering point of the UAV is adjusted in real time according to the comparison results, so as to complete the delivery of the goods. When the receiving posture is not made, the goods are directly placed on the ground in front of the owner of the goods, and when the clamping state of the goods is released, it is necessary to use the unloading judgment module to determine whether the force of the goods meets the unloading parameters, and the unloading parameter settings is the pressure change parameter between the cargo and the UAV. The pressure change parameter is set according to the weight of the cargo. The value of the pressure change parameter is greater than half of the cargo weight. The purpose is to make the cargo not touch the ground. The inclination also enables the cargo owner to adapt to the weight of the cargo when receiving the cargo, and avoids the phenomenon that the cargo suddenly falls and hurts the cargo owner.
在一个较佳的实施方式中,还包括通信模块,通信模块用于提醒货主选择落货方式;In a preferred embodiment, it also includes a communication module, which is used to remind the owner of the cargo to choose the delivery method;
若货主选择悬停接货,则无人机悬停于货主的前方;If the cargo owner chooses to hover to pick up the cargo, the drone will hover in front of the cargo owner;
若货主选择地面落货,则无人机将货物放置于地面;If the cargo owner chooses to drop the cargo on the ground, the drone will place the cargo on the ground;
若货主未进行回应,则通过一级判定模块识别货主的人体图像,且根据识别结果自动确定落货方式。If the owner of the goods does not respond, the body image of the owner is recognized through the first-level judgment module, and the delivery method is automatically determined according to the recognition result.
在该实施方式中,货物配送之前可以通过通信模块提醒货主自主选择落货方式,因为无人机所配送的货物中可能存在易碎品或者贵重物品等,故而先行与货主沟通并核实落货方式是十分必要的,而在货主未回应时,则通过一级判定模块的判定结果自主确定落货方式。In this embodiment, the communication module can be used to remind the cargo owner to choose the delivery method independently before the delivery of the goods, because there may be fragile or valuable items in the goods delivered by the drone, so communicate with the owner first and verify the delivery method It is very necessary, and when the owner of the goods does not respond, the delivery method is determined independently through the judgment result of the first-level judgment module.
其次,特征提取模块包括第一执行单元和第二执行单元,第一执行单元的执行优先权高于第二执行单元的执行优先权;Secondly, the feature extraction module includes a first execution unit and a second execution unit, and the execution priority of the first execution unit is higher than that of the second execution unit;
第一执行单元执行时,捕捉货主的面部图像,并将面部图像上传至一级判定模块;When the first execution unit executes, it captures the facial image of the cargo owner, and uploads the facial image to the first-level judgment module;
第二执行单元执行时,捕捉货主的关节图像,并将关节图像上传至一级判定模块,其中,关节图像包括肩关节特征、肘关节特征以及腕关节特征。When the second execution unit executes, it captures the joint image of the cargo owner and uploads the joint image to the first-level determination module, wherein the joint image includes shoulder joint features, elbow joint features and wrist joint features.
上述中,无人机的前端搭载有双目相机,用于采集货主的人脸图像和关节图像,并且采集人脸图像的优先权要高于采集关节图像的优先权,在无人机到达指定位置之后,双目相机会采集货物的人体图像和动作信息,并将该人体图像上传至一级判定模块和二级判定模块,为是否解除对货物的限定提供数据支持。Among the above, the front end of the UAV is equipped with a binocular camera, which is used to collect the face image and joint image of the owner, and the priority of collecting face images is higher than that of joint images. When the UAV arrives at the specified After the location, the binocular camera will collect the human body image and motion information of the cargo, and upload the human body image to the first-level judgment module and the second-level judgment module to provide data support for whether to lift the restrictions on the goods.
再其次,一级判定模块包括第一判定单元和第二判定单元,第一判定单元的执行优先权高于第二判定单元的执行优先权;Next, the primary judgment module includes a first judgment unit and a second judgment unit, and the execution priority of the first judgment unit is higher than that of the second judgment unit;
第一判定单元用于判断面部图像是否与标准图像一致;The first judging unit is used to judge whether the face image is consistent with the standard image;
若一致,则判定货主信息准确,并将无人机悬停于货主的正前方;If they are consistent, it is determined that the information of the cargo owner is accurate, and the drone is hovered directly in front of the cargo owner;
若不一致,则判定货主信息不符,且不执行第二判定单元;If inconsistent, it is determined that the owner information does not match, and the second determination unit is not executed;
第二判定单元用于判断肩关节特征、肘关节特征以及腕关节特征的位置关系;The second judging unit is used for judging the positional relationship of the shoulder joint features, the elbow joint features and the wrist joint features;
若腕关节特征位于肘关节特征的上方、肘关节特征位于肩关节特征的上方,则判定货主选择空中悬停接货;If the wrist joint feature is above the elbow joint feature and the elbow joint feature is above the shoulder joint feature, it is determined that the owner chooses to hover in the air to pick up the goods;
若肩关节特征位于肘关节特征的上方,则判定货主选择地面落货。If the shoulder joint feature is above the elbow joint feature, it is determined that the cargo owner chooses to drop the cargo on the ground.
该实施方式中,在双目相机采集到货主的人脸图像之后,立即将其上传至第一判定单元中,第一判定单元将该人脸图像与标准图像进行比较,判断其比对结果是否一致,并且在其比对结果一致的情况下,执行第二判定单元,第二判定单元判断肩关节特征、肘关节特征以及腕关节特征的位置关系,在腕关节特征、肘关节特征和肩关节特征由高至低的顺序排列时,才能判定货主处于收货姿态,确定货主选择悬停接货,此时无人机携带货物悬停在货主的前方即可,而在货主肩关节特征位于肘关节特征的上方时,则判定货主选择地面落货,而货主收货姿态可能存在延迟,此时便需要结合动作捕捉模块来采集货主的动作信息,输出货主的动作变化趋势,判断货主的腕关节特征是否上升,若是,则判定货主选择悬停接货,反之则判定货主选择地面落货;In this embodiment, after the binocular camera captures the owner's face image, it is immediately uploaded to the first judging unit, and the first judging unit compares the face image with the standard image, and judges whether the comparison result is Consistent, and in the case of the same comparison results, execute the second determination unit, the second determination unit determines the positional relationship between the shoulder joint features, elbow joint features and wrist joint features, and the wrist joint features, elbow joint features and shoulder joint features When the features are arranged in order from high to low, it can be determined that the cargo owner is in the receiving posture, and it is determined that the cargo owner chooses to hover to receive the cargo. At this time, the UAV can carry the cargo and hover in front of the cargo owner. The shoulder joint feature of the cargo owner is located at the elbow. When the joint feature is above, it is determined that the owner chooses to drop the goods on the ground, and the owner’s receiving posture may be delayed. At this time, it is necessary to combine the motion capture module to collect the movement information of the owner, output the movement trend of the owner, and judge the owner’s wrist joint. Whether the feature is rising, if so, it is determined that the owner of the goods chooses to hover to pick up the goods, otherwise, it is determined that the owner of the goods chooses to drop the goods on the ground;
此处,需要说明的是,腕关节特征、肘关节特征和肩关节特征确定后,以肩关节特征为原点,构建虚拟坐标系,且确定腕关节特征、肘关节特征和肩关节特征的边缘坐标点,并比较这些边缘坐标点的纵坐标即可。Here, it needs to be explained that after the wrist joint feature, elbow joint feature and shoulder joint feature are determined, a virtual coordinate system is constructed with the shoulder joint feature as the origin, and the edge coordinates of the wrist joint feature, elbow joint feature and shoulder joint feature are determined point, and compare the vertical coordinates of these edge coordinate points.
再其次,二级判定模块内预设有标准姿态图像,并在获取预测姿态之后与其进行比较;Secondly, the standard posture image is preset in the secondary judgment module, and compared with it after obtaining the predicted posture;
若预测姿态与标准姿态图像一致,则无人机悬停于指定位置;If the predicted attitude is consistent with the standard attitude image, the UAV hovers at the specified position;
若预测姿态与标准姿态图像不一致,则生成偏差距离,并将无人机的悬停位置调整至预测姿态的位置。If the predicted attitude is inconsistent with the standard attitude image, a deviation distance is generated, and the hovering position of the UAV is adjusted to the position of the predicted attitude.
在该实施方式中,在对货主的手臂姿态进行预测时,首先通过动作捕捉模块获取货主的动作信息,此动作信息为视频信息,在捕捉到视频信息之后,将其输入至解码器中进行解码处理,健儿便可得到多帧且连续的关节图像,并分别获取这些关节图像中肩关节特征、肘关节特征以及腕关节特征的边缘坐标,并将这些边缘坐标标定为待评估坐标,而后从趋势分析模型中调用趋势分析函数,并将待评估坐标输入至趋势分析函数中,进而便可得到待评估坐标的变化趋势值,且待评估坐标设置为腕关节特征、肘关节特征和肩关节特征的纵坐标,其中,趋势分析函数为:,式中,/>表示待评估坐标的变化趋势值,/>表示待评估坐标的数量,/>表示待评估坐标的编号,并不参与实际的运算,/>和/>均表示待评估坐标,在得到待评估坐标的变化趋势值之后,立即对其进行判定,若是待评估坐标的变化趋势值的取值为负,则判定货主未处于收货姿态,且默认货主选择地面落货,若待评估坐标的变化趋势值的取值为正,则判定货主存在收货趋势,则判定货主选择悬停接货,并且测算其预测姿态,此预测姿态为货主腕关节特征、肘关节特征和肩关节特征按照由高至低排列时的临界点坐标,预测姿态若与标准图像姿态一致,则无人机不改变悬停点,反之,则计算标准图像中腕关节特征与预测姿态中腕关节特征的偏差距离,且无人机根据此偏差距离调整悬停点即可。In this embodiment, when predicting the arm posture of the owner, the motion information of the owner is first obtained through the motion capture module, which is video information, and after the video information is captured, it is input into the decoder for decoding After processing, athletes can obtain multiple frames of continuous joint images, and obtain the edge coordinates of the shoulder joint features, elbow joint features, and wrist joint features in these joint images, and mark these edge coordinates as the coordinates to be evaluated, and then from the trend The trend analysis function is called in the analysis model, and the coordinates to be evaluated are input into the trend analysis function, and then the change trend value of the coordinates to be evaluated can be obtained, and the coordinates to be evaluated are set as the wrist joint features, elbow joint features and shoulder joint features. The ordinate, where the trend analysis function is: , where, /> Indicates the change trend value of the coordinates to be evaluated, /> Indicates the number of coordinates to evaluate, /> Indicates the number of the coordinate to be evaluated, and does not participate in the actual operation, /> and /> Both represent the coordinates to be evaluated. After the change trend value of the coordinates to be evaluated is obtained, it is judged immediately. If the value of the change trend value of the coordinates to be evaluated is negative, it is determined that the owner is not in the attitude of receiving goods, and the default owner chooses For ground delivery, if the change trend value of the coordinates to be evaluated is positive, it is determined that the owner has a receiving trend, then it is determined that the owner chooses to hover to pick up the goods, and the predicted attitude is calculated. This predicted attitude is the characteristic of the owner's wrist joint, Elbow joint features and shoulder joint features are arranged according to the critical point coordinates from high to low. If the predicted attitude is consistent with the standard image attitude, the drone will not change the hovering point. Otherwise, the wrist joint features in the standard image and the predicted The deviation distance of the wrist joint feature in the posture, and the drone can adjust the hovering point according to the deviation distance.
在一个较佳的实施方式中,还包括语音播报模块,语音播报模块用于播放提醒验收语句,例如“请确认货物完好”或者“请收货”等语句。In a preferred embodiment, a voice broadcast module is also included, and the voice broadcast module is used to play reminder acceptance sentences, such as "please confirm that the goods are in good condition" or "please accept the goods".
如图3所示,本发明还提供了,一种基于人体姿态识别的物流无人机,应用于上述的基于人体姿态识别的人机物流交互系统,包括机身1,机身1下方设置有用于承载货物的夹持机构2,夹持机构2上设置有拉力传感器,拉力传感器用于检测夹持机构2与所承载货物之间的拉力值;As shown in Figure 3, the present invention also provides a logistics drone based on human body posture recognition, which is applied to the above-mentioned human-machine logistics interaction system based on human body posture recognition, including a fuselage 1, and a useful drone is arranged under the fuselage 1. For the clamping mechanism 2 carrying goods, a tension sensor is provided on the clamping mechanism 2, and the tension sensor is used to detect the tension value between the clamping mechanism 2 and the carried goods;
其中,一级判定模块判定落货方式后,卸货判定模块根据落货方式设定落货参数,该落货参数为夹持机构与所承载货物之间的压力变化值,当拉力传感器检测到夹持机构2的受力满足落货参数时,夹持机构解除对货物的夹持。Among them, after the first-level determination module determines the unloading mode, the unloading determination module sets the unloading parameter according to the unloading mode. The unloading parameter is the pressure change value between the clamping mechanism and the loaded cargo. When the force of the holding mechanism 2 satisfies the unloading parameters, the holding mechanism releases the holding of the goods.
上述中,在承载货物降落至地面或者货主的手掌中之后,承载货物会受到来自地面的支撑力或者货主手掌的托举力,此时夹持机构2的受力减小,相应的,拉力传感器的拉力值也就会减小,在其减少值满足落货参数时,夹持机构2就会解除对承载货物的夹持,而后货主便可取走货物。In the above, after the loaded cargo falls to the ground or the palm of the cargo owner, the loaded cargo will be supported by the ground or the lifting force of the cargo owner’s palm. At this time, the force of the clamping mechanism 2 is reduced. Correspondingly, the tension sensor The tension value of the pull force will also decrease, and when the reduced value meets the unloading parameter, the clamping mechanism 2 will release the clamping of the loaded goods, and then the owner of the goods can take away the goods.
此外,夹持机构2包括夹持板201和双向伸缩杆202,夹持板201设置有两个,两个夹持板201均设置于机身1的下方,双向伸缩杆202固定安装于机身1的底端,且双向伸缩杆202的两端分别与两个夹持板201的顶端固定连接。In addition, the clamping mechanism 2 includes a clamping plate 201 and a two-way telescopic rod 202, two clamping plates 201 are provided, the two clamping plates 201 are arranged below the fuselage 1, and the two-way telescopic rod 202 is fixedly installed on the fuselage 1, and the two ends of the two-way telescopic rod 202 are respectively fixedly connected with the top ends of the two clamping plates 201.
进一步的,两个夹持板201均设置为L状,两个夹持板201之间设置有承载货物外箱体,承载货物外箱体的两侧均开设有与夹持板201相对应的卡接槽口。Further, the two clamping plates 201 are both arranged in an L-shape, and an outer box for carrying goods is arranged between the two clamping plates 201, and the two sides of the outer box for carrying goods are provided with corresponding openings for the holding plates 201. snap slot.
具体的,在拉力传感器的减少值满足落货参数后,双向伸缩杆202动作,并带动两个夹持板201向远离承载货物外箱体的两侧移动,此时,承载货物外箱体所受限制便被解除,之后货主再行取走货物即可。Specifically, after the reduction value of the tension sensor satisfies the unloading parameter, the two-way telescopic rod 202 moves, and drives the two clamping plates 201 to move away from the two sides of the outer box carrying the goods. At this time, the outer box carrying the goods The restriction will be lifted, and then the owner of the goods can take away the goods.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其它变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、装置、物品或者方法不仅包括那些要素,而且还包括没有明确列出的其它要素,或者是还包括为这种过程、装置、物品或者方法所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、装置、物品或者方法中还存在另外的相同要素。It should be noted that, in this document, the terms "comprising", "comprising" or any other variation thereof are intended to cover a non-exclusive inclusion such that a process, apparatus, article or method comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, apparatus, article, or method. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional same elements in the process, apparatus, article or method comprising the element.
以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以作出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。本发明中未具体描述和解释说明的结构、装置以及操作方法,如无特别说明和限定,均按照本领域的常规手段进行实施。The above is only a preferred embodiment of the present invention, it should be pointed out that for those of ordinary skill in the art, without departing from the principle of the present invention, some improvements and modifications can also be made, and these improvements and modifications should also be It is regarded as the protection scope of the present invention. The structures, devices and operation methods not specifically described and explained in the present invention, unless otherwise specified and limited, shall be implemented according to conventional means in the art.
Claims (7)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310499993.0A CN116229582B (en) | 2023-05-06 | 2023-05-06 | Logistics unmanned aerial vehicle and man-machine logistics interactive system based on human body gesture recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310499993.0A CN116229582B (en) | 2023-05-06 | 2023-05-06 | Logistics unmanned aerial vehicle and man-machine logistics interactive system based on human body gesture recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116229582A CN116229582A (en) | 2023-06-06 |
| CN116229582B true CN116229582B (en) | 2023-08-04 |
Family
ID=86579065
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310499993.0A Active CN116229582B (en) | 2023-05-06 | 2023-05-06 | Logistics unmanned aerial vehicle and man-machine logistics interactive system based on human body gesture recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116229582B (en) |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9459620B1 (en) * | 2014-09-29 | 2016-10-04 | Amazon Technologies, Inc. | Human interaction with unmanned aerial vehicles |
| US9536216B1 (en) * | 2014-12-18 | 2017-01-03 | Amazon Technologies, Inc. | Delivery of packages by unmanned aerial vehicles |
| CN106327128A (en) * | 2016-08-26 | 2017-01-11 | 成都畅达网通讯科技有限公司 | Intelligent one-stop freight tracking settlement system and tracking settlement method |
| CN106809393A (en) * | 2016-10-21 | 2017-06-09 | 北京京东尚科信息技术有限公司 | A kind of freight transportation method based on unmanned plane |
| CA2997077A1 (en) * | 2017-03-06 | 2018-09-06 | Walmart Apollo, Llc | Apparatuses and methods for gesture-controlled unmanned aerial vehicles |
| CN109696923A (en) * | 2017-10-20 | 2019-04-30 | 成都麦动信息技术有限公司 | Intelligent delivery method and device |
| US20200202284A1 (en) * | 2018-12-21 | 2020-06-25 | Ford Global Technologies, Llc | Systems, methods, and devices for item delivery using unmanned aerial vehicles |
| CN110458494A (en) * | 2019-07-19 | 2019-11-15 | 暨南大学 | A kind of unmanned aerial vehicle logistics delivery method and system |
| CN114220157A (en) * | 2021-12-30 | 2022-03-22 | 安徽大学 | Recognition method of consignee based on face alignment and face recognition in drone delivery |
| CN115063073B (en) * | 2022-06-10 | 2024-04-16 | 安徽大学 | Efficient and secret unmanned aerial vehicle collaborative distribution method |
| CN115050080A (en) * | 2022-07-22 | 2022-09-13 | 安徽大学 | Target identification method and system based on face fusion in multi-unmanned aerial vehicle cooperative distribution |
-
2023
- 2023-05-06 CN CN202310499993.0A patent/CN116229582B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN116229582A (en) | 2023-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110687902B (en) | System and method for controller-free user drone interaction | |
| US11787541B2 (en) | Safeguarded delivery of goods by unmanned aerial vehicles | |
| US10222800B2 (en) | System and method for automated aerial system operation | |
| CN106873623B (en) | A rapid autonomous endurance system for unmanned aerial vehicles and method thereof | |
| CN113034072B (en) | Unmanned aerial vehicle intelligent distribution system and method based on Internet of things | |
| CN110692027A (en) | System and method for providing easy-to-use release and automatic positioning of drone applications | |
| CN109502039A (en) | A kind of vehicle-mounted unmanned aerial vehicle stops cabinet equipment, automatic replacement battery methods and system | |
| US20230280763A1 (en) | Method for protection unmanned aerial vehicle and unmanned aerial vehicle | |
| CN106444843A (en) | Unmanned aerial vehicle relative azimuth control method and device | |
| WO2020107468A1 (en) | Control method for unmanned device, and unmanned vehicle | |
| CN106101511A (en) | A kind of full-automatic unmanned machine system | |
| CN104950908B (en) | Stratospheric airship horizontal level control system and implementation method | |
| KR102220394B1 (en) | System and method for automatic aviation system operation | |
| WO2017185363A1 (en) | Method, apparatus, and system for controlling unmanned aerial vehicle | |
| CN104950902A (en) | Multi-rotor aircraft and control method thereof | |
| WO2020123605A1 (en) | Systems, apparatuses, and methods for detecting escalators | |
| CN205909832U (en) | Unmanned aerial vehicle navigation based on machine vision | |
| CN108364159A (en) | A kind of unmanned plane logistics face label device and method | |
| CN206757791U (en) | A kind of unmanned plane receives cabinet | |
| CN109508037B (en) | Auxiliary charging system for drone | |
| CN116229582B (en) | Logistics unmanned aerial vehicle and man-machine logistics interactive system based on human body gesture recognition | |
| WO2023193604A1 (en) | Route task online planning method and related apparatus | |
| CN207282003U (en) | The intelligent control bracelet and UAV system of unmanned plane | |
| CN111580533B (en) | Aerodynamics-based UAV information collection method and device | |
| CN109597424A (en) | Unmanned plane line walking control system based on video image processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230713 Address after: 541000 No.1 Jinji Road, Qixing District, Guilin City, Guangxi Zhuang Autonomous Region Applicant after: GUILIN University OF ELECTRONIC TECHNOLOGY Address before: Room 205B, block B, animation building, No.11 Xinghuo Road, Jiangbei new district, Nanjing, Jiangsu 210000 Applicant before: Nanjing Hongwu Software Technology Co.,Ltd. Applicant before: GUILIN University OF ELECTRONIC TECHNOLOGY |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20230606 Assignee: Jiangsu Xinling Intelligent Technology Co.,Ltd. Assignor: GUILIN University OF ELECTRONIC TECHNOLOGY Contract record no.: X2025980010189 Denomination of invention: A logistics drone and human-machine logistics interaction system based on human posture recognition Granted publication date: 20230804 License type: Common License Record date: 20250609 |