[go: up one dir, main page]

CN116686638A - Automatic Morchella picking robot for greenhouse planting - Google Patents

Automatic Morchella picking robot for greenhouse planting Download PDF

Info

Publication number
CN116686638A
CN116686638A CN202310849123.1A CN202310849123A CN116686638A CN 116686638 A CN116686638 A CN 116686638A CN 202310849123 A CN202310849123 A CN 202310849123A CN 116686638 A CN116686638 A CN 116686638A
Authority
CN
China
Prior art keywords
picking
morchella
image information
personal computer
industrial personal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310849123.1A
Other languages
Chinese (zh)
Other versions
CN116686638B (en
Inventor
朱明�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuxi Haiji Intelligent Robot Co ltd
Original Assignee
Wuxi Haiji Intelligent Robot Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuxi Haiji Intelligent Robot Co ltd filed Critical Wuxi Haiji Intelligent Robot Co ltd
Priority to CN202310849123.1A priority Critical patent/CN116686638B/en
Publication of CN116686638A publication Critical patent/CN116686638A/en
Application granted granted Critical
Publication of CN116686638B publication Critical patent/CN116686638B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01GHORTICULTURE; CULTIVATION OF VEGETABLES, FLOWERS, RICE, FRUIT, VINES, HOPS OR SEAWEED; FORESTRY; WATERING
    • A01G18/00Cultivation of mushrooms
    • A01G18/70Harvesting
    • AHUMAN NECESSITIES
    • A01AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01GHORTICULTURE; CULTIVATION OF VEGETABLES, FLOWERS, RICE, FRUIT, VINES, HOPS OR SEAWEED; FORESTRY; WATERING
    • A01G18/00Cultivation of mushrooms
    • A01G18/80Accessories for use after harvesting, e.g. scrapers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/22Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A40/00Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
    • Y02A40/10Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in agriculture
    • Y02A40/25Greenhouse technology, e.g. cooling systems therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Multimedia (AREA)
  • Environmental Sciences (AREA)
  • Biomedical Technology (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Mycology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Molecular Biology (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)

Abstract

The application relates to an automatic Morchella picking robot for greenhouse planting, and belongs to the technical field of fungus picking. The robot comprises a hollow motion chassis and a triaxial right-angle mechanical arm arranged at the top of the motion chassis, wherein a vision system is carried on the automatic picking robot, a mushroom storage device is fixedly arranged on the motion chassis, a picking clamping jaw is arranged at the output end of the triaxial right-angle mechanical arm, and the vision system comprises a first camera used for acquiring front road image information, a second camera and a third camera used for acquiring Morchella image information and an industrial personal computer used for receiving the image information. According to the automatic picking robot, the visual navigation information is obtained by analyzing the image information acquired by the first camera through the industrial personal computer, a motion instruction is sent to the motion chassis, so that the automatic picking robot walks along the small channels on two sides of a given land, and the three-axis right-angle mechanical arm is matched with the picking clamping jaw to shear and harvest each Morchella one by one, so that automatic picking of Morchella on the land planted in a greenhouse is realized, the labor is saved, and the picking efficiency is improved.

Description

一种大棚种植羊肚菌自动采摘机器人An automatic picking robot for growing hickory chicks in greenhouses

技术领域technical field

本发明属于菌菇采摘技术领域,具体涉及一种大棚种植羊肚菌自动采摘机器人。The invention belongs to the technical field of mushroom picking, and in particular relates to an automatic picking robot for growing hickory chicks in a greenhouse.

背景技术Background technique

羊肚菌是一种珍稀的食药兼用菌,其菌盖整体呈塔形,菌盖表面具有网状的凸起褶皱,褶皱之间形成近似羊肚状的凹坑。在营养生长阶段,羊肚菌的培养较为容易,而在出菇阶段,羊肚菌的培养难度较大,对温湿度条件的要求较高,导致市面上销售的羊肚菌多为野生菌菇,随着大棚种植技术的发展,人工种植羊肚菌的技术日趋完善,只要协调好温度、湿度与通风的关系,即可实现大规模的羊肚菌人工种植。Morchella is a rare edible and medicinal fungus. Its cap is in the shape of a tower as a whole. The surface of the cap has net-like raised folds, and morel-shaped pits are formed between the folds. In the vegetative growth stage, the cultivation of morels is relatively easy, but in the fruiting stage, the cultivation of morels is more difficult, and the requirements for temperature and humidity conditions are higher, resulting in that most of the morels sold on the market are wild mushrooms , With the development of greenhouse planting technology, the technology of artificially planting morels is becoming more and more perfect. As long as the relationship between temperature, humidity and ventilation is coordinated, large-scale artificial planting of morels can be realized.

现有技术通过人工采摘的方式采收羊肚菌,羊肚菌的采摘不同于普通菌种,在采收羊肚菌的过程中不能将其连根拔起,采收时轻握菌柄,使用采收刀具切割羊肚菌的子实体,保留部分菌柄,使羊肚菌的原基继续生长,以实现持续出菇,提高产量。由此可见,羊肚菌的采摘过程较为繁琐,采收期间耗费大量人力成本,人力采摘过程中,采摘者的手掌容易接触菌菇表面残留的农药,不利于种植人员的身体健康,羊肚菌的采摘效率也有待提高,在大棚种植羊肚菌的过程中,亟须一种针对羊肚菌的自动采摘机器人来优化菌菇采摘模式。In the prior art, morels are harvested by manual picking. The picking of morels is different from common strains. During the process of harvesting morels, the morels cannot be uprooted. The cutting tool cuts the fruiting body of the morel, and retains part of the stipe, so that the primordia of the morel can continue to grow, so as to achieve continuous fruiting and increase yield. It can be seen that the picking process of hickory chicks is relatively cumbersome, and a lot of labor costs are consumed during the harvesting process. During the manual picking process, the palms of the pickers are likely to come into contact with the residual pesticides on the surface of the mushrooms, which is not conducive to the health of the growers. The picking efficiency of morels also needs to be improved. In the process of growing morels in greenhouses, there is an urgent need for an automatic picking robot for morels to optimize the mushroom picking mode.

发明内容Contents of the invention

本发明的目的就在于为了解决上述问题而提供一种结构简单,设计合理的大棚种植羊肚菌自动采摘机器人。The purpose of the present invention is just to provide a kind of simple in structure in order to solve the above-mentioned problem, the automatic picking robot of greenhouse planting hickory chick rationally designed.

本发明通过以下技术方案来实现上述目的:The present invention achieves the above object through the following technical solutions:

一种大棚种植羊肚菌自动采摘机器人,包括中空运动底盘和设于运动底盘顶部的三轴直角机械臂,该自动采摘机器人上搭载有视觉系统,所述运动底盘上固设有菌菇存放装置,所述三轴直角机械臂的输出端安装有采摘夹爪,所述视觉系统用于向运动底盘、三轴直角机械臂和采摘夹爪发送控制指令;An automatic picking robot for growing hickory chicks in a greenhouse, comprising a hollow moving chassis and a three-axis right-angle mechanical arm arranged on the top of the moving chassis, the automatic picking robot is equipped with a vision system, and a mushroom storage device is fixed on the moving chassis , the output end of the three-axis right-angle mechanical arm is equipped with picking claws, and the vision system is used to send control instructions to the moving chassis, three-axis right-angle mechanical arm and picking claws;

所述视觉系统包括用于采集前方道路图像信息的第一摄像头、用于采集羊肚菌图像信息的第二摄像头和第三摄像头以及用于接收图像信息的工控机,所述工控机结合图像信息向运动底盘传递运动指令,以使该自动采摘机器人沿既定地垄二侧小道行走,并向三轴直角机械臂和采摘夹爪传递采摘指令,以使三轴直角机械臂配合采摘夹爪剪切羊肚菌,并将羊肚菌运输至菌菇存放装置之中。The vision system includes a first camera for collecting image information of the road ahead, a second camera and a third camera for collecting morel image information, and an industrial computer for receiving image information, and the industrial computer combines image information Transmit motion instructions to the moving chassis so that the automatic picking robot walks along the trails on both sides of the predetermined ridge, and transmit picking instructions to the three-axis right-angle manipulator and the picking jaws so that the three-axis right-angle manipulator cooperates with the picking jaws to cut Morchella, and transport the Morchella to the mushroom storage device.

作为本发明的进一步优化方案,所述运动底盘包括矩形中空底框、设于底框后侧底端的两个电动轮和设于底框前侧底端的两个万向轮,所述底框前端一侧固设有用于固定工控机的机箱。As a further optimization solution of the present invention, the sports chassis includes a rectangular hollow bottom frame, two electric wheels arranged at the bottom end of the rear side of the bottom frame, and two universal wheels arranged at the bottom end of the front side of the bottom frame, and the front end of the bottom frame One side is fixed with a chassis for fixing the industrial computer.

作为本发明的进一步优化方案,所述三轴直角机械臂包括设于底框一侧顶端的横向传送带、设于横向传送带一端的第一驱动电机、固设于底框另一侧的限位杆、滑动设于限位杆上的纵向机架、滑动设于纵向机架上的竖向机架、固设于纵向机架一端的第一丝杆电机、滑动设于竖向机架上的滑块和固设于竖向机架顶端的第二丝杆电机,所述纵向机架远离限位杆的一端与横向传送带相互固定,所述第一丝杆电机的输出轴与竖向机架螺纹连接,所述第二丝杆电机的输出轴与滑块螺纹连接。As a further optimization solution of the present invention, the three-axis right-angle mechanical arm includes a transverse conveyor belt arranged at the top of one side of the bottom frame, a first drive motor arranged at one end of the transverse conveyor belt, and a limit rod fixed on the other side of the bottom frame , slide the longitudinal frame set on the limit rod, slide the vertical frame set on the longitudinal frame, the first screw motor fixed at one end of the longitudinal frame, slide the slide set on the vertical frame Block and the second screw motor fixed on the top of the vertical frame, the end of the longitudinal frame away from the limit rod is fixed with the horizontal conveyor belt, the output shaft of the first screw motor is threaded with the vertical frame connected, the output shaft of the second screw motor is threaded with the slider.

作为本发明的进一步优化方案,所述竖向机架靠近纵向机架的一端转动设有上下两组导向轮,上下两组所述导向轮分别与纵向机架的上下两端相抵,所述纵向机架与每组导向轮之间均设置有导向杆,所述导向轮外侧开设有与导向杆对应的环形凹槽。As a further optimization scheme of the present invention, one end of the vertical frame close to the longitudinal frame is rotated to be provided with two sets of guide wheels, the upper and lower sets of guide wheels respectively offset the upper and lower ends of the longitudinal frame, and the longitudinal A guide rod is arranged between the frame and each set of guide wheels, and an annular groove corresponding to the guide rod is provided on the outer side of the guide wheels.

作为本发明的进一步优化方案,所述采摘夹爪包括固定设于滑块底端的安装架、固设于安装架一端的第二驱动电机、固设于第二驱动电机输出端的摇臂、分别铰接于摇臂两端的两个摆臂、铰接于摆臂远离摇臂的一端的夹块、固设于夹块底端的夹刀和刀架以及分别固设于两个刀架相靠近的一端的切刀,所述夹块滑动设于安装架底端。As a further optimization solution of the present invention, the picking jaws include a mounting frame fixed at the bottom end of the slider, a second drive motor fixed at one end of the mounting frame, a rocker arm fixed at the output end of the second drive motor, respectively hinged Two swing arms at both ends of the rocker arm, a clamping block hinged at the end of the swinging arm away from the rocking arm, a clamping knife and a knife holder fixed at the bottom of the clamping block, and a cutting tool respectively fixed at the end of the two knife rests close to each other. knife, and the clamp block is slidably arranged at the bottom end of the mounting frame.

作为本发明的进一步优化方案,两个所述刀架相互对称,两个所述夹刀相互对称且两个夹刀位于两个刀架之间,两个所述夹刀相对的一端设有减压层。As a further optimization solution of the present invention, the two tool holders are symmetrical to each other, the two clamping knives are symmetrical to each other and the two clamping knives are located between the two tool holders, and the opposite ends of the two clamping knives are provided with a relief laminated.

作为本发明的进一步优化方案,所述夹刀相对的一端到安装架中轴线的距离从上向下逐渐缩短,所述减压层顶部向上延伸并与夹块相互固定,所述减压层由柔软材料制成。As a further optimization solution of the present invention, the distance from the opposite end of the clamping knife to the central axis of the mounting frame is gradually shortened from top to bottom, the top of the decompression layer extends upward and is fixed with the clamping block, and the decompression layer consists of Made of soft material.

作为本发明的进一步优化方案,所述菌菇存放装置包括固设于底框前端中部的采摘筐和倾斜设于采摘筐一侧的滑道。As a further optimization solution of the present invention, the mushroom storage device includes a picking basket fixed at the middle of the front end of the bottom frame and a slideway inclined at one side of the picking basket.

作为本发明的进一步优化方案,所述采摘筐内侧滑动设于接料板,所述接料板与采摘筐的底壁弹性连接。As a further optimization solution of the present invention, the inner side of the picking basket is slidably arranged on the material receiving plate, and the material receiving plate is elastically connected to the bottom wall of the picking basket.

一种大棚种植羊肚菌的采摘方法,包括以下步骤:A method for picking morels grown in greenhouses, comprising the following steps:

S1、建立菌菇模型S1. Establish mushroom model

a.样本采集a. Sample collection

拍摄多张羊肚菌图片,将图片分为两组,一组图片作为训练集,用于训练羊肚菌检测模型,另一组图片作为测试集,用于测试羊肚菌检测模型的准确率;Take multiple morel pictures and divide the pictures into two groups. One set of pictures is used as a training set for training the morel detection model, and the other set of pictures is used as a test set for testing the accuracy of the morel detection model ;

b.样本预处理b. Sample preprocessing

对训练集的图像信息进行预处理,羊肚菌菌盖表面的褶皱形成塔形网状线,对训练集图像信息中的塔形网状线进行线特征提取;The image information of the training set is preprocessed, and the folds on the surface of the morel cap form a tower-shaped network line, and the line feature extraction is performed on the tower-shaped network line in the image information of the training set;

c.模型构建c. Model building

将预处理后得到的线特征写入工控机的存储器中,通过YOLO算法对线特征进行迭代训练,获得羊肚菌检测模型;Write the line features obtained after preprocessing into the memory of the industrial computer, and iteratively train the line features through the YOLO algorithm to obtain the morel detection model;

d.模型测试d. Model testing

利用测试集对羊肚菌检测模型的准确率进行检测,准确率未达标时,再次对模型进行迭代训练,直至羊肚菌检测模型的准确率达标为止;Use the test set to test the accuracy of the morel detection model. When the accuracy is not up to the standard, iteratively train the model again until the accuracy of the morel detection model reaches the standard;

S2、沿既定地垄二侧小道行走S2. Walk along the path on both sides of the established ridge

通过第一摄像头对运动底盘前方区域进行拍摄,以采集前方道路图像信息,并将前方道路图像信息传递至工控机,工控机对前方道路图像信息进行分析,并进行地垄边界的识别,当工控机检测到地垄边界存在时,工控机控制运动底盘间歇性直行,当工控机检测到地垄边界消失时,工控机控制运动底盘差速转向;Use the first camera to shoot the area in front of the moving chassis to collect the image information of the road ahead, and transmit the image information of the road ahead to the industrial computer. The industrial computer analyzes the image information of the road ahead and recognizes the border of the land. When the computer detects the existence of the ridge boundary, the industrial computer controls the moving chassis to go straight intermittently; when the industrial computer detects the disappearance of the ridge boundary, the industrial computer controls the moving chassis to differentially steer;

S3、初级定位S3, primary positioning

该自动采摘机器人行走过程中,当运动底盘止于地笼上方时,通过第二摄像头对底框内的区域进行拍摄,以采集羊肚菌图像信息,并将羊肚菌图像信息传递至工控机,工控机通过羊肚菌检测模型对羊肚菌进行识别,获取羊肚菌的位置分布信息;During the walking process of the automatic picking robot, when the moving chassis stops above the ground cage, the area inside the bottom frame is photographed by the second camera to collect the morel image information, and the morel image information is transmitted to the industrial computer , the industrial computer recognizes the morel through the morel detection model, and obtains the location and distribution information of the morel;

S4、二级定位S4, secondary positioning

工控机根据位置分布信息向三轴直角机械臂发出移动指令,使三轴直角机械臂将采摘夹爪移动至单个羊肚菌上方,通过第三摄像头对采摘夹爪下方的羊肚菌进行拍摄,二次采集羊肚菌图像信息,并将该羊肚菌图像信息传递至工控机,工控机通过羊肚菌检测模型对羊肚菌进行识别,获取单个羊肚菌的精确位置信息,工控机根据精确位置信息向三轴直角机械臂发出移动指令,使三轴直角机械臂对采摘夹爪进行位置修正,以确保采摘夹爪位于羊肚菌正上方,三轴直角机械臂通过第二丝杆电机驱动滑块和滑块底端的采摘夹爪下移,使采摘夹爪包围羊肚菌;The industrial computer sends movement instructions to the three-axis right-angle manipulator according to the position distribution information, so that the three-axis right-angle manipulator moves the picking jaws to the top of a single morel, and uses the third camera to shoot the morels under the picking jaws. The morel image information is collected for the second time, and the image information of the morel is transmitted to the industrial computer. The industrial computer recognizes the morel through the morel detection model and obtains the precise location information of a single morel. The industrial computer according to The precise position information sends a movement command to the three-axis right-angle robotic arm, so that the three-axis right-angle robotic arm can correct the position of the picking jaw to ensure that the picking jaw is directly above the morel, and the three-axis right-angle robotic arm passes the second screw motor Drive the slider and the picking jaws at the bottom of the slider to move down, so that the picking jaws surround the morels;

S5、菌菇剪切与存放S5. Mushroom cutting and storage

工控机向采摘夹爪发出剪切指令,采摘夹爪对羊肚菌进行切割和夹持,接着工控机向三轴直角机械臂发出移动指令,三轴直角机械臂根据移动指令将采摘夹爪移动至滑道上方,工控机向采摘夹爪发出卸料指令,采摘夹爪松开羊肚菌,使羊肚菌沿滑道滑入采摘筐之中。The industrial computer sends a cutting command to the picking jaws, and the picking jaws cut and clamp the morels, and then the industrial computer sends a movement command to the three-axis right-angle robotic arm, and the three-axis right-angle robotic arm moves the picking jaws according to the movement command When reaching the top of the slideway, the industrial computer sends an unloading command to the picking jaws, and the picking jaws release the morels, allowing the morels to slide into the picking basket along the slideway.

本发明的有益效果在于:The beneficial effects of the present invention are:

1)本发明通过视觉系统的第一摄像头采集前方道路图像信息,工控机结合前方道路图像信息向运动底盘传递运动指令,以使该自动采摘机器人沿既定地垄二侧小道行走,视觉系统还能够采集羊肚菌图像信息,工控机向三轴直角机械臂和采摘夹爪传递采摘指令,以使三轴直角机械臂配合采摘夹爪剪切羊肚菌,并将羊肚菌运输至菌菇存放装置之中,以实现大棚种植的地垄上羊肚菌的自动采摘,保障种植者的生命健康,节省人力,提高采摘效率;1) The present invention collects the image information of the road ahead through the first camera of the vision system, and the industrial computer combines the image information of the road ahead to transmit motion instructions to the moving chassis, so that the automatic picking robot can walk along the trails on both sides of the predetermined ridge, and the vision system can also Collect the morel image information, and the industrial computer transmits picking instructions to the three-axis right-angle manipulator and the picking jaws, so that the three-axis right-angle manipulator cooperates with the picking jaws to cut the morels, and transport the morels to the mushroom storage In the device, to realize the automatic picking of Morchella on the ridge planted in the greenhouse, to ensure the life and health of the grower, save manpower, and improve the picking efficiency;

2)本发明在建立羊肚菌检测模型的过程中,通过提取羊肚菌表面褶皱形成的塔形网状线这一线特征,以完成羊肚菌检测模型的构建,提高视觉系统对羊肚菌的识别能力,在采集羊肚菌图像信息的过程中,通过第二摄像头配合工控机和三轴直角机械臂对采摘夹爪进行初级定位,通过第三摄像头配合工控机和三轴直角机械臂对采摘夹爪进行二次定位,使机器人对羊肚菌定位更加精准,确保自动采摘机器人能够顺利完成采摘作业;2) the present invention is in the process of setting up the hickory chick detection model, by extracting the line feature of the tower-shaped mesh line that the hickory chick surface fold forms, to complete the construction of the hickory chick detection model, improve the vision system to the hickory chick In the process of collecting morel image information, the picking jaws are initially positioned through the second camera in conjunction with the industrial computer and the three-axis right-angle manipulator, and the third camera is used in conjunction with the industrial computer and the three-axis right-angle manipulator. The second positioning of the picking jaws makes the robot more precisely position the morels, ensuring that the automatic picking robot can successfully complete the picking operation;

3)本发明通过在夹块上设置夹刀和切刀,切割羊肚菌的同时对羊肚菌进行夹持,并在夹刀上设置减压层,增大羊肚菌受力面积,菌菇存放装置接取羊肚菌,采摘夹爪在滑道上方松开羊肚菌,羊肚菌沿滑道滑落至采摘筐中部,通过与采摘筐底壁弹性连接的接料板对羊肚菌进行缓冲,减少羊肚菌受到的冲击,并通过接料板产生的轻微晃动,将采摘筐内的羊肚菌摇匀,提高采摘筐存放菌菇的能力,防止羊肚菌在机器人行走过程中洒落。3) The present invention clamps the hickory chick while cutting the hickory chick by setting a clip knife and a cutter on the clip block, and sets a decompression layer on the clip knife to increase the stress area of the hickory chick, and the bacteria The morels are picked up by the mushroom storage device, and the morels are released by the picking claws above the slideway, and the morels slide down to the middle of the picking basket along the slideway, and the morels are picked up by the material receiving plate elastically connected to the bottom wall of the picking basket. Buffer to reduce the impact on the morels, and through the slight shaking of the receiving plate, shake the morels in the picking basket evenly, improve the ability of the picking basket to store mushrooms, and prevent the morels from being moved by the robot during walking spilled.

附图说明Description of drawings

图1是本发明的整体结构示意图;Fig. 1 is the overall structural representation of the present invention;

图2是本发明的运动底盘结构示意图;Fig. 2 is a schematic structural view of the sports chassis of the present invention;

图3是本发明的三轴直角机械臂结构示意图;Fig. 3 is a structural schematic diagram of a three-axis right-angle mechanical arm of the present invention;

图4是本发明的菌菇存放装置剖面结构示意图;Fig. 4 is a schematic sectional structure diagram of the mushroom storage device of the present invention;

图5是本发明的三轴直角机械臂Z轴结构示意图;Fig. 5 is a schematic diagram of the Z-axis structure of the three-axis right-angle mechanical arm of the present invention;

图6是本发明的采摘夹爪侧面的立体图;Fig. 6 is a perspective view of the side of the picking jaw of the present invention;

图7是本发明的既定地垄二侧小道路线示意图。Fig. 7 is a schematic diagram of the path route on the two sides of the predetermined ridge of the present invention.

图中:1、运动底盘;2、三轴直角机械臂;3、视觉系统;4、菌菇存放装置;5、采摘夹爪;6、机箱;11、底框;12、电动轮;13、万向轮;21、横向传送带;22、第一驱动电机;23、限位杆;24、纵向机架;25、竖向机架;26、第一丝杆电机;27、滑块;28、第二丝杆电机;29、导向轮;31、第一摄像头;32、第二摄像头;33、第三摄像头;41、采摘筐;42、滑道;43、接料板;44、弹簧;51、安装架;52、第二驱动电机;53、摇臂;54、摆臂;55、夹块;56、夹刀;57、刀架;58、切刀;59、减压层;E、地垄边界。In the figure: 1. Motion chassis; 2. Three-axis right-angle mechanical arm; 3. Vision system; 4. Mushroom storage device; 5. Picking claw; 6. Chassis; 11. Bottom frame; 12. Electric wheel; Universal wheel; 21, horizontal conveyor belt; 22, the first drive motor; 23, limit rod; 24, longitudinal frame; 25, vertical frame; 26, the first screw motor; 27, slide block; 28, The second screw motor; 29, the guide wheel; 31, the first camera; 32, the second camera; 33, the third camera; 41, the picking basket; 42, the slideway; 43, the receiving plate; 44, the spring; 51 , mounting frame; 52, second drive motor; 53, rocker arm; 54, swing arm; 55, clamp block; 56, clamp knife; 57, knife rest; 58, cutter; Ridge border.

具体实施方式Detailed ways

下面结合附图对本申请作进一步详细描述,有必要在此指出的是,以下具体实施方式只用于对本申请进行进一步的说明,不能理解为对本申请保护范围的限制,该领域的技术人员可以根据上述申请内容对本申请作出一些非本质的改进和调整。The application will be described in further detail below in conjunction with the accompanying drawings. It is necessary to point out that the following specific embodiments are only used to further illustrate the application, and cannot be interpreted as limiting the protection scope of the application. The above application content makes some non-essential improvements and adjustments to this application.

实施例Example

如图1所示,一种大棚种植羊肚菌自动采摘机器人,包括中空运动底盘1和设于运动底盘1顶部的三轴直角机械臂2,该自动采摘机器人上搭载有视觉系统3,运动底盘1上固设有菌菇存放装置4,三轴直角机械臂2的输出端固定安装有采摘夹爪5,视觉系统3用于向运动底盘1、三轴直角机械臂2和采摘夹爪5发送控制指令,控制指令包括用于控制运动底盘1间歇性直行和差速转向的运动指令以及用于控制三轴直角机械臂2和采摘夹爪5采摘羊肚菌的采摘指令;As shown in Figure 1, an automatic picking robot for growing hickory chicks in greenhouses, including a hollow motion chassis 1 and a three-axis right-angle mechanical arm 2 arranged on the top of the motion chassis 1, the automatic picking robot is equipped with a vision system 3, the motion chassis 1 is fixed with a mushroom storage device 4, and the output end of the three-axis right-angle manipulator 2 is fixedly equipped with picking claws 5. Control instructions, the control instructions include motion instructions for controlling the motion chassis 1 intermittently going straight and differential steering, and the picking instructions for controlling the three-axis right-angle mechanical arm 2 and the picking jaw 5 to pick morels;

如图3所示,视觉系统3包括用于采集前方道路图像信息的第一摄像头31、用于采集羊肚菌图像信息的第二摄像头32和第三摄像头33以及用于接收图像信息的工控机,工控机接收的图像信息包括第一摄像头31采集的前方道路图像信息以及第二摄像头32和第三摄像头33采集的羊肚菌图像信息,工控机结合图像信息向运动底盘1传递运动指令,以使该自动采摘机器人沿既定地垄二侧小道行走,并向三轴直角机械臂2和采摘夹爪5传递采摘指令,运动指令包括用于控制运动底盘1直行的行进指令、用于控制运动底盘1停止的制动指令和用于控制运动底盘1差速转向的转向指令,采摘指令包括用于控制三轴直角机械臂2移动采摘夹爪5的移动指令、用于控制采摘夹爪5切割并夹持羊肚菌的剪切指令和用于控制采摘夹爪5松开羊肚菌的卸料指令,以使三轴直角机械臂2配合采摘夹爪5剪切羊肚菌,并将羊肚菌运输至菌菇存放装置4之中,实现大棚种植羊肚菌的自动采摘,保障种植者的生命健康,节省人力,提高采摘效率,在采集羊肚菌图像信息的过程中,通过第二摄像头32配合工控机和三轴直角机械臂2对采摘夹爪5进行初级定位,通过第三摄像头33配合工控机和三轴直角机械臂2对采摘夹爪5进行二次定位,使机器人对羊肚菌定位更加精准,确保自动采摘机器人能够顺利完成采摘作业。As shown in Figure 3, the visual system 3 comprises a first camera 31 for collecting image information of the road ahead, a second camera 32 and a third camera 33 for collecting morel image information and an industrial computer for receiving image information The image information received by the industrial computer includes the image information of the road ahead collected by the first camera 31 and the morel image information collected by the second camera 32 and the third camera 33. Make the automatic picking robot walk along the trails on both sides of the predetermined ridge, and transmit the picking instructions to the three-axis right-angle mechanical arm 2 and the picking jaws 5. The movement instructions include the travel instructions for controlling the moving chassis 1 to go straight, 1 stop braking command and steering command for controlling the differential steering of the moving chassis 1, the picking command includes a movement command for controlling the three-axis right-angle mechanical arm 2 to move the picking jaw 5, for controlling the picking jaw 5 to cut and The cutting command for clamping the morels and the unloading command for controlling the picking jaws 5 to release the morels, so that the three-axis right-angle mechanical arm 2 cooperates with the picking jaws 5 to cut the morels, and put the morels Mushrooms are transported to the mushroom storage device 4 to realize automatic picking of morels in greenhouses, ensuring the life and health of growers, saving manpower, and improving picking efficiency. During the process of collecting image information of morels, through the second camera 32 cooperates with the industrial computer and the three-axis right-angle mechanical arm 2 to perform primary positioning on the picking jaw 5, and through the third camera 33 cooperates with the industrial computer and the three-axis right-angle mechanical arm 2 to carry out secondary positioning on the picking jaw 5, so that the robot can locate the sheep tripe The positioning of bacteria is more accurate, ensuring that the automatic picking robot can successfully complete the picking operation.

如图2所示,运动底盘1包括矩形中空底框11、设于底框11后侧底端的两个电动轮12和设于底框11前侧底端的两个万向轮13,两个万向轮13均内置了轮毂电机,在自动采摘机器人差速转向时,两个轮毂电机差速运转,以使运动底盘1完成转向,底框11前端一侧固设有用于固定工控机的机箱6,机箱6内还安装有与三轴直角机械臂2以及采摘夹爪5对应的驱动器和电池,第一摄像头31通过安装板固定设于底框11的前侧,第二摄像头32固定设于底框11的右侧。As shown in Figure 2, the sports chassis 1 includes a rectangular hollow bottom frame 11, two electric wheels 12 arranged at the bottom end of the rear side of the bottom frame 11, and two universal wheels 13 arranged at the bottom end of the front side of the bottom frame 11. Wheel hub motors are built into the wheels 13. When the automatic picking robot is turning at a differential speed, the two hub motors run at a differential speed so that the moving chassis 1 can complete the steering. The front end side of the bottom frame 11 is fixed with a chassis 6 for fixing the industrial computer. The driver and battery corresponding to the three-axis right-angle mechanical arm 2 and the picking jaw 5 are also installed in the chassis 6. The first camera 31 is fixed on the front side of the bottom frame 11 through the mounting plate, and the second camera 32 is fixed on the bottom. Right side of box 11.

如图3和图5所示,三轴直角机械臂2包括设于底框11一侧顶端的横向传送带21、设于横向传送带21一端的第一驱动电机22、固设于底框11另一侧的限位杆23、滑动设于限位杆23上的纵向机架24、滑动设于纵向机架24上的竖向机架25、固设于纵向机架24一端的第一丝杆电机26、滑动设于竖向机架25上的滑块27和固设于竖向机架25顶端的第二丝杆电机28,横向传送带21通过支架安装在底框11后端顶部,横向传送带21与第一驱动电机22组成了三轴直角机械臂2的X轴,纵向机架24与第一丝杆电机26组成了三轴直角机械臂2的Y轴,竖向机架25与第二丝杆电机28组成了三轴直角机械臂2的Z轴,纵向机架24远离限位杆23的一端与横向传送带21相互固定,横向传送带21的内侧设置有多个凸起,纵向机架24远离限位杆23的一端设置有与凸起一一对应的凹槽,第一丝杆电机26的输出轴与竖向机架25螺纹连接,第二丝杆电机28的输出轴与滑块27螺纹连接,第三摄像头33固设于竖向机架25顶端。As shown in Fig. 3 and Fig. 5, the three-axis right-angle mechanical arm 2 includes a transverse conveyor belt 21 arranged at the top end of one side of the bottom frame 11, a first driving motor 22 arranged at one end of the transverse conveyor belt 21, and a first drive motor 22 fixed at the other end of the bottom frame 11. The limit rod 23 on the side, the longitudinal frame 24 that is slidably located on the limit rod 23, the vertical frame 25 that is slidably located on the longitudinal frame 24, and the first screw motor that is fixed on one end of the longitudinal frame 24 26. Slide the slider 27 arranged on the vertical frame 25 and the second screw motor 28 fixed on the top of the vertical frame 25. The horizontal conveyor belt 21 is installed on the top of the rear end of the bottom frame 11 through a bracket. The horizontal conveyor belt 21 Form the X-axis of the three-axis right-angle mechanical arm 2 with the first driving motor 22, the Y-axis of the three-axis right-angle mechanical arm 2 is formed by the longitudinal frame 24 and the first screw mandrel motor 26, the vertical frame 25 and the second wire The rod motor 28 forms the Z axis of the three-axis right-angle mechanical arm 2, and the end of the longitudinal frame 24 away from the limit rod 23 is fixed to the horizontal conveyor belt 21. The inner side of the horizontal conveyor belt 21 is provided with a plurality of protrusions, and the vertical frame 24 is away from One end of the limit rod 23 is provided with a groove corresponding to the protrusion one by one, the output shaft of the first screw motor 26 is screwed with the vertical frame 25, and the output shaft of the second screw motor 28 is screwed with the slide block 27. Connected, the third camera 33 is fixed on the top of the vertical frame 25 .

如图3和图5所示,竖向机架25靠近纵向机架24的一端转动设有上下两组导向轮29,上下两组导向轮29分别与纵向机架24的上下两端相抵,纵向机架24与每组导向轮29之间均设置有导向杆,导向轮29外侧开设有与导向杆对应的环形凹槽,当第一丝杆电机26驱动竖向机架25移动时,上下两组导向轮29分别沿纵向机架24上的两根导向杆滚动。As shown in Fig. 3 and Fig. 5, the vertical frame 25 rotates near one end of the longitudinal frame 24 and is provided with two groups of guide wheels 29 up and down. All be provided with guide bar between frame 24 and every group guide wheel 29, guide wheel 29 outsides offer the annular groove corresponding with guide bar, when first screw mandrel motor 26 drives vertical frame 25 to move, two up and down Group guide wheel 29 rolls along two guide rods on the longitudinal frame 24 respectively.

如图6所示,采摘夹爪5包括固定设于滑块27底端的安装架51、固设于安装架51一端的第二驱动电机52、固设于第二驱动电机52输出端的摇臂53、分别铰接于摇臂53两端的两个摆臂54、铰接于摆臂54远离摇臂53的一端的夹块55、固设于夹块55底端的夹刀56和刀架57以及分别固设于两个刀架57相靠近的一端的切刀58,夹块55滑动设于安装架51底端,两个摆臂54均呈弧形并关于第二驱动电机52的输出端中心对称;As shown in Figure 6, the picking jaw 5 includes a mounting frame 51 fixed at the bottom end of the slider 27, a second driving motor 52 fixed at one end of the mounting frame 51, and a rocker 53 fixed at the output end of the second driving motor 52. , two swing arms 54 respectively hinged at the two ends of the rocker 53, a clip 55 hinged at the end of the swing arm 54 away from the rocker 53, a clip 56 and a knife rest 57 fixed at the bottom of the clip 55, and fixed respectively The cutter 58 at the end where the two knife rests 57 are close to each other, the clamping block 55 is slidably arranged at the bottom of the mounting frame 51, and the two swing arms 54 are arc-shaped and symmetrical about the center of the output end of the second driving motor 52;

进一步地,两个刀架57相互对称,两个夹刀56相互对称且两个夹刀56位于两个刀架57之间,两个夹刀56相对的一端设有减压层59,减压层59用于增大羊肚菌受力面积;Further, the two knife rests 57 are symmetrical to each other, the two clamping knives 56 are mutually symmetrical and the two clamping knives 56 are located between the two knife rests 57, and the opposite ends of the two clamping knives 56 are provided with a decompression layer 59, and the decompression Layer 59 is used to increase the stressed area of hickory chick;

进一步地,夹刀56相对的一端到安装架51中轴线的距离从上向下逐渐缩短,减压层59顶部向上延伸并与夹块55相互固定,减压层59由柔软材料制成,减压层59优选为海绵片。Further, the distance from the opposite end of the clamping knife 56 to the central axis of the mounting bracket 51 is gradually shortened from top to bottom, and the top of the decompression layer 59 extends upwards and is fixed with the clamping block 55. The decompression layer 59 is made of soft material, reducing the pressure. The laminate 59 is preferably a sponge sheet.

如图4所示,菌菇存放装置4包括固设于底框11前端中部的采摘筐41和倾斜设于采摘筐41一侧的滑道42,采摘筐41上方开口,机箱6设于采摘筐41另一侧,采摘筐41位于底框11与第一摄像头31之间,滑道42通过支架与采摘筐41相互固定,滑道42的上端位于底框11上方,滑道42的下端位于采摘筐41上方;另外,该滑道42的下端也可以设于采摘筐41的内部;As shown in Figure 4, the mushroom storage device 4 includes a picking basket 41 fixed at the middle part of the front end of the bottom frame 11 and a slideway 42 inclined at one side of the picking basket 41. 41 on the other side, the picking basket 41 is located between the bottom frame 11 and the first camera 31, the slideway 42 is fixed to the picking basket 41 through a bracket, the upper end of the slideway 42 is located above the bottom frame 11, and the lower end of the slideway 42 is located at Basket 41 top; In addition, the lower end of this slideway 42 also can be located at the inside of picking basket 41;

进一步地,采摘筐41内侧滑动设于接料板43,接料板43与采摘筐41的底壁弹性连接,具体地,接料板43通过弹簧44与采摘筐41的底壁相连,通过与采摘筐41底壁弹性连接的接料板43对羊肚菌进行缓冲,减少羊肚菌受到的冲击,并通过接料板43产生的轻微晃动,将采摘筐41内的羊肚菌摇匀,提高采摘筐41存放菌菇的能力,避免羊肚菌在采摘筐41的中间位置堆积过高,从而防止羊肚菌在机器人行走过程中洒落。Further, the inner side of the picking basket 41 slides on the material receiving plate 43, and the material receiving plate 43 is elastically connected to the bottom wall of the picking basket 41. Specifically, the material receiving plate 43 is connected to the bottom wall of the picking basket 41 by a spring 44. The material receiving plate 43 elastically connected to the bottom wall of the picking basket 41 buffers the hickory chicks, reduces the impact on the morels, and shakes the morels in the picking basket 41 evenly through the slight shaking produced by the material receiving plate 43. Improve the ability of the picking basket 41 to store mushrooms, avoid the accumulation of morels in the middle of the picking basket 41, and prevent the morels from falling during the walking of the robot.

一种大棚种植羊肚菌的采摘方法,应用于该自动采摘机器人,包括以下步骤:A method for picking morels grown in greenhouses, applied to the automatic picking robot, comprising the following steps:

S1、建立菌菇模型S1. Establish mushroom model

a.样本采集a. Sample collection

拍摄多张羊肚菌图片,将图片分为两组,一组图片作为训练集,用于训练羊肚菌检测模型,另一组图片作为测试集,用于测试羊肚菌检测模型的准确率,羊肚菌图片共标注有50张,其中40张图片作为训练集,10张图片作为测试集,每张羊肚菌图片上的羊肚菌目标数量为6-8个;Take multiple morel pictures and divide the pictures into two groups. One set of pictures is used as a training set for training the morel detection model, and the other set of pictures is used as a test set for testing the accuracy of the morel detection model , There are 50 morel pictures marked in total, 40 of which are used as training sets, 10 pictures are used as test sets, and the target number of morels on each morel picture is 6-8;

b.样本预处理b. Sample preprocessing

对训练集的图像信息进行预处理,羊肚菌菌盖表面具有凸起褶皱,褶皱之间形成羊肚状凹坑,凸起的褶皱形成塔形网状线,样本预处理过程中,对训练集图像信息中的塔形网状线进行线特征提取;The image information of the training set is preprocessed. The surface of the morel cap has raised folds, and morel-shaped pits are formed between the folds, and the raised folds form a tower-shaped mesh line. During the sample preprocessing process, the training Collect the tower-shaped mesh lines in the image information for line feature extraction;

c.模型构建c. Model building

将预处理后得到的线特征写入工控机的存储器中,通过YOLO算法对线特征进行迭代训练,YOLO算法是一种目标检测算法,能够从图片中找出物体并给出其类别和位置,训练时使用的网络结构为YOLOv8n,其他参数使用默认设置,获得羊肚菌检测模型;Write the line features obtained after preprocessing into the memory of the industrial computer, and iteratively train the line features through the YOLO algorithm. The YOLO algorithm is a target detection algorithm that can find objects from pictures and give their categories and positions. The network structure used during training is YOLOv8n, and other parameters use the default settings to obtain the morel detection model;

d.模型测试d. Model testing

利用测试集对羊肚菌检测模型的准确率进行检测,准确率未达标时,再次对模型进行迭代训练,直至羊肚菌检测模型的准确率达标为止,迭代训练过程中,整个训练过程共训练了300个epoch,最终测试的准确率能够达到100%,其中,epoch代表迭代次数;Use the test set to test the accuracy of the morel detection model. When the accuracy is not up to the standard, iteratively train the model again until the accuracy of the morel detection model reaches the standard. During the iterative training process, the entire training process is trained After 300 epochs, the accuracy of the final test can reach 100%, where epoch represents the number of iterations;

S2、沿既定地垄二侧小道行走S2. Walk along the path on both sides of the established ridge

通过第一摄像头31对运动底盘1前方区域进行拍摄,以采集前方道路图像信息,并将前方道路图像信息传递至工控机,工控机对前方道路图像信息进行分析,并进行地垄边界E的识别,当工控机检测到地垄边界E存在时,工控机向运动底盘1发出行进及制动的运动指令,以控制运动底盘1间歇性直行,当工控机检测到地垄边界E消失时,工控机向运动底盘1发出转向的运动指令,以控制运动底盘1差速转向;The area in front of the sports chassis 1 is photographed by the first camera 31 to collect image information of the road ahead, and the image information of the road ahead is transmitted to the industrial computer, and the industrial computer analyzes the image information of the road ahead, and recognizes the boundary E of the ridge , when the industrial computer detects the existence of the boundary E of the ridge, the industrial computer sends a movement command of moving and braking to the moving chassis 1 to control the moving chassis 1 to go straight intermittently. When the industrial computer detects that the boundary E of the ridge disappears, the industrial control The machine sends a steering movement command to the moving chassis 1 to control the differential steering of the moving chassis 1;

S3、初级定位S3, primary positioning

该自动采摘机器人行走过程中,当运动底盘1止于地笼上方时,通过第二摄像头32对底框11内的区域进行拍摄,以采集羊肚菌图像信息,并将羊肚菌图像信息传递至工控机,工控机通过羊肚菌检测模型对羊肚菌进行识别,获取三轴直角机械臂2采摘范围内羊肚菌的位置分布信息,识别过程中,通过训练好的模型对输入的测试集图片进行检测,获取目标框的坐标,以框底部中心的坐标为物体的坐标,这样即可得到羊肚菌在图片中的位置坐标;During the walking process of the automatic picking robot, when the moving chassis 1 stops above the ground cage, the area in the bottom frame 11 is photographed by the second camera 32 to collect the morel image information and transmit the morel image information To the industrial computer, the industrial computer recognizes morels through the morel detection model, and obtains the position distribution information of morels within the picking range of the three-axis right-angle manipulator 2. During the identification process, the trained model is used to test the input Collect the pictures for detection, obtain the coordinates of the target frame, and take the coordinates of the center of the bottom of the frame as the coordinates of the object, so that the position coordinates of the morel in the picture can be obtained;

S4、二级定位S4, secondary positioning

工控机根据位置分布信息向三轴直角机械臂2发出移动指令,使三轴直角机械臂2将采摘夹爪5移动至单个羊肚菌上方,通过第三摄像头33对采摘夹爪5下方的羊肚菌进行拍摄,二次采集羊肚菌图像信息,并将该羊肚菌图像信息传递至工控机,工控机通过羊肚菌检测模型对羊肚菌进行识别,获取单个羊肚菌的精确位置信息,判断采摘夹爪5是否对准该单个羊肚菌,若为对准该单个羊肚菌,则工控机根据精确位置信息向三轴直角机械臂2发出移动指令,使三轴直角机械臂2对采摘夹爪5进行位置修正,以确保采摘夹爪5位于羊肚菌正上方,三轴直角机械臂2通过第二丝杆电机28驱动滑块27和滑块27底端的采摘夹爪5下移,使采摘夹爪5包围羊肚菌;The industrial computer sends a movement command to the three-axis right-angle manipulator 2 according to the position distribution information, so that the three-axis right-angle manipulator 2 moves the picking jaw 5 to the top of a single morel, and the third camera 33 pairs the sheep under the picking jaw 5. The morels are photographed, and the image information of the morels is collected for the second time, and the image information of the morels is transmitted to the industrial computer, and the industrial computer recognizes the morels through the morel detection model, and obtains the precise position of a single morel information, to judge whether the picking jaw 5 is aligned with the single morel, if it is aimed at the single morel, the industrial computer sends a movement command to the three-axis right-angle mechanical arm 2 according to the precise position information, so that the three-axis right-angle mechanical arm 2 Correct the position of the picking jaw 5 to ensure that the picking jaw 5 is directly above the morel, and the three-axis right-angle mechanical arm 2 drives the slider 27 and the picking jaw 5 at the bottom of the slider 27 through the second screw motor 28 Move down so that the picking jaws 5 surround the hickory chick;

三轴直角机械臂2移动采摘夹爪5的过程中,通过第一驱动电机22驱动横向传送带21做回转运动,横向传送带21带动纵向机架24在X轴方向上移动,通过第一丝杆电机26带动竖向机架25在Y轴方向上移动,通过第二丝杆电机28带动滑块27在Z轴方向上移动,以确保采摘夹爪5能够抵达底框11围成的矩形空间的各个位点。During the process of the three-axis right-angle mechanical arm 2 moving the picking jaw 5, the first driving motor 22 drives the horizontal conveyor belt 21 to make a rotary motion. 26 drives the vertical frame 25 to move in the Y-axis direction, and the second screw motor 28 drives the slider 27 to move in the Z-axis direction to ensure that the picking jaws 5 can reach each of the rectangular spaces surrounded by the bottom frame 11. site.

S5、菌菇剪切与存放S5. Mushroom cutting and storage

工控机向采摘夹爪5发出剪切指令,采摘夹爪5对羊肚菌进行切割和夹持,接着工控机向三轴直角机械臂2发出移动指令,三轴直角机械臂2根据移动指令将采摘夹爪5移动至滑道42上方,工控机向采摘夹爪5发出卸料指令,采摘夹爪5松开羊肚菌,使羊肚菌沿滑道42滑入采摘筐41之中,工控机还通过第三摄像头33检测采摘夹爪5的到位情况和剪切及卸料的完成情况;The industrial computer sends a cutting command to the picking jaw 5, and the picking jaw 5 cuts and clamps the morels, and then the industrial computer sends a movement command to the three-axis right-angle mechanical arm 2, and the three-axis right-angle mechanical arm 2 moves according to the movement command. The picking jaw 5 moves to the top of the slideway 42, and the industrial computer sends an unloading command to the picking jaw 5, and the picking jaw 5 releases the morel, so that the morel slides along the slideway 42 into the picking basket 41, and the industrial control The machine also detects the placement of the picking jaws 5 and the completion of cutting and unloading by the third camera 33;

在剪切过程中,第二驱动电机52正转,第二驱动电机52的输出端通过摇臂53带动两个摆臂54摆动,从而使两个夹块55相向滑动,两片切刀58完成对羊肚菌菌柄的切割的同时,两片夹刀56也完成了对羊肚菌的夹持,在卸料过程中,第二驱动电机52反转,第二驱动电机52通过摇臂53和两个摆臂54驱动两个夹块55相背滑动,从而使采摘夹爪5松开羊肚菌。During the shearing process, the second drive motor 52 rotates forward, and the output end of the second drive motor 52 drives the two swing arms 54 to swing through the rocker arm 53, so that the two clamping blocks 55 slide towards each other, and the two cutting knives 58 are completed. While cutting the stalk of the morel, the two clamping knives 56 have also completed the clamping of the morel. During the unloading process, the second drive motor 52 reverses, and the second drive motor 52 passes through the rocker arm 53. And two swing arms 54 drive two clamping blocks 55 to slide back, thereby make picking jaw 5 unclamp hickory chick.

重复步骤S4和步骤S5,使采摘夹爪5依次对底框11下方所有的羊肚菌进行采摘,接着运动底盘1继续沿既定地垄二侧小道行走,该既定地垄二侧小道如图7所示,自动采摘机器人从既定地垄二侧小道的起点抵达既定地垄二侧小道的终点时,完成羊肚菌采摘作业。Repeat steps S4 and S5, so that the picking jaws 5 pick all the morels below the bottom frame 11 in turn, and then the moving chassis 1 continues to walk along the trails on both sides of the predetermined ridge, which is shown in Figure 7 As shown, when the automatic picking robot arrives at the end point of the path on both sides of the predetermined ridge from the starting point of the path on both sides of the predetermined ridge, the morel picking operation is completed.

以上所述实施例仅表达了本发明的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。The above-mentioned embodiments only express several implementation modes of the present invention, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present invention. It should be noted that, for those skilled in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention.

Claims (10)

1. Automatic morchella picking robot for greenhouse planting comprises a hollow motion chassis (1) and a triaxial right-angle mechanical arm (2) arranged at the top of the motion chassis (1), and is characterized in that: the automatic picking robot is provided with a vision system (3), a fungus mushroom storage device (4) is fixedly arranged on the motion chassis (1), a picking clamping jaw (5) is arranged at the output end of the three-axis right-angle mechanical arm (2), and the vision system (3) is used for sending control instructions to the motion chassis (1), the three-axis right-angle mechanical arm (2) and the picking clamping jaw (5);
the vision system (3) comprises a first camera (31) for acquiring front road image information, a second camera (32) and a third camera (33) for acquiring Morchella image information and an industrial personal computer for receiving the image information, wherein the industrial personal computer is used for transmitting motion instructions to the motion chassis (1) by combining the image information so that the automatic picking robot walks along the small channels on two sides of a given ridge and transmitting picking instructions to the three-axis right-angle mechanical arm (2) and the picking clamping jaw (5), so that the three-axis right-angle mechanical arm (2) is matched with the picking clamping jaw (5) to shear Morchella and transport the Morchella to the mushroom storage device (4).
2. The automatic picking robot of claim 1, wherein: the motion chassis (1) comprises a rectangular hollow bottom frame (11), two electric wheels (12) arranged at the bottom end of the rear side of the bottom frame (11) and two universal wheels (13) arranged at the bottom end of the front side of the bottom frame (11), and a case (6) for fixing an industrial personal computer is fixedly arranged at one side of the front end of the bottom frame (11).
3. The automatic picking robot of claim 2, wherein: the three-axis right-angle mechanical arm (2) comprises a transverse conveying belt (21) arranged at the top end of one side of a bottom frame (11), a first driving motor (22) arranged at one end of the transverse conveying belt (21), a limiting rod (23) fixedly arranged at the other side of the bottom frame (11), a longitudinal rack (24) arranged on the limiting rod (23) in a sliding mode, a vertical rack (25) arranged on the longitudinal rack (24) in a sliding mode, a first screw motor (26) fixedly arranged at one end of the longitudinal rack (24), a sliding block (27) arranged on the vertical rack (25) in a sliding mode and a second screw motor (28) fixedly arranged at the top end of the vertical rack (25), one end, far away from the limiting rod (23), of the longitudinal rack (24) is mutually fixed with the transverse conveying belt (21), and an output shaft of the first screw motor (26) is in threaded connection with the vertical rack (25), and an output shaft of the second screw motor (28) is in threaded connection with the sliding block (27).
4. The automatic picking robot of claim 3, wherein: the one end that vertical frame (25) is close to vertical frame (24) rotates and is equipped with two sets of leading wheels (29) from top to bottom, two sets of leading wheels (29) are offset with the upper and lower both ends of vertical frame (24) respectively, all be provided with the guide bar between vertical frame (24) and every group leading wheel (29), the annular groove that corresponds with the guide bar has been seted up in the leading wheel (29) outside.
5. The automatic picking robot of claim 3, wherein: picking clamping jaw (5) including fixed mounting bracket (51) that locate slider (27) bottom, set firmly in second driving motor (52) of mounting bracket (51) one end, set firmly in rocking arm (53) of second driving motor (52) output, articulate respectively in two swing arms (54) at rocking arm (53) both ends, articulate in swing arm (54) clamp splice (55) of the one end of keeping away from rocking arm (53), set firmly in clamp knife (56) and knife rest (57) of clamp splice (55) bottom and set firmly respectively in cutter (58) of the one end that two knife rests (57) are close to mutually, clamp splice (55) slide and locate mounting bracket (51) bottom.
6. The automatic picking robot of claim 5, wherein: the two knife holders (57) are symmetrical to each other, the two clamping knives (56) are located between the two knife holders (57), and a decompression layer (59) is arranged at the opposite end of the two clamping knives (56).
7. The automatic picking robot of claim 6, wherein: the distance from the opposite end of the clamping knife (56) to the central axis of the mounting frame (51) is gradually shortened from top to bottom, the top of the pressure reducing layer (59) extends upwards and is mutually fixed with the clamping block (55), and the pressure reducing layer (59) is made of soft materials.
8. The automatic picking robot of claim 6, wherein: the mushroom storage device (4) comprises a picking basket (41) fixedly arranged in the middle of the front end of the bottom frame (11) and a slideway (42) obliquely arranged on one side of the picking basket (41).
9. The automatic picking robot of claim 8, wherein: the inner side of the picking basket (41) is slidably arranged on the receiving plate (43), and the receiving plate (43) is elastically connected with the bottom wall of the picking basket (41).
10. A picking method for planting Morchella in a greenhouse is characterized by comprising the following steps: the automatic picking robot applied to claim 9, comprising the steps of:
s1, establishing a fungus model
a. Sample collection
Taking a plurality of Morchella pictures, dividing the pictures into two groups, wherein one group of pictures is used as a training set for training a Morchella detection model, and the other group of pictures is used as a test set for testing the accuracy of the Morchella detection model;
b. sample pretreatment
Preprocessing the image information of the training set, forming tower-shaped reticular lines by folds on the surface of the Morchella esculenta cover, and extracting line characteristics of the tower-shaped reticular lines in the image information of the training set;
c. model construction
Writing the line characteristics obtained after pretreatment into a memory of an industrial personal computer, and performing iterative training on the line characteristics through a YOLO algorithm to obtain a Morchella detection model;
d. model testing
Detecting the accuracy of the Morchella detection model by using the test set, and performing iterative training on the model again when the accuracy does not reach the standard until the accuracy of the Morchella detection model reaches the standard;
s2, walking along the small sidewalk at two sides of the established ridge
Shooting a front area of the motion chassis (1) through a first camera (31) to acquire front road image information, transmitting the front road image information to an industrial personal computer, analyzing the front road image information by the industrial personal computer, identifying a ridge boundary (E), controlling the motion chassis (1) to intermittently move straight by the industrial personal computer when the industrial personal computer detects that the ridge boundary (E) exists, and controlling the differential steering of the motion chassis (1) by the industrial personal computer when the industrial personal computer detects that the ridge boundary (E) disappears;
s3, primary positioning
In the walking process of the automatic picking robot, when the motion chassis (1) is stopped above a ground cage, the region in the bottom frame (11) is shot through the second camera (32) to acquire Morchella image information, the Morchella image information is transmitted to the industrial personal computer, and the industrial personal computer identifies Morchella through the Morchella detection model to acquire Morchella position distribution information;
s4, two-stage positioning
The industrial personal computer sends a moving instruction to the three-axis right-angle mechanical arm (2) according to the position distribution information, the three-axis right-angle mechanical arm (2) moves the picking clamping jaw (5) to the position above the single morchella, the morchella below the picking clamping jaw (5) is shot through the third camera (33), the morchella image information is acquired for the second time, the morchella image information is transmitted to the industrial personal computer, the industrial personal computer identifies the morchella through the morchella detection model, the accurate position information of the single morchella is obtained, the industrial personal computer sends a moving instruction to the three-axis right-angle mechanical arm (2) according to the accurate position information, the three-axis right-angle mechanical arm (2) carries out position correction on the picking clamping jaw (5) so as to ensure that the picking clamping jaw (5) is positioned right above the morchella, and the three-axis right-angle mechanical arm (2) drives the sliding block (27) and the picking clamping jaw (5) at the bottom end of the sliding block (27) to move downwards through the second screw motor (28), and the picking clamping jaw (5) surrounds the morchella;
s5, cutting and storing the mushrooms
The industrial personal computer sends a shearing instruction to the picking clamping jaw (5), the picking clamping jaw (5) cuts and clamps Morchella, then the industrial personal computer sends a moving instruction to the three-axis right-angle mechanical arm (2), the three-axis right-angle mechanical arm (2) moves the picking clamping jaw (5) to the upper part of the slideway (42) according to the moving instruction, the industrial personal computer sends a discharging instruction to the picking clamping jaw (5), and the picking clamping jaw (5) loosens Morchella, so that Morchella slides into the picking basket (41) along the slideway (42).
CN202310849123.1A 2023-07-12 2023-07-12 An automatic picking robot for morels grown in greenhouses Active CN116686638B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310849123.1A CN116686638B (en) 2023-07-12 2023-07-12 An automatic picking robot for morels grown in greenhouses

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310849123.1A CN116686638B (en) 2023-07-12 2023-07-12 An automatic picking robot for morels grown in greenhouses

Publications (2)

Publication Number Publication Date
CN116686638A true CN116686638A (en) 2023-09-05
CN116686638B CN116686638B (en) 2025-08-12

Family

ID=87845238

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310849123.1A Active CN116686638B (en) 2023-07-12 2023-07-12 An automatic picking robot for morels grown in greenhouses

Country Status (1)

Country Link
CN (1) CN116686638B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117678444A (en) * 2024-01-09 2024-03-12 石河子大学 Accurate laser ablation cotton topping machine

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116267434A (en) * 2023-04-27 2023-06-23 武汉市农业科学院 A six-axis robot for picking morels
CN220274461U (en) * 2023-07-12 2024-01-02 无锡海基智能机器人有限公司 Automatic Morchella picking robot for greenhouse planting

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116267434A (en) * 2023-04-27 2023-06-23 武汉市农业科学院 A six-axis robot for picking morels
CN220274461U (en) * 2023-07-12 2024-01-02 无锡海基智能机器人有限公司 Automatic Morchella picking robot for greenhouse planting

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117678444A (en) * 2024-01-09 2024-03-12 石河子大学 Accurate laser ablation cotton topping machine

Also Published As

Publication number Publication date
CN116686638B (en) 2025-08-12

Similar Documents

Publication Publication Date Title
CN101990796B (en) Weeding robot system and method based on machine vision
CN107667670B (en) Nondestructive intelligent grading harvester for hedge wall type fresh grapes and control method thereof
CN220274461U (en) Automatic Morchella picking robot for greenhouse planting
CN109156161A (en) A kind of fertile mandarin orange picking robot of intelligence
CN114303644A (en) Nondestructive picking, grading, packing and collecting robot for fresh table grapes and method of using the same
CN114600641B (en) Strawberry picking machine based on image recognition technology and picking method thereof
CN111758397A (en) Device is picked to prickly ash intelligence based on visual identification
CN209527208U (en) A kind of strawberry picking machine
CN201135036Y (en) Cotton Intelligent Picking Harvester
CN116686638A (en) Automatic Morchella picking robot for greenhouse planting
CN113692854A (en) Tomato picking machine and control method thereof
CN102696411A (en) Grape winter-pruning operation device based on machine vision
CN116671344A (en) A greenhouse strawberry automatic picking robot
CN114271097A (en) Control system and control method of safflower picking robot
CN117044496A (en) Broccoli selective harvesting robot and control method thereof
CN117016181A (en) Automatic sun-curing robot of picking of sunflower
CN116267235A (en) Scraping type automatic prickly ash picking machine
CN116965236A (en) Small watermelon picking robot and picking method based on greenhouse three-dimensional cultivation mode
CN115989750B (en) Automatic lotus pod picking system and lotus pod picking method
CN217184250U (en) An automatic high-throughput tissue culture and fast propagation device for potato tissue culture seedlings
CN210093992U (en) Hawthorn picking robot
CN212573595U (en) An automatic lotus pod picking machine based on standardized lotus fields
CN108323325A (en) A kind of strawberry picking machine and picking method imitating human hand type
CN210900434U (en) Rail type automatic tea picking robot
CN117461474A (en) Method and equipment for automatically picking litchis

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant