Crop root system 3D microscopic phenotype detection system and detection method
Technical Field
The invention belongs to the technical fields of intelligent agricultural equipment technology, computer vision technology and biological feature recognition, and particularly relates to a crop root system 3D microscopic phenotype detection system and a detection method.
Background
The plant root system is used as a key organ for absorbing water and nutrient of crops, and the microstructure characteristic analysis of the plant root system has important significance for revealing the physiological mechanism of plants and guiding accurate breeding. The traditional research methods such as an excavation method, a soil core drilling method and the like are difficult to realize in-situ dynamic observation due to destructive sampling, and cannot meet the requirements of modern plant phenotyping on high-throughput and high-precision detection. With the development of nondestructive imaging technology, a related technical system breaks through to a certain extent, but a significant technical bottleneck still exists in dimensions such as microscopic phenotype analysis, dynamic monitoring and the like.
In the aspect of spatial resolution, the existing three-dimensional imaging technology is difficult to balance the detection requirements of macroscopic scale and microscopic features. In a typical multi-view image reconstruction technology proposed in patent CN104897575A, although sub-millimeter level observation is achieved by co-scanning of a high-precision electric control rotating table and a vertical lifting table, the minimum imaging unit of the optical path amplifying system is only 50 μm due to the design limitation of a fixed objective lens, and root hair structures with diameters of 5-15 μm and finer epidermis cell morphology cannot be effectively captured. This directly results in the absence of data from the existing three-dimensional model in characterizing key phenotypic parameters such as root hair density, meristematic cell arrangement, etc.
In terms of dynamic monitoring capability, the current system architecture generally has insufficient synergy of a mechanical structure and an imaging module. Taking the multi-mode three-dimensional reconstruction system of patent CN107392956B as an example, the mechanical arm rotation acquisition mode adopted by the system needs to be matched with manual intervention, the single plant scanning time is more than 30 minutes, and a microscopic imaging module is not integrated, so that continuous observation of the growth process of the living root system cannot be realized. The double limitation of time resolution and space resolution severely restricts the research of dynamic biological processes such as plant stress response and the like.
Environmental suitability challenges are focused on the optical interference cancellation level of complex media. Although patent CN119437076a improves transparent medium imaging by combining colloid culture with an optical calibration groove, a three-dimensional reconstruction algorithm based on silhouette images is easily interfered by impurity particles in a real soil environment, so that extraction distortion of edge features of root systems is caused. More importantly, the existing optical system lacks a refractive index correction mechanism for microscopic imaging, and is difficult to penetrate through heterogeneous media on the premise of maintaining high resolution, so that accurate measurement of biomechanical characteristics such as epidermal cell wall thickness and the like is affected.
From the technical application dimension, the existing solutions have significant efficiency and cost contradiction. Although X-ray CT and other equipment can realize nondestructive detection of the root system of the whole plant, the single scanning cost of the miniature CT is more than ten thousand yuan, and the single scanning time is as long as 2-3 hours. The high cost and low efficiency makes it difficult to support the sample flux required by the large-scale plant phenotyping and histology research, and severely restricts the effective conversion of technical achievements to breeding practice.
The superposition effect of the technical bottlenecks causes that the existing root system analysis system still has difficulty in meeting the urgent requirements of intelligent agriculture on the digital analysis of the crop root system phenotype on key indexes such as microscopic phenotype analysis precision, dynamic process capturing capability, complex environment adaptability, large-scale detection efficiency and the like. .
Disclosure of Invention
First, the technical problem to be solved
The existing microscopic imaging equipment is limited by the fixed light path structure and the fixed light source, so that the imaging area is narrow and fixed, and the microscopic imaging equipment cannot be used for large-range nondestructive imaging of crop roots. Aiming at the problems of the existing technology and means for observing the microscopic phenotype of the crop root system, the invention provides a high-efficiency scheme for extracting the microscopic phenotype of the crop root system, and realizes the real-time and nondestructive collection and analysis of microscopic phenotype of the crop root system, such as root hairs, root surface cells and rhizosphere microorganisms.
(II) technical scheme
In order to solve the problems, the invention provides the following technical scheme, and provides a crop root system 3D microscopic phenotype detection system and a detection method, which are specifically as follows.
A crop root system 3D microscopic phenotype detection system for acquiring a crop root system microscopic phenotype, the detection system comprising:
an optical platform (1) horizontally placed for positioning other components of the detection system;
The three-dimensional module (2) is fixed on the optical platform, and the microscopic imaging system (3) is controlled and driven by the servo motor to perform three-dimensional movement, so that microscopic automatic focusing and multi-angle shooting of the root system of the crop to be detected are realized;
The microscopic imaging system (3) is arranged on the three-dimensional module (2) and comprises an industrial camera (3-1) and a microscopic lens (3-2) capable of automatically changing times and is used for microscopic imaging of crop root systems;
The rotating platform (4) is fixed on the optical platform (1) and is positioned on the right side of the three-dimensional module (2) and used as a platform for placing the plant incubator (5), and the rotating platform is controlled by a stepping motor and can drive the plant incubator to bidirectionally rotate;
the plant incubator (5) is integrally in a cuboid shape, the bottom surface of the plant incubator is square and made of a high transparent material, the plant incubator consists of an outer box (5-1) and an inner box (5-2), a gap (5-3) with fixed intervals is arranged between the inner wall of the outer box and the outer wall of the inner box to form 4 narrow flat surface spaces, nutrient solution supporting plant growth is contained in each flat surface space, and 1 crop plant is planted in each flat surface space to enable plant roots to grow in the flat surface space;
And the microscope light supplementing system (6) is fixedly connected with the microscopic imaging system (3) and is used for supplementing light to the root system of the crop to be detected in microscopic shooting.
Preferably, the three-dimensional module (2) is composed of 3 linear motion modules (2-1) (2-2) (2-3) and 1 rotary module (2-4), wherein the 2 linear motion modules (2-2) (2-3) are responsible for driving the microscopic imaging system to move back and forth and up and down, the 1 linear motion module (2-1) is responsible for driving the microscopic imaging system to focus, the rotary module is responsible for adjusting the imaging angle of the microscopic imaging system, and the four modules are matched together to realize three-dimensional multi-angle shooting of the microscopic imaging system.
Preferably, the automatic zoom microscope lens of the microscopic imaging system (3) uses a 4K high-resolution zoom lens, and the maximum resolution is 2.8 microns when the automatic zoom microscope lens is matched with the industrial camera.
Preferably, the rotary platform (4) is provided with 4 infrared limiting points for rotary positioning, the 4 infrared limiting points correspond to root system shooting of 4 surfaces of the plant incubator, and when the rotary platform rotates to a specific infrared limiting point, the rotary platform automatically pauses, so that flat surface space of the plant incubator, namely a root system surface to be detected, is opposite to the microscopic imaging system.
Preferably, the top of the inner box of the plant incubator is provided with 4 inclined planes (5-4) which deviate to the inner cavity, and the inclined planes respectively form included angles with the 4 flat plane spaces, and the included angles are used for fixedly placing plant bases, so that plant roots are immersed into the flat plane spaces.
Preferably, the microscope light supplementing system comprises 4 light supplementing modules, namely a synchronous dark field light supplementing module (6-1), a coaxial light source light supplementing module (6-2), an annular front external light source light supplementing module (6-3) and a back light source light supplementing module (6-4).
The synchronous dark field light supplementing module of the microscope light supplementing system comprises a linkage support (6-1-1) and a light source assembly (6-1-2), wherein the linkage support is in a shape of a Chinese character 'ji', one end of the linkage support is rigidly connected with the microscopic imaging system, the other end of the linkage support is rigidly connected with the light source assembly, the light source assembly is suspended in an inner cavity space of an inner box (5-2) of the plant incubator through the linkage support and can synchronously move along with the movement of the microscopic imaging system, the light source assembly consists of a middle cavity (6-1-4) and symmetrical light sources (6-1-3) positioned on two sides, the cavity plane in the middle of the light source assembly is vertically opposite to an imaging optical axis of the microscopic imaging system (3), a dark field background is provided during microscopic imaging, and the symmetrical light sources on two sides supplement light to a root system to be measured from the rear side.
Preferably, the optical axis of the symmetrical light source (6-1-3) of the light source assembly (6-1-2) faces the root system to be measured, and the light supplementing optical axis forms an angle with the imaging optical axis of the micro lens (3-2) for enhancing the Rayleigh scattering effect of the transparent root hair
Preferably, an included angle formed by the light supplementing optical axis of the symmetrical light source and the imaging optical axis of the microscope lens (3-2) is 30-45 degrees.
The crop root system 3D microscopic phenotype detection method adopts the crop root system 3D microscopic phenotype detection system to detect, and the detection method comprises the following steps:
S1, placing a plant incubator (5) on the rotary platform (4);
S2, the rotating platform (4) rotates to drive the plant incubator (5) to rotate, stopping after limiting, and enabling the microscopic imaging system to be aligned with a root surface to be detected;
s3, opening a microscope light supplementing system (6), selecting a proper light supplementing scheme according to the root system development condition, and supplementing light to the root system to be tested through the microscope light supplementing system;
s4, the three-dimensional module (2) drives the microscopic imaging system (3) to move, an industrial camera is adopted to shoot a large-scale root system image in a low-magnification mode, a global root system picture is obtained, and specific position coordinates of the root system in the incubator are calculated and marked;
S5, the three-dimensional module (2) drives the microscopic imaging system (3) to move, a microscopic lens is adopted to shoot the whole root system plane, and panoramic stitching of the root system of the current surface to be detected is completed under a homogeneous coordinate system;
S6, rotating the rotating platform (4) to the next limiting point, and shooting the next root surface to be detected;
S7, repeating the steps S4 to S6 until shooting of crop root systems of 4 root systems surfaces to be detected of the whole plant incubator (4) is completed, and ending the task.
Preferably, in step S5, the expression trait extraction specifically uses Symphonies deep learning model to segment multiple parts including main root, lateral root, root hair and root tip meristematic region of the crop, and uses computer vision technology to remove impurities.
Preferably, the root phenotypic trait extracted in step S5 includes root biomass, root structure, lateral root number, root hair density, and root tip meristematic region length.
(III) beneficial effects
Compared with the prior art, the invention has at least the following positive technical effects.
(1) The existing root microscopic imaging technology is limited by a fixed light path and a static light source, an imaging area is limited in a narrow range, a large-scale structure of the root system of crops is difficult to cover, and the traditional bright field illumination has poor imaging effect on semi-transparent tissues (such as root hairs). According to the invention, through the design of synchronous and coordinated movement of the three-dimensional movement module and the microscopic imaging system and the combination of an automatic focusing technology, the imaging boundary of the traditional microscope is broken through, and the multi-angle and multi-region efficient scanning of the root system is realized. By fusing an image stitching algorithm and a three-dimensional reconstruction technology, the system can complete three-dimensional modeling of root system global under the micron-scale resolution (such as 0.5 mu m/pixel) and support quantitative analysis of microscopic phenotypes such as root hair density, epidermal cell morphology and the like.
(2) The existing light supplementing scheme for microscopic imaging is difficult to adapt to the imaging requirement of microscopic morphology of the root system. The invention innovatively adopts a synchronous microscopic dark field light supplementing technology, realizes the rigid connection of the light source and the microscope lens by utilizing the linkage support to realize synchronous movement and light supplementing, adopts the bracket in a shape like a Chinese character 'ji' to suspend the light source at the rear of the root system to be tested to realize light supplementing from the rear side, and adopts the symmetrical light source to carry out symmetrical light supplementing on the root system to be tested from the rear side, meanwhile, the background which is opposite to the imaging axis is designed to be a cavity dark field for enhancing the detail contrast of the root system to be tested, and the adoption of the design can integrally and effectively enhance the scattered light signal capturing capability of semitransparent biological tissues (such as root hairs and root tip meristematic regions). Experiments show that compared with the traditional bright field imaging, the definition of the edge of the root hair in the dark field mode is improved by more than 3 times, and a high-precision data base is provided for automatic phenotype parameter extraction (such as root hair length and density).
(3) The existing microscopic imaging scheme needs to move or invert a sample, and cannot be suitable for nondestructive microscopic phenotype observation of plants. According to the invention, the microscopic imaging system is driven to actively move through the three-dimensional motion module, so that the sample is kept stationary in the shooting process, and the non-contact optical scanning strategy is combined, so that the in-situ nondestructive detection of the root system is realized. The system can adapt to various culture modes such as soil culture, water culture and the like, supports dynamic monitoring (such as root tip growth rate) of living root systems, and avoids damage to root microenvironment caused by the traditional sampling method. And through the design of the coordination of the four-side-implantable plant incubator and the rotary platform, and the combination of the control of the three-dimensional motion module, the continuous microscopic focusing and imaging of the crop root system are realized, so that the single scanning time of the system is shortened by 75% compared with the traditional single plant detection.
Drawings
Fig. 1 is a general design of the present invention.
FIG. 2 is a schematic view of the plant incubator of the present invention.
Fig. 3 is a schematic structural diagram of a light supplementing system of a microscope according to the present invention.
Fig. 4 is a schematic diagram of a synchronous dark field light compensation module according to the present invention.
FIG. 5 is a flow chart of a method for detecting the 3D microscopic phenotype of the crop root system.
Fig. 6 is a graph showing the comparison of the shooting effect of the annular front light supplementing and the movable dark field light supplementing rice root hairs.
Detailed Description
The invention is further described below with reference to the drawings and examples.
The invention discloses a crop root system 3D microscopic phenotype detection system and a detection method. Fig. 1 is a diagram showing the overall design scheme of the crop root system 3D microscopic phenotype detection system of the present invention. The system comprises an optical platform 1, a three-dimensional module 2, a microscopic imaging system 3, a rotating platform 4, a plant incubator 5 and a microscope light supplementing system 6. The optical platform 1 is horizontally placed, and the surface is provided with a shockproof structure for fixing the three-dimensional module 2. The three-dimensional module 2 consists of 3 linear motion modules 2-1, 2-2, 2-3 and 1 rotary module 2-4, and is driven by a servo motor. The linear motion module 2-1 is responsible for focusing (Z-axis movement) of the microscopic imaging system 3, the linear motion modules 2-2 and 2-3 respectively control front and back (X-axis) and up and down (Y-axis) movement, and the rotary module 2-4 adjusts the shooting angle of the microscopic imaging system 3. The movement precision of the module is +/-0.01 mm, the travel range is 0-300mm in X/Y axis and 0-50mm in Z axis. The resolution of 3-1 pixels of the industrial camera is 4112 x 3000, the maximum shooting frame rate is 30 frames, the microscope lens 3-2 is a 4K automatic zoom lens, and the maximum resolution is 2.8 mu m/pixel. The imaging system moves through the three-dimensional module 2 to realize automatic focusing (based on a contrast detection algorithm) and multi-angle shooting. The rotary platform 4 is arranged on the right side of the optical platform 1, and driven by a stepping motor, and has a rotation angle of 0-360 degrees and a positioning precision of +/-0.1 degrees. The platform is provided with 4 infrared limiting points (with an interval of 90 degrees) corresponding to 4 flat surface spaces of the incubator 5.
FIG. 2 shows a schematic diagram of the plant incubator 5 of the present invention. 4 flat-surface gaps 5-3 (thickness 5 mm) are formed between the outer box 5-1 and the inner box 5-2 of the plant incubator 5, and nutrient solution is filled in the gaps. 4 inclined planes 5-4 are arranged at the top of the inner box and used for fixing the plant base, so that the root system grows along the flat surface space.
As shown in fig. 3 and 4, the light supplementing system 6 of the microscope of the present invention includes four modules, namely, a synchronous dark field light supplementing module 6-1, a coaxial light supplementing module 6-2, an annular external light source 6-3 and a back light source 6-4. The light source assembly 6-1-2 of the synchronous dark field light supplementing module 6-1 is hung in the inner cavity of the incubator, the included angle between the optical axis of the bilateral symmetry light source 6-1-3 (power 10W) and the imaging optical axis of the micro lens 3-2 is 30-45 degrees, the angle is adjustable, the definition and contrast of dark field imaging are improved by enhancing Rayleigh scattering of root hairs, the coaxial light source light supplementing module 6-2 provides uniform front illumination, the adjustable brightness range is 0-1000 Lux, uniform illumination of the surface of a sample is ensured, shadows and light spots are reduced, the annular external light source 6-3 is used for lateral light supplementing, strong surface illumination is provided, the imaging requirement of a complex sample is met, the back light source 6-4 is used for transmission imaging, stable back illumination is provided, and clear representation of the internal structure of the sample is ensured. Through the collaborative work of the four light supplementing modules, the system can adapt to different sample types and imaging conditions, and high-quality and high-flux root microscopic phenotype group detection is realized.
As shown in fig. 5, the specific method steps of one embodiment of the detection system of the present invention when performing detection are as follows.
(1) Starting the system and performing self-checking, namely starting an image acquisition system, running a self-checking program, detecting the connection state and the power stability of hardware equipment such as a microscopic imaging system 3, a rotary platform 4, a three-dimensional module 2 and the like item by item, synchronously verifying the loading condition of software modules such as image shooting, path planning, a splicing algorithm and the like, and ensuring no hardware fault or software error reporting.
(2) The shooting parameter setting comprises the steps of completing shooting parameter configuration in a system operation interface, setting exposure time according to shooting requirements, selecting a corresponding light supplementing scheme (such as dark field light supplementing, coaxial light source and the like), calibrating white balance parameters to restore real colors, designating storage paths of images and data, and completing parameter initialization before shooting.
(3) Placing and inputting numbers of the plant incubator 5, namely firmly placing the plant incubator at a designated position of a turntable, clicking a system interface to start acquisition, inputting incubator numbers (such as naming rules of date and serial numbers) in a popped input box, and completing acquisition preparation work.
(4) The method comprises the steps of triggering a microscopic imaging system, firstly shooting a large-scale root system image in a low-magnification mode to obtain a global root system picture, analyzing the image through an image recognition algorithm, calculating and marking specific position coordinates of the root system in an incubator, and providing a data basis for fine shooting.
(5) The method comprises the steps of path planning, shooting and image naming, wherein a computer plans a refined shooting path (such as an X/Y axis moving track, a focusing point position and the like) based on root system position coordinates, controls a three-dimensional module to move according to the path, triggers shooting at each point position, and synchronously names acquired images in an incubator number and shooting sequence, so that traceability of image data is ensured.
(6) And (3) rotating the turntable and circularly shooting, namely controlling the turntable to rotate to the next infrared limiting point after the shooting of the current angle is completed, repeating the steps (4) and (5), continuously shooting the next plant root system, performing global splicing processing on the images after all shooting is completed, storing the spliced panoramic image and the original data according to a preset path, and extracting the phenotypic character of the crop root based on the images and the data.
The phenotypic character extraction specifically adopts Symphonies deep learning model to divide a plurality of parts including main root, lateral root, root hair and root tip meristematic region of crops, and uses computer vision technology to remove impurities. The root phenotype character extracted by the invention comprises root biomass, root structure, lateral root number, root hair density and root tip meristematic region length.
Fig. 6 is a graph showing the comparison of the effects of photographing the root hairs of the rice in the conventional annular front light supplementing mode and the movable dark field light supplementing mode. The advantage of the light supplementing mode is verified through a light supplementing mode effect comparison experiment.
The experiment uses the root system of the rice seedling (7 days of culture) as a sample, adopts the same microscopic imaging system (industrial camera+4K microscope lens), and respectively uses the traditional annular front light supplement (the light source is positioned around the lens, the optical axis is parallel to the imaging optical axis) and the synchronous dark field light supplement (the light source component is rigidly connected with the microscope lens, and the optical axis included angle is 40 ℃), for shooting. Experimental results show that the root hair edge is blurred under the traditional light filling, the gray gradient value is 15-20, the contrast ratio between the background and the root hair is low, semitransparent tissues are difficult to distinguish, the detail at the bifurcation of the root hair is lost, the identification accuracy is only 65%, the root hair edge definition is obviously improved under the synchronous dark field light filling, the gray gradient value reaches 50-60, the background is in a dark field effect, the contrast ratio between the background and the root hair is obviously enhanced, the root hair boundary is clearly visible, and the identification accuracy is improved to 95%. In addition, the synchronous dark field light filling mode does not need to adjust the position of the light source for multiple times, the single shooting time is shortened by 20%, and the imaging efficiency is further improved. In summary, the synchronous dark field light supplementing mode of the invention is significantly superior to the traditional light supplementing mode in root hair definition, background contrast, detail capturing capability and imaging efficiency.
The specific examples described in this application are offered by way of illustration only. Various modifications or additions may be made to the embodiments described herein by those skilled in the art, or the manner of practicing the invention may be substituted in the form thereof without departing from the spirit of the invention or exceeding the scope of the invention as defined in the appended claims.