Multimodal Sensors Meet Artificial Intelligence

The overall objective of the research project “REWO-SORT” is the evaluation of the technical feasibility and development of an improved sorting technology for raw materials by means of a multimodal sensor data fusion of optical and X-ray technologies.

The early separation of low-value material in the process chain should not only increase the treatment efficiency, but also reduce the water and energy consumption in the following process steps. The sensor data fusion method is based on deep neural networks (DNNs). The project will examine the robustness of the methodology under variable geological conditions, for example different rock compositions.

Complementing Technologies

The combination of laser induced plasma spectroscopy (LIBS) and multi energy X-ray imaging (ME-XRT) is particularly promising, as the technologies complement each other very well in terms of their analytical performance: LIBS is able to provide an analysis of the chemical composition of the surface, whereas ME-XRT determines elementary information of the total object volume. "The technological convergence of these two sensor technologies will enable the extrapolation of precise surface information to the entire volume. This allows us to determine representative values ​​for the entire ore. Adaptation to varying ore types and geological parameters will be done using artificial intelligence." explains Markus Firsching, Project Manager at the Fraunhofer Development Center for X-ray Technology, a division of ​​Fraunhofer IIS.

The fusion of sensor technologies to be developed should provide constant and accurate monitoring of the mineralogy of the mined rock. Special feature: the geological, mineralogical, rock mechanical and metallurgical properties of the ore are determined directly while the rock material moves over a conveyor belt. Additionally, these properties will be automatically fed into geological 3D models in order to facilitate mine planning.

Planned Exploitation of the Research Results

The project results will be used mainly in the fields of sorting primary raw materials. An application in the field of recycling is also conceivable. Both areas pose major challenges for manufacturers of sorting machines due to increasingly complex tasks. The results regarding the use of deep neural networks should be used to enable a flexible reaction to changing requirements, as well as to facilitate the teaching of the system and the configuration for sorting material flows. For the industrial partners, these advantages represent great unique selling propositions compared to their competitors and are thus highly interesting in economic terms.

REWO-SORT is a joint project of Fraunhofer IIS, Luleå University of Technology, Secopta and University of Chile. The work package of the German partners Secopta and Fraunhofer EZRT is funded by the German Federal Ministry of Education and Research for a period of three years with a volume of around € 520,000.