Automatic Handling of Pressed Parts Through 3D Container Inspection
The Ensenso C addresses current challenges in the automation and robotics industry. Compared to other Ensenso models, it provides both 3D and RGB color information. Customers thus benefit from even more meaningful image data. The housing of the robust 3D camera system meets the requirements of protection class IP65/67. It offers a resolution of 5 MP and is available with baselines from current to approximately 455 mm. This means that even large objects can be reliably detected. The camera is quick and easy to use, and addresses primarily large-volume applications, e.g., in medical technology, logistics, or factory automation.
Up to now, employees have been responsible for loading the containers. This simple subtask is more complex than one might think at first glance. In addition to the actual insertion process, the first step is to determine the appropriate free space for the part. At the same time, any interfering factors, such as interlocks, must be removed, and a general check of the “load box” for any defects must be carried out. All these tasks are to be taken over by a robot with a vision system—a technological challenge. This is because the containers also come from different manufacturers, are of different types, and may sometimes vary in their dimensions.
The main result of the image processing solution is the multivector correction. In this way, the robot is adjusted to be able to insert the component at the next possible, suitable deposit position. Secondary results are error messages due to interfering edges or objects in the container that would prevent filling. Damaged containers that are in a generally poor condition can be detected and sorted out with applied data. The entire image processing takes place in the image processing software MSS (multisensor systems) developed by VMT. FrameSense is designed to be easy to use and can also be converted to other components directly onsite.
Supported by a high-intensity projector, the Ensenso C projects high-contrast textures onto the object to be imaged.
Finally, the overall picture is compared with a stored reference model. In this way, the containers can be simultaneously checked for their condition and position in a fully automated manner. Even deformed or slanted containers can be processed. All this information is also recorded for use in a quality management system where the condition of all containers can be traced. The calibration as well as the consolidation of the measurement data and their subsequent evaluation are carried out in a separate IPC (industrial computer) with screen visualization, operating elements, and connection to the respective robot control.
For their fully automatic loading and unloading, the position of several relevant features of the containers must be determined for a so-called multivector correction of the robot. The basis is a type, shape, and position check of the respective container. This is the only way to ensure process-reliable and collision-free path guidance of the loading robot. All this must be integrated into the existing production process. Time delays must be eliminated, and the positioning of the components must be accurate to the millimeter.
Innovation
Automatic Handling of Pressed Parts Through 3D Container Inspection
Four eyes see better than two
When inserting the components into the comb strips of the racks, the robots have to work with millimeter precision.
Type, shape, and position inspection with the aid of four 3D cameras
Evaluation and visualization of the measurement data
Robust 3D camera system
However, someone has to pay for this content. And that’s where advertising comes in. Most people consider ads a nuisance, but they do serve a useful function besides allowing media companies to stay afloat. They keep you aware of new products and services relevant to your industry. All ads in Quality Digest apply directly to products and services that most of our readers need. You won’t see automobile or health supplement ads.
To achieve this, VMT uses four 3D cameras per system. The four sensors each record a part of the entire image field. This can consist of two containers, each measuring approximately 1.5 m x 2 m x 1.5 m (D x W x H). Two of the cameras focus on one container. This results in data from two perspectives each, to optimize the information quality of the 3D point cloud. The point clouds of all four sensors are combined for the subsequent evaluation. During the process, registrations of relevant features of the container take place in ROIs (regions of interest) of the total point cloud. A registration is the exact positioning of a feature using a model in all six degrees of freedom. In other ROIs, interference contours are searched for that could lead to collisions during loading.
Published: Wednesday, October 18, 2023 – 12:02
An automobile manufacturer is taking advantage of this to improve the cycle time of its press lines. Together with the automaker, VMT Vision Machine Technic Bildverarbeitungssysteme from Mannheim, Germany, developed the robot-based 3D measuring system FrameSense for the fully automatic loading and unloading of containers. Pressed parts are thus safely and precisely inserted into or removed from containers. Four Ensenso 3D cameras from IDS Imaging Development Systems provide the basic data, and thus the platform for process automation.
Application
Robots do monotonous workflows and less pleasant, repetitive tasks with brilliance. Combined with image processing, they become “seeing” and reliable supporters of humans. They’re used in quality assurance to check components, help with assembling and positioning components, detect errors and deviations in production processes, and increase the efficiency of entire production lines.
The actual workflow that FrameSense is designed to automate is part of many manufacturing operations. A component comes out of a machine—here, a press—and runs on a conveyor belt to a container. There it’s stacked. As soon as the container is full, it’s transported to the next production step, e.g., assembly into a vehicle.
Quality Digest does not charge readers for its content. We believe that industry news is important for you to do your job, and Quality Digest supports businesses of all types.
Lukas Neumann from product management sees their added value especially here. “The high projector power and large sensor resolutions are particularly advantageous in the field of intralogistics,” he says. “Here, high-precision components have to be gripped from a great distance with a large measuring volume.”
Our PROMISE: Quality Digest only displays static ads that never overlay or cover up content. They never get in your way. They are there for you to read, or not.
The specifications of the Ensenso C correspond exactly to VMT’s requirements, as project manager and technology manager Andreas Redekop explains: “High projector performance and resolution together with fast data processing were our main technical criteria when selecting the camera. The installation in a fixed housing was also an advantage.”
Four Ensenso C cameras capture the contours of the stacking containers.
Outlook
By automatically loading and unloading containers along with the integrated 3D container inspection, manual workstations can be automated with the help of FrameSense. Against the background of the shortage of skilled workers, the system can make an important contribution to process automation in the automotive industry, among others. It meets the prevailing challenges of the industry. Ensenso C provides the crucial basis for data generation and exceeds the requirements of many applications.
For other stacking or bin-picking applications in classic logistics, he could imagine a similar camera with high projector power but lower resolution and fast recording. So, nothing stands in the way of further developments and automation solutions in conjunction with “seeing” robots.
So please consider turning off your ad blocker for our site.
On the camera side, VMT relies on Ensenso 3D cameras—initially on the X36 model. The current expansion stage of FrameSense is equipped with the Ensenso C variant. The reasons for the change are mainly the better projector performance, thanks to a new projection process, as well as a higher recording speed. In addition, the Ensenso C enables a larger measuring volume. This is an important criterion for FrameSense because the robot can only reach the containers to be filled up to a certain distance.
