Camera System for an Automatic Placement Machine

The project consists of a sturdy structure that can be moved as a single unit. The camera uses a Raspberry Pi to calculate the centers of the components in real time and can provide both this information and a live feed through which these centers and their positions can be viewed. 

10/01/2023 - 03/14/2024

Camera System for an Automatic Placement Machine

Degree Program

ET - Discontinued

Project Description

The project consists of a sturdy structure that can be moved as a whole. The camera uses a Raspberry Pi to calculate the centers of the components in real time and can provide this information, as well as a live feed from which these centers and their positions can be retrieved.

The main objective of the project is to detect the centers of SMD resistors up to size 0603 (inches) in bulk using a camera. The setup is designed to allow for easy, user-friendly configuration and data retrieval. The lighting assists the camera in determining the component centers.

People Involved

Student group: Sebastian Summer, Manuel Melcher, Tobias Ruisinger, Michael Bablok

Advisor: Prof. Dr.-Ing. Christoph Zeuke

Course

Systems Engineering 1 (IK)

Duration

Winter Semester 2023/24

Requirements

Hardware:

  • Sturdy construction with maximum dimensions of 80 cm x 70 cm x 70 cm (WxHxD)
  • dimmable lighting for the bulk material
  • Camera height easily adjustable without tools

Software:

  • Web server with access to a live feed and position data
  • Marking of component centers
  • Calibration of lens distortion and standardization of pixel width

Implementation

The structure consists of

  • item profiles,
  • 3D-printed mounts,
  • a metal slide with fine adjustment, and
  • a base that can be easily removed.
  • A Raspberry Pi HQ camera
  • with a Pentax C-mount 35mm lens,
  • is processed by a Raspberry Pi, which handles component recognition.

It also sets up a local web server through which a live feed can be accessed and started, a JSON file containing the position data of recognized components is provided, and images can be downloaded.

The lighting can also be controlled, and calibration can be performed for the set camera height, which remains valid for subsequent images taken with the same camera settings. The latter also enables the standardization of pixel width and thus position by reading a known grid pattern.

The software is written in Python, and the main image processing library is OpenCV.

Uses

The data for the position can be transferred to another project for an automated placement machine, such as one with a suction cup arm.

Of course, when dealing with bulk material, the quantity can also be easily determined and used as a counter.

Integrating OCR would also enable component value recognition; the raw data in the Pi would allow for this, though the Pi itself lacks the processing power to handle it.

Other Projects at THA

A man wearing a helmet and carrying a leather shoulder bag is riding a bicycle

07/01/2026 - 06/30/2029

A2W

Active to Work - Active Commuting: Effects on Mental Health and the Role of Urban Environmental Factors

Discover project
Students wearing VR headsets

04/01/2026 - 04/30/2029

Gesellschaft • KI

AI-Supported, VR-Based German Language Learning for Future Professionals

The project “AI-Supported, VR-Based Skills Competition for Future Professionals in the Field of German as a Technical and Professional Language” addresses the ongoing shortage of skilled workers

Discover project

02/01/2026 - 01/31/2027

GeWo-Bay Study

An exploratory field study is examining health care for homeless people in Bavaria.

Discover project

02/01/2026 - 01/31/2029

Digitalisierung • Robotik

BOSDra

BOSDra is developing an automated first-response drone system for law enforcement and other organizations with security responsibilities (BOS).

Discover project
Ambulance Image

01/01/2026 - 12/31/2027

WARM Study

Effects of Environmental Factors on Acute and Chronic Wounds, Mental Health Conditions, and Social Factors Among People Experiencing Housing Crises in Augsburg

Discover project
Two field workers use an app on a construction site to install fiber-optic cables

01/01/2026 - 06/30/2027

Digitalisierung

DocPilot

Digital Data Management for Fiber-Optic Network Expansion

Discover project

01/01/2025 - 12/31/2026

Ressourceneffizienz • Wasser

Cost-Effective Upgrades to Wastewater Treatment Plants

Cost-Effective Upgrading of Wastewater Treatment Plants by Improving the Settling Properties of Activated Sludge

Discover project
Cover photo: DiPukS

08/01/2024 - 06/30/2027

Digitalisierung

DiPukS

Digital Planning Support for Climate-Neutral Urban Development

Discover project