Positioning/Alignment

Positioning/alignment

Positioning/alignment is another process for which image processing has been introduced, alongside inspections for quantity and presence of parts and products, appearance (foreign particles, flaws), and dimensions (length, diameter). Positioning/alignment using image processing systems has been introduced for a variety of purposes:

  • Positioning of glass substrates
  • Measurement of misalignment of labels or barcodes
  • Checking the orientation of IC chips
  • Checking for misaligned lids on food containers
  • Position control of machine tools (Vision-guided robots)

This section introduces the basic principles and specific applications of positioning and alignment using image processing.

Basic principle of positioning/alignment for detecting position using image processing

To achieve quick and reliable positioning

To improve the efficiency of production processes, it is necessary to instantaneously detect the positional relationship between the target and machine tool or table and control the system carefully. Poor detection accuracy may lead to defective workpieces. If there is a time lag between detection and control, productivity may decrease. Accurate and quick positioning/alignment is essential for factory automation (FA). Image processing has been increasingly used to achieve it.

Problems in positioning/alignment

Production of LCD panels requires high-accuracy positioning for processes such as glass or film lamination. Although image processing systems have become common in recent years, they had several problems:

  • Positioning using image processing systems required too much time and labor for calibration.
  • The process functioned as a black box, so it was difficult to add functions and the process lacked versatility.
  • Expert knowledge was needed to achieve high-accuracy and high-speed positioning.
  • Positioning could not satisfy the required accuracy so the uses were limited.

In recent years, these problems have been overcome owing to Auto-calibration, which completes calibration automatically, and improved accuracy of the alignment for guiding the system to an accurate position.

Flow of positioning using image processing

The first important point is to understand the flow of positioning/alignment that takes advantage of image processing. There may be some variations in the flow depending on the image processing system. This section introduces the basic flow of positioning using KEYENCE's “XG-X Series” with an example of glass lamination.

Auto-calibration

Detect the position of an alignment mark by pattern search (search processing) or other method and calculate the stage axis direction and rotation center position.

Reference position registration

Register the destination to which the target will be moved.

Alignment

Measure the position of the target and calculate the amount of correction to reach the reference position.

Positioning

Feed back the calculated position information to a PLC or other host system and control the stage to perform positioning.

定位

Advantages of positioning using image processing

Introducing image processing systems to positioning/alignment offers multiple advantages:

High-accuracy position detection through pattern search

Pattern search (search processing) is a technique that is indispensable for positioning/alignment using image processing. Pattern search automatically detects reference images or patterns (marks), known as alignment or positioning marks. Using lens distortion correction and filters improves the accuracy of position detection.

Lens distortion correction
Lens distortion correction Before correction/After correction Perspective distortion correction Before correction/After correction

Before correction

Lens distortion correction Before correction/After correction Perspective distortion correction Before correction/After correction

After correction

Perspective distortion correction
Lens distortion correction Before correction/After correction Perspective distortion correction Before correction/After correction

Before correction

Lens distortion correction Before correction/After correction Perspective distortion correction Before correction/After correction

After correction

Auto-calibration for improving takt

Conventional coordinate-based position control had problems such as misalignment of the target and table and detection accuracy, which prevented ideal detection of position/angle. In recent years, the accuracy of the auto-calibration has improved greatly owing to advances in pattern search (search processing) technology. Automatic high-speed high-accuracy calibration is now possible, resulting in improved takt.

Accurate control supported by high-accuracy detection using image processing

Alignment marks can now be detected with high accuracy by using high-pixel-count machine vision and improved image processing technologies. ShapeTrax is KEYENCE's profile search technology which provides the highest accuracy in the industry. It allows position detection with an accuracy of 0.025 pixels for both linearity and repeatability.

Linearity data

In addition to detecting alignment marks, position detection can be achieved flexibly according to the needs of each application even without alignment marks. Methods to achieve this include detection of a virtual intersection at the corner of a PCB or positioning based on a wafer notch.

Detection of a virtual intersection at the corner of a PCB

Detection of a virtual intersection at the corner of a PCB

Positioning based on a wafer notch

Positioning based on a wafer notch

Positioning/alignment achieved with ultra-high-pixel-count cameras

KEYENCE offers ultra-high-pixel-count cameras with 21 megapixels that provide the best solution in the industry. Commonly-used cameras with fewer pixels such as 0.3 or 2 megapixels have the problems shown below. Ultra-high-pixel cameras can eliminate these issues.

Have you ever suffered from these problems?
Products with many rounded sections cannot be detected stably because of unstable detection of corners.

Conventional

When a rounded surface is large, the straight section is too short to detect the corner stably.
Some products have no straight section to use for detection.

When a 21 megapixel camera is used to capture the entire image of the product

From now on

The entire image of the product can be captured while conventional accuracy is maintained.
This allows high accuracy detection of the profile of the entire shape, even when the product has a complex shape.

When a 21 megapixel camera is used to capture the entire image of the product, even complexed profiles can be detected with high accuracy. This ensures stable and accurate alignment of products regardless of their shapes.

Changeover requires lot of labor because different products are manufactured on the same line.

Conventional

The dimensions of products change frequently. This requires labor to change the layout for each changeover.

When a 21 megapixel camera is used to capture the entire image of the product

From now on

No layout change is necessary for changeover.
The camera can be fixed to the same position, which makes the mechanism simple.

To satisfy the required accuracy with a low-resolution camera, the field of view should be set smaller. Consequently, when different products are manufactured on the same line, the layout of the camera must be changed for each changeover. When a 21 megapixel camera is used to capture the entire image of the product, the labor for the changeover is no longer necessary. The camera can be fixed in the same position, which makes production system simpler. Moreover, two or more products can be inspected simultaneously.

Appearance/dimension inspection using image processing is performed in a separate process from alignment.

Conventional

Appearance or dimension inspection is performed in a separate process from alignment.
This requires building a large-scale system.

When a 21 megapixel camera is used to capture the entire image of the product

From now on

Appearance or dimension inspection of the product as a whole can be performed simultaneously with alignment.

There are still many cases where appearance or dimension inspection is performed in a different process from alignment. When a 21 megapixel camera is used to capture an image of the entire product, alignment and appearance inspection of the product as a whole can be performed simultaneously. This leads to streamlining of the production facility.

Practical applications

The precision of products is increasing and high accuracy is required for production processes. It is also necessary to increase productivity to improve yield rate. To satisfy these requirements, there is an increasing demand for positioning and alignment that take advantage of image processing systems. The following are some introduction examples that take advantage of image processing and calibration.

Sensing guide holes during car body assembly

Industrial robots are indispensable for production processes including welding, handling, and assembly. Conventional systems required tricky coordinate teaching for origin setting and positioning. Fine adjustment may be required depending on the product or individual differences. Positioning/calibration using image processing can solve these problems. In the assembly process for doors or other heavy parts, image processing can be used to recognize guide holes and control the robot. This makes the production faster and more reliable. KEYENCE also proposes vision-guided robot solutions for industrial robots.

About Vision-Guided Robots

Misalignment of patterns

For wafers used in semiconductor device manufacturing, pattern misalignment on the order of micrometers may become fatal defects. Position information regarding defects must be obtained through detection using an instrument such as optical microscopes. For example, when the XG-X Series which supports 21 megapixel color cameras is used, misalignment of patterns or positions including the rotation direction of wafers can be detected accurately.

Assembly of electronic components

As smartphones and tablets are designed to be more compact, the need for high assembly accuracy in the electronic device industry is increasing. The XG-X Series supports 21 megapixel color cameras with high resolution and high field of view that provide the maximum number of pixels in its class. It enables clear detection of the details of chips and achieves high-accuracy alignment. It allows accurate assembly of even minute parts such as electronic components.

Assembly of electronic components
Assembly of electronic components
21 megapixel camera

Capabilities of a 21 megapixel camera
A large capacity image of 21 million effective pixels (5104 x 4092 pixels) can be transmitted quickly at 16x speed, in just 110 ms. This allows detection of minute defects and details of large targets, which were impossible with conventional cameras.

0.31 megapixel

The entire image looks blurred and nothing can be identified

5 megapixels

The profiles of chips appear blurred and accurate detection is difficult.

21 megapixels

Everything is clear including the details, so accurate judgment is possible.