Deep learning for automated image analysis

Reliable results thanks to artificial intelligence

One of the greatest challenges in modern microscopy is image segmentation, in which an image is divided into different areas. Experience and a trained eye are required to recognize the many different areas of an image - or an artificial intelligence (AI) specially trained for this purpose.

Deep learning, a method of machine learning, can quickly detect the smallest errors and deviations that the human eye might miss. This allows you to speed up and improve your image analysis with little effort. Use the software capabilities of ZEISS to create reproducible, scalable and automatic routines. Increase the quality of your results and products.

Use the potential of deep learning for your image processing with ZEISS ZEN Intellisis:

  • Automated and manufacturer-independent analysis of images from a wide range of imaging systems in 2D and 3D
  • Reproducible and scalable automated segmentation of 2D and 3D content
  • Significant minimization of evaluation time through deep learning
  • Simple cloud-based interface to train and create AI models
  • Image segmentation of complex images from 2D and 3D imaging with one click, either in the cloud or locally
  • Expert knowledge can be easily shared across the organization by reusing the trained AI model

The challenge of image segmentation

Image segmentation is used to analyze images taken with a microscope. Segmentation refers to the division of images into specific areas that are important for subsequent analysis and classification. Such an area could be, for example, a defect or contamination on the surface of a component, as well as the detection of different material layers. During the subsequent analysis of the images and classification of the recognized areas, the areas themselves and the boundary between different areas are considered. This enables accurate results to be delivered and errors to be detected.

However, traditional methods of segmentation, such as thresholding (gray value analysis), quickly reach their limits.

The gray levels of the areas can be difficult to distinguish if they have a similar color and brightness. Users are also faced with the question of which features in the image are relevant, e.g. color, texture or edges, in order to identify objects and areas in an image.

It is also important to know how to combine the features in order to discover objects and classes. The more classes are added when processing an image, the more complex the task becomes. The search for scratches on displays for electrical appliances is also a challenge that is difficult to solve with rule-based analyses - because every scratch is different in size, has its own shape and can occur on the entire surface. Image processing with deep learning is the right solution here.

The challenge of image segmentation
The challenge of image segmentation

SEM (scanning electron microscope) image of a PCB contact with AI image segmentation

How does deep learning help with image processing?

Machine learning and deep learning are used when conventional methods for image segmentation are not sufficient. The trainable system consists of neural networks in which all relevant information for image processing is stored. Technically, it is crucial to correctly differentiate between the different areas and characteristics in order to create an optimal analysis and achieve precise and reproducible results.

A training model is created to teach the AI how to analyze images. Certain areas are marked on an image (or on several images) by assigning different colors to different features that are important for quality assurance. The AI learns the properties of the areas or features and creates its own algorithm for classification. The algorithm is then applied to the remaining image data that has not yet been marked or colored. The AI learns independently which features it needs to pay particular attention to in connection with a certain class. The more training data or sample images are analyzed, the more accurate the algorithm becomes.

Your advantages with AI-based image processing

If the segmentation of the entire image data is not optimal, the annotations and their parameters can be retrained. In this way, the AI learns new characteristics and can revise the algorithm - until precise results are achieved. This optimized model can then be automatically applied to all image data of the same type taken under the same imaging conditions, e.g. under the microscope. This results in many advantages:

  • Fast, automated segmentation and analysis

  • Precise results and reliable detection of faults

  • High reproducibility

  • Simple adaptation of the algorithm

Exploit the potential of artificial intelligence

ZEISS ZEN Intellesis with Deep Learning enables automated image processing in the laboratory, in development, quality assurance and in production-related analysis systems. Modern and future-oriented companies use deep learning to ensure reproducibility and accuracy in analysis. Test the entire ZEISS ZEN core suite including ZEN Intellesis now for up to 60 days free of charge and without obligation.

Which data records can be evaluated by an AI?

In general, all scaled 2D and 3D data sets can be assessed, for which ZEISS relies on powerful AI tools. Here you can see which formats can be analyzed by an AI, which functions are possible and whether the format is well suited for image processing with deep learning.

Manufacturer / Format

File extension

Pixel value transfer

Metadata transfer

FEI TIFF

.tiff

●●●○

●●●○

Hitachi S-4800

.txt, .tif, .bmp, .jpg

●●●○

●●●○

IMAGIC

.hed, .img

●●●○

●●●○

JEOL

.dat, .img, .par

●●○○

●○○○

JPEG

.jpg

●●●○

●●●○

Leica LCS LEI

.lei, .tif

●●●●

●●●●

Leica LAS AF LIF (Leica Image File Format)

.lif

●●●●

●●●●

Nikon Elements TIFF

.tiff

●●○○

●●○○

Olympus SIS TIFF

.tiff

●●○○

●●○○

Oxford Instruments

.top

●●○○

●○○○

Tagged Image File Format)

.tiff, .tif, .tf2, .tf8, .btf

●●●○

●●●●

Other formats available on request!

automatic and intelligent image analysis with AI

What is the goal of automatic and intelligent image analysis with AI?

The main goal is to replace manual image analysis processes with automatic routines in order to make them reproducible and scalable. This saves time and money and also prevents a subjective assessment. This is because every person makes their decision a little differently, so that different segmentations arise or errors can be overlooked or classified as within tolerance. In addition, AI-based image processing and analysis makes it easy to spread expert knowledge throughout your own organization. This increases the quality of our own products and also the reproducibility of the results.

Try out ZEN core

Simply register and test ZEN core free of charge - without any contractual obligation. Get to know our image analysis and machine learning tools in up to 60 days.

Form is loading...

If you want to have more information on data processing at ZEISS please refer to our data privacy notice.