Chocolate Cookies Inspection 3D

1. In Workspace Explorer open workspace Examples and in Film strip window select ChocolateCookie dataset. Drag the Surface channel to the ACQUIRE section.

2. Add the CropSurface. Connect the output outSurface to the inSurface. Click on the filter and in Properties window in the bottom left corner and set the inZLimits.Min and the inZLimits.Max to 12 and 23 respectively. Set the inPreserveDimensions to True. That way points corresponding to the background and noise will be removed.

3. Add the CreateImageFromSurface_AnyScales filter to create an image of z-values of the given surface. It allows us to work with 2D tools, even though input data is 3D. Connect the outSurface to the inSurface. Click on the filter and in the Properties window and set the inPixelOffset to 0.

4. Now create a new step macrofilter which you can name e.g. "SegmentAndCountCookies". Connect the outImage and the outSurface to macrofilter inputs. Inside of the macrofilter, add the ExtractBlobs_Intensity.

5. Connect macrofilter input inImage to the inImage. Click on the filter and set these values in the Properties window:

   • the inThresholdParams.Polarity to Bright to extracts blobs brighter than background,
   • the inThresholdParams.Threshold to 1 to remove small noise,
   • the inSplittingParams.MinArea to 200000 so that only blobs of the area no lower than that are taken into account,
   • the inSplittingParams.MaxArea to 900000 so that only blobs of the area no greater than that are taken into account.

6. Next, add the ClassifyRegions filter. Connect the outBlobs to the inRegions. Click on the filter and in the Properties window set following parameters:

   • the inFeature to Rectangularity because we need to detect blobs that are rectangle-shaped,
   • the inMinimum to 0.8 to make sure that incorrect blobs are not accepted.

7. Add the RegionUnion_OfArray. Connect the outAccepted to the inArray.

8. Add the CropSurfaceToRegion filter to get a Surface representing only cookies, without points corresponding to the box. Connect the macrofilter inSurface input to the inSurface and the outRegion to the inRegion. Click on the filter and in the Properties window set the inPreserveDimensions to True.

9. Add an empty Formula and perform the following operations:

   • Add a new macrofilter input representing the number of cookies you are expecting to get (e.g. "inExpectedNumberOfCookies" of Integer type) and set its default value to 12. Connect it to the newly-created formula,
   • Right-click on the outAccepted output, select Property Outputs and choose the Count property. Connect it to the formula as inNumberOfCookies input,

   • Create a new output in the formula outIsCountOK like this:

     outIsCountOK = inExpectedNumberOfCookies == inNumberOfCookies

   • Connect the outIsCountOK output to the macrofilter outputs.

10. Go back to Main and create another step macrofilter (e.g. "FindSurfaceMinimalPoint"). Connect the outSurface from the SegmentAndCountCookies macrofilter to the newly-created macrofilter as an input.

11. Connect the outBlobs from the SegmentAndCountCookies macrofilter as an array connection. It will cause the macrofilter to execute in an array mode (see also: Arrays in Aurora Vision Studio).

12. Inside the macrofilter add the FillRegionHoles to extend the region so that it contains also the pixels previously lying in its holes. Connect the inRegion input to the inRegion.

13. Add the ErodeRegion to make the region thin enough to find later a minimal point representing the cookie hight. This step is essential since the cookies have rounded edges. Connect the outRegion from the previous filter to the inRegion of the current one. Set the inRadiusX to 30 to remove noise on edges.

14. Add the SurfaceMinimalPoint filter to get the minimal point of the surface within the region obtained in the previous step and connect the inSurface to the inSurface and the outRegion to the inRoi. Drag the outMinimalPoint output to the macrofilter outputs.

15. Go back to Main and create a new step macrofilter to create an individual local coordinate system for each cookie (you may call it e.g. "CreateLocalCoordinateSystem3D"). Connect outSurface and outBlobs from the SegmentAndCountCookies macrofilter to it as new inputs: inSurfaceFormat and inRegion (as an array connection) respectively. The macrofilter will be executed in the array mode as well as the FindSurfaceMinimalPoint macrofilter.

16. Inside the macrofilter, add the RegionBoundingBox_OrNil. Connect the inRegion to the inRegion.

17. Add the CreateCoordinateSystemFromRectangle filter to create an alignment for further analysis. Connect the outBoundingRectangle to the inRectangle.

18. Next, add the ConvertCoordinateSystem2DTo3D to convert image coordinate system into a 3D coordinate system, because they may not align unless the Surface format is given. Connect the outCoordinateSystem to the inCoordinateSystem. Then, connect the inSurfaceFormat to the inSurfaceFormat.

19. Drag the outCoordinateSystem output to the macrofilter outputs.

20. Go back to Main. Create another step macrofilter (e.g. "MeasureObjectDimensions"). Connect the outSurface from the SegmentAndCountCookies macrofilter and the outCoordinateSystem from the previous macrofilter to inputs of the current one as the inSurface and the inScanFieldAlignment respectively.

21. Inside of the macrofilter, add two MeasureObjectWidth3D filters and connect the inSurface and the inScanFieldAlignment to the inSurface and the inScanFieldAlignment in both filters.

22. Now click on the first filter and make the following changes in the Properties window:

    • Click on the inScanField and mark the scanning path to compute the height of the cookie,
    • Set the inScanCount to 10 to increase the number of scans to be performed,
    • Set the inScanWidth to 10 to increase the width of scanning field,
    • Set the inStripeScanParams.StripePolarity to Valid - to detect only actual points of the surface representing cookie,
    • Set the inMaxProfileGapWidth to 10 which will be the maximal allowed value of profile gap.

23. Click on the other MeasureObjectWidth3D filter and make the following changes in the Properties window:

    • Click on the inScanField and mark the scanning path to compute the width of the cookie,
    • Set the inScanCount to 10 to increase the number of scans to be performed,
    • Set the inScanWidth to 10 to increase the width of scanning field,
    • Set the inStripeScanParams.StripePolarity to Valid - to detect only actual points of the surface representing cookie,
    • Set the inMaxProfileGapWidth to 400 which will be the maximal allowed value of profile gap,
    • Set the inOutlierSuppression to Tukey which will be the best method to ignore incorrectly detected points in this case.

24. Connect both outObjectWidth outputs to the macrofilter outputs as the outVerticalDimension and the outHorizontalDimension respectively.

25. Add an empty Formula with the following inputs:

    • inMinVerticalDimension with a default value 7,
    • inMinHorizontalValue with a default value 39,
    • inMinHeight with a default value 17.

26. Create the following outputs in the formula:

    IsVerticalDimensionOK = VerticalDimension > inMinVerticalDimension

    IsHorizontalDimensionOK = HorizontalDimension > inMinHorizontalDimension

    IsHeightOK = SurfaceMinimalPoint > inMinHeight

    InspectionResult = IsVerticalDimensionOK and IsHorizontalDimensionOK and IsHeightOK

Macrofilter Main

Macrofilter CreateLocalCoordinateSystem3D

Macrofilter FindSurfaceMinimalPoint

Macrofilter MeasureObjectDimensions

Macrofilter SegmentAndCountCookies