Warning

You are reading the documentation for an older Pickit release (2.2). Documentation for the latest release (3.4) can be found here.

Build a showcase demo with a M-camera and suction cup

This article will guide you in setting up a simple showcase demo with Pickit and a UR that you can show at trade fairs. For this demo a Pickit M camera is used to detect round boxes of cheese in a bin. The parts are picked from the bin with a UR5 robot and a vacuum cup. A video of the end result can be seen below.


Requirements

The list below shows the different hardware that has been used to set up this demo.

  • Pickit system with M camera

  • Mounting plate to mount camera on to the robot

  • UR5 robot

  • Stand to mount the robot on

  • Schmalz Vacuum gripper ECBPi 12 24V-DC M12-8, 15 cm extended with vacuum cup SPB4f 40

  • Bin with size 400 x 300 x 120 mm

  • Round boxes of cheese ø110 mm and height 20 mm

  • Stand of the same height of the bin to drop off the parts, in this demo a similar bin has been put upside down

Mounting instructions

  • The robot is mounted on the stand.

  • The camera is mounted on the robot flange of the robot with the help of a mounting plate.

  • The vacuum gripper is mounted on the robot flange beneath the camera. The distance between the end effector of the vacuum and the mounted camera should be bigger than the depth of the bin. In the example the bin is 120 mm deep and the distance between the end effector and camera is 150 mm.

  • The bin is placed at a distance of 700 mm (center of robot base to center of bin) and is placed 200 mm lower than the robot.

  • The drop off stand is placed next to the bin in between the bin and the robot.

../_images/teach-m-demo-cheese-general.png

Setting up the Pickit files

Here you can download a snapshot of the demo. In the snapshot you can see that the boxes are detected by using the Teach detection engine with a single model.

Setup file

For this demo the Region of Interest (ROI) has similar dimensions as the real bin, the set ROI is slightly smaller and slightly higher. Last, the ROI box is attached to the Robot base frame. No other settings are used for this demo.

Need help with these settings? See the Region of Interest article for more information.

Product file

The model that is being used is the shape from the top, which is a circle. The pick point of this model is located in the center of the circle. The matching score and tolerance is set to 90% and 1.5 mm. No fusion or downsampling is applied and the detection speed is set to Fast.

Need help with these settings? See the Teach article for more information.

In the Picking page, the pick point has flexible pick orientation enabled, set to allow tilting 20° in XY (due to the compliant gripper bellows) plus full rotation about Z (due to the part’s circular symmetry). This setting will favor picking parts vertically from the top, and will reduce robot wrist motions, hence yielding faster cycle times and less likelihood of cable entanglement problems. No other settings in the Picking page are being used for this demo.

Need help with these settings? See the Picking article for more information.

Calibration

Next step is the robot-camera calibration. This process teaches Pickit where the robot base is located w.r.t. to the camera. This information is used to transform the object pick points into robot coordinates. A detailed description in robot-camera calibration can be found in the article Calibration.

Setting up the robot program

Here you can download the UR robot program. The idea of the program is to pick 3 boxes from the bin and drop these in a line. Once three boxes are picked they are pushed back in the bin. Then these steps are repeated.

../_images/teach-m-demo-cheese-ur-program.png

The following still needs to be defined in this robot program:

  • Pickit select command, the correct setup and product file need to be filled in.

  • Above_bin is a fixed waypoint on the center top of the bin. This intermediate waypoint is used to get in to and to get out of the bin.

  • In the picking sequence the vacuum needs to be set to active.

  • The dropping sequence uses a pallet function. Here the StartPos_1 and Endpos_1 are defined 280 mm apart from each other. The Approach_1 and Exit_1 are the same and are defined 100 mm above the PatternPoint_1. In this dropping sequence the vacuum is also turned off.

  • The pushing sequence pushes the boxes back into the bin. Here the StartPos_2 and Endpos_2 are also defined 280 mm apart from each other. The Approach_2, PatternPoint_2 and Exit_2 waypoints are defined as shown below.

../_images/teach-m-demo-cheese-pushing-sequence.png

  • The detect_pose is a waypoint defined 700 mm above the bin, this is also the starting position of the program.

Interaction with the running demo

This demo is robust and will keep on working continuously. After a while it could be that always the same 3 boxes are picked and pushed back in.

Interaction with the scene is possible when the robot just picked a box and is dropping it off. If the robot moves to the top of the bin to look for new objects the scene can’t be changed anymore.

Parts can be placed under angles. If the surface is tilted less than 30 degrees the robot will still pick them. If they are steeper than 30 degrees the parts can still be detected but will be labeled unpickable, due to the angle.