Skip to main content

RobCo Studio

In RobCo Studio, new projects can be trained and deployed to the vision controller. To do this, you need to upload either a CAD model and select a texture or upload images of the part you want to pick. The pose estimation models will be trained automatically, and you will be notified once the training is complete and the models are deployed to the Vision Controller.

Train new vision projects​

  1. Access RobVision: Open RobCo Studio and navigate to the RobVision section.
  2. Add Project: Click Add Project to begin adding a new object.
  3. Configure Project: Name the project and choose the project type. CAD picking project enables you to upload a 3D file of the part. With label picking you can upload images of the part you want to pick.
    1. Upload CAD Model: Upload the CAD model file (either .obj or .step format).
    2. Define camera facing orientation: In the visualizer, rotate the part to define the surface that will face the camera during operation. Ensure the desired camera-facing surface is clearly visible.
    3. Select Texture/Color: Choose a texture or color for the part.

Uploading a CAD model and defining the camera facing orientation

  1. Upload Images: Upload images showing the parts. One or more images per class are possible.
  2. Label: Click on the object to auto-label. If the auto-label is not perfect, use the brush tool to adjust the label. You can only label one object per image.
  3. Enter Info: Enter class name and object size.

Labelling a part and entering class name and object size

  1. Advanced Settings: Configure advanced Settings as described below
  2. Confirm Addition: Click Add to confirm the part details.
  3. Start Training: A new entry for the part will appear in the list. Select the part and click Start Training to begin the model training process.

If the trained model does not detect all parts reliably after deployment, a possible improvement is to add hand-labeled real world data. The process is described here.

Advanced Settings​

The standard training setup should suffice in most cases. In rare cases you can configure the following setups:

Activate flip: trains the rotation model from top and bottom side, useful when those sides differ a lot (only CAD picking)

Keep Texture: Keeps the texture of the 3D object, instead of overwriting it with the chosen texture. Works only with .glb files that contain a texture (only CAD picking)

Part Symmetry: Limits the angle the rotation model is trained on, when the part is symmetric in a way that it repeats itself after a certain angle (e.g. 90° for a cube)

Resolution Angle: The resolution with which the rotation model is going to be trained

Deploy model​

  1. Verify Connectivity: Ensure the Robot's Control Unit has a stable internet connection and is properly connected to the RobVision Device, as previously configured.
  2. Select Project: In RobCo Studio, click on the specific part you wish to deploy.
  3. Initiate Deployment: Click the Deploy button.
  4. Choose Control Unit: Select the serial number of the target Control Unit to which you want to deploy the part.

Deploying a model to a control unit