[dbmnt]

Someone provided the solution in another comment.

After pinning the extension, click on it and deselect the "enabled" option (the line with the purple X). This will kill the floating orb UI but you can still click on the extension in the toolbar to use it.