It seems like a small thing maybe,
But it is always an extra click and drag first to get the roll off the black bar then click the blue added note removed.

So I would suggest: make quick double click on the black looper only piano roll and not add the note.