gloves wont help much.
but i can hols the magnet in my hand even without gloves - its really hard to grab it wrong or get too close because it will hurt any you (actuelly me xd) wil pull your hand away automatically like on a hot plate.
if i just hold it on the shielded side or on the metal screw on top its not an issue. i never accidentally hurted myself bad while magnetfishing.
just take care of the metal shards that you will find with the magnet. there gloves will help 