After the obvious attraction downwards the horse shoe builds up a gravitational reservoir, long before the horseshoe hangs horizontally the magnet 'fails'. This creates a horizontal sweep much like a pendulum and creates additional momentum.