There were lots of pagan Kaabas in Arabia, long before Muhammad adopted and then adapted the Kaaba Inc. built by Yemeni immigrants in Mecca in the early 5th century AD.
http://islamchristianforum.com/index.php?topic=1079.0
http://www.youtube.com/watch?v=K4dKABzonoY