They used to. Before the Kabba I believe Muslims used to make pilgrimage to the Dome of Rock aka Al Aqsa in Jerusalem. Abraham and Ishmael built the Kabba and then afterwards it became a part of one's duty as a Muslim, if they can, to make pilgrimage to Hajj. The direction in which Muslims pray is called the Qibla, towards the direction of Mecca, but before that it was Jerusalem/Temple Mount just like Jews. It also holds a high significance to Muslims since the Quran states that that's where Muhammad ascended to heaven with the angel Gabriel, and he was joined by previous prophets and messengers like Abraham, Moses, and Jesus to pray. I believe the story is called "Al-Isra Wal Miraj".
But the point is they don't anymore.