Ibn al-Zubayr initiates the rebuilding of the Kaaba after the Umayyads' departure from Mecca, but most of the people, led by Ibn Abbas, had abandoned the city fearing divine retribution; it is only when Ibn al-Zubayr himself begins to demolish the remains of the old building, that they are encouraged to return and aid him.

Ibn al-Zubayr's reconstruction changes the original plan, incorporating modifications that Muhammad himself is reported to have intended, but which had not been not carried out during Muhammad's lifetime for fear of alienating the recently converted Meccans.

The new Kaaba is built entirely of stone—the old one was of alternating layers of stone and wood—and has two doors, an entrance in the east and an exit in the west.

In addition, he includes the semicircular hatīm wall into the building proper.

The three fragments of the Black Stone are bound in a silver frame, and placed by Ibn al-Zubayr inside the new Kaaba.

After the Umayyad reconquest of the city eight years later, the hatīm will be separated again from the main building, and the western gate will be walled up, reverting to the general outlines of the pre-Islamic plan.

This is the form in which the Kaaba has survived to this day.