During the late l800's and the early part of the 20th century, immigrants from the Indian Subcontinent came to the Cape and settled in the lower part of District 6 at the foot of Table Mountain. By 1922, the community had grown considerably and a row of houses was purchased in Chapel Street with the aim of establishing a place of prayer in the area. By the 4th of March 1923, the building of the mosque was completed on the corner of Chapel and Muir Streets.

Within a short period, the community had grown to such an extent that the building proved to be inadequate in catering for the needs of the growing community. Several adjacent properties wm acquired by the Trustees of the masjid and plans were drawn up for a new and larger building to accommodate the aspirant spiritual, cultural, educational and social needs of the communities of District 6. In I 93 7, the old masjid was demolished and by the 5th of April I 938 a new and larger building was completed with the basement accommodating a madrassa and ladies prayer facility, the ground and mezzanine levels catering for the male prayer areas.

The Muir street masjid, being the largest masjid in the city, was a focal point of religious and cultural activities of the people of District 6. Situated in the city bowl close to the railway station and the harbour, the masjid had hosted many foreign dignitaries and guests as well as the many visitors to Cape Town from other provinces.

Among the illustrious and distinguished personalities who officiated as Imaams at the Muir street Mosque were Imaam Haffejee, Sheigh Abduragiem AI Iraqi, Ahmed Kajee Tankaria, Hafiz Umar Zardad, Imaam Achmat Talap, Sheigh Salie Abadar, Imaam Boeta Cassiem, Sheigh Abubakar Najaar (may Allah be pleased with them and grant them a lofty place in jannah). The late Adam Peerbhai, well known Islamic scholar and author of several books, also had his humble beginnings at this mosque.

In the 1960s, with the proclamation of District 6 as a White area, the evictions of the multicultural, diverse religious, racial and ethnic communities had begun, stripping the city of its most vibrant and colourful populace.

Today the only reminders of the existence communities in this part of the their places of worship.

In 1963, the Tabligh jamaat began their dawah work in the Western Cape from J Street Masjid. Today, Alhamdulillah, not only is it the local Markaz but also h international and foreign jamaats to the city.