The Surat castle is one of the ancient monuments of 16th century existing in the city and bears a significant relevance to its history. However, such a great fortification built to provide the citizens of Surat with an adequate defence against the attacks of the invaders seems to have been forgotten from the minds of the present generation. The Ahmedabad king Sultan Mahmood-III (1538-1554), who was very much annoyed by these frequent destructions of Surat, ordered for building a very strong castle and entrusted the work to Safi Agha, a Turkish soldier who had been ennobled with the title of Khudawand Khan. The work of building the castle was completed in 1546. After the capture of Surat by the emperor Akbar (1573) the fortress remained in the charge of commandants appointed from Delhi till it was seized by the Sidhi admiral of the Mugal fleet in 1751. The Sidhi did not hold the castle for long period, as it was captured by the English in 1759 with rest of the city. Though from the first practically independent, the English held the castle nominally under the Mugal. In token of this divided command, two flags waved from the castle walls, the English ensign on the south-west, and the Moorish standard on the south-east bastion. This practice was continued till, in 1842, on the death of the last of the nawabs of Surat, the English fleet was removed from the Tapi, and the Moorish standard taken down from the castle walls. Though, as a defence against any well-equipped enemy, they have long been useless, the castle buildings initially were being kept in repair, and until the year 1862, were garrisoned by a small body of European and native troops. In that year, as no longer required, the force was withdrawn, and the vacated rooms were made over for the accommodation of the various offices connected with the revenue and police departments, in whose occupation the castle has since remained.