The Castle of Silves is a castle in the civil parish of Silves in the municipality of Silves in the Portuguese Algarve. It's believed that the first fortifications were built upon a possible Lusitanian castro, by the Romans or Visigoths.