The village of Skrilje lies in the central part of the Vipava Valley on the sunny area at the foot of Mala Gora (1034) and Kucelj  (1237), at the edge of Čaven (1185). The village was inhabited already in the 11th century.
Skrilje is a compacted settlement with coastal region-karst characteristics. The level above the sea at the Church of St. Margaret (Sv Marjeta) is 160 metres. The village is divided into three smaller villages: Valiči, Ruštji, Bajči. To Valiči joins the small village of Kisel hrib. Through the village flow several streams which unite into the Skrivšek, which continues its way towards Dobravlje and flows into the Vipava river.