New South Wales began registering births in 1856, following British colonial practices. Earlier records can be found in church registries, especially for Anglican and Catholic congregations.
The NSW Registry of Births, Deaths, and Marriages holds these records, with access restricted for 100 years