Street accessibility varies depending on jurisdictions. Georgia law allows for incorporated towns and municipalities to adopt ordinances pertaining to ATVs, so you will need to check on a case-by-case basis. Keep in mind that riding an ATV on public roads could be dangerous, as they are not built for pavement.
Check out these Elberton, GA ATV/OHV resources: