If you are thinking a small caliber would be best you might consider stepping it up yo a 22 magnum22lr will most definitely kill deer. It is legal in NC as a deer round.
For SHTF, nothing better than the 22. You can slip 100 rds into any pocket and be able to defend or forage for days.