It depends on the kid. I know of parents who their 4th grader went home alone because he wanted alone time to do homework and he did homework without problems. However, his brother didn't stay home till 7th grade when SACC ended
You'll know when it's time. don't worry about it now.