Just from my own reading about stuff, I don't think you get into "too long" until it's double digit weeks long, lol.
Someone will correct me if I'm wrong but I think 3 weeks is said to be enough in most cases if you don't use a secondary, but 4 definitely wouldn't be too much.