Glass is actually a non-viscous liquid. It does weaken over time but I think it is a LONG time. I would think that in your lifetime you will NOT see a failure unless it is an external event such as a rapid cooling from hot or dropping the bottle.
Even if a glass bottle drops and does not break, there can be small fissures around that are not visible. I would not keep any bottles that hit something and do not break. Maybe that is overkill, but just saying.