This is how great civilizations throughout history have ended.
People assume it was due to conquest, but it was actually often simply too much prosperity leading to low birth rate and population collapse, which ultimately enabled them to be conquered.