While reps for Usher and Foster were not immediately available for comment, one source says Usher was with his wife and new child Tuesday at an Atlanta hospital, and the family is expected to head home on Wednesday.
No other details were available.
Usher, 29, and Foster, 36, announced the pregnancy in June. In September, Usher told PEOPLE that they were expecting a boy, and added, "I just want my son to fully be coherent and to be healthy, first and foremost."
The couple were married in a quiet civil ceremony in Atlanta on Sept. 1.