"We are thrilled," the couple told Us Weekly in a statement about their baby girl, who weighed in at 6 lbs., 2 ozs. "Mother and child are in excellent health."
The happy news had a bittersweet twist, however, when the couple also revealed they lost Faith’s twin brother early in Kayte’s pregnancy.
"This was not something we cared to make known publicly at the time. It was unspeakably painful and we know that people will understand our desire to keep the news private then, as we know they will respect our privacy in this matter now."
The statement continued, "A glorious birth with a lingering sadness is ours today. We choose to celebrate the life that has been given us. We proudly announce Faith to the world today looking forward to the days ahead and the children yet to come."
The Grammers were married in February 2011.
Actor Kelsey Grammer and wife Kayte celebrated the newest addition to their family on Friday, a baby girl named Faith Evangeline Elisa.