Glory,’ the song Jay-Z wrote for his baby Blue Ivy, made its live debut Monday night during the rapper’s performance at Carnegie Music Hall. The setting for the debut could not have been more majestic, with a huge symphony backing up the tuxedo-wearing rapper in the legendary theater.

“One hand in the air for Blue!,” Jay shouted as the song began. He had the crowd captivated as he rapped the tender love song to his daughter with the memorable line, “My greatest creation was you.”

“All the proud parents in the house tonight make some noise!,” he commanded as the song drew to a close, adding, “I didn’t think I was gonna make it through that one. That was tough.”

Blue’s mom Beyonce was in attendance, making her first post-baby public appearance. The concert was one of two performances Jay-Z is making this week at Carnegie Hall to benefit the Shawn Carter Scholarship Foundation and the United Way of NYC.

MTV reports that Jay played many of his greatest hits, including ‘Hard Knock Life,’ ‘Izzo’ and ‘Encore.’ He also brought out Alicia Keys for ‘Empire State of Mind’ and played his encore from the balcony, where he traded in the tux for a t-shirt and baseball cap and finished with some of his early songs.

Watch Jay-Z Perform ‘Glory’ at Carnegie Hall