Justin Bieber and Hailey Baldwin Register for Marriage License

Famous celebrity couple Justin Bieber and Hailey Baldwin were seen walking into a courthouse in New York City on Sept. 13, according to reports.

The 24-year-old musician and his 21-year-old model fiancée applied for a marriage license at the Marriage Bureau, according to a source who spoke with ET. The couple reportedly used a back office to fill out the registration form, so as not to draw too much attention to themselves.

Another source told ET the couple was not yet married, however, a religious source told PEOPLE that the couple were married that day.

Baldwin responded to the rumors on Twitter, saying, “I understand where the speculation is coming from, but I’m not married yet!”

A New York marriage license is typically valid 24 hours after being issued. However, a judge would be able to waive that waiting period upon request, reported ET.

The license is also good for 60 days total, so this means Beiber and Baldwin would have until November 13 for a public ceremony.

“They’re going to have a big blowout, in front of God and everyone they love,” the religious source told PEOPLE.

The news shocked fans on social media, especially since the couple has only been engaged since July.

Bieber announced their engagement on Instagram, writing, “My heart is COMPLETELY and FULLY YOURS and I will ALWAYS put you first! You are the love of my life Hailey Baldwin and I wouldn’t want to spend it with anybody else.”

“God’s timing really is literally perfect, we got engaged on the seventh day of the seventh month, the number seven is the number of spiritual perfection, it’s true GOOGLE IT! Isn’t that nuts? By the way I didn’t plan that, anyways My goodness does feel good to have our future secured!” he added.

Baldwin has already said she hired a wedding planner for the event and even ordered a custom wedding gown from a designer, according to The Cut.

“I think having it in the woods would be so beautiful,” she said. “My sister will be my bridesmaid. I was hers last year. And maybe Justin’s little sister as a flower girl.”

The bride-to-be also said her parents were supportive of the couple’s marriage plans.