The USCCB has dedicated a page on its website listing news stories of vandalism by month.
Unknown perpetrators entered the church without any problem, as the place of worship is open every day.
The 22-year-old was arrested on Saturday and detained for further questioning.
Vandalism followed revelations of unmarked graves at residential schools
The culprit, who already had a criminal record, will be brought before the criminal court as part of an accelerated procedure.
According to the police it seems that the perpetrators were not looking for money.
The vandalism comes four days after the Supreme Court allowed a Texas law banning most abortions after six weeks into a pregnancy.