It's not a matter of religious freedom. You don't get to do whatever you want just because it's your religion.
Blasting prayers over loudspeakers five times a day would irritate the hell out of me whatever religion was doing it.
As I have said multiple times, as long as mosques are subject to the same noise ordinances as churches' bells and loud worship music, it is a religious freedom issue. Because Islam is a religion.