There's one key factor in it:
Between Quebec and New York lies the Mohawk Indian Reservation. They make it virtually impossible to maintain any usable border security there without whining over their sovereignty rights. So all the smugglers go through the Rez. It's a long-established hole in the border.