California did much the same to us, too. We left in 2010 and in 2012 or 2013 they sent a couple jerks from their Franchise Tax Board
to our home in Wyoming to demand that we prove that we lived in Wyoming.

My advice is to contact both your local law enforcement and your state's attorney general should they ever try doing this with you.