The memo was written after Comey had dinner with Trump one evening. It was not a scheduled business meeting - it was an after hours dinner Trump wanted. After Comey left, he made a personal note of the encounter. The note was his, not the governments. If one says this was secret information, then anyone who speaks to the president cannot make a note as every utterance of the President is secret.