In recent years, transformer has become an effective tool for fault diagnosis, but it has been shown that a sufficient amount of labeled data is usually required to train a transformer model. However, ...