Abstract: The neural network of bilateral attention, especially Bidirectional Encoder Representations from Transformers (BERT), has achieved good results since its appearance, and has obtained high ...