Chromosome rearrangements may distort 3D chromatin architectures and thus change gene regulation, yet how 3D chromatin structures evolve in insects is largely unknown. Here, we obtain chromosome-level genomes for four butterfly species, Graphium cloanthus, Graphium sarpedon, Graphium eurypylus with 2n = 30, 40, and 60, respectively, and Papilio bianor with 2n = 60. Together with large-scale Hi-C data, we find that inter-chromosome rearrangements very rarely disrupted the pre-existing 3D chromatin structure of ancestral chromosomes. However， some intra-chromosome rearrangements changed 3D chromatin structures compared to the ancestral configuration. We find that new TADs and subTADs have emerged across the rearrangement sites where their adjacent compartments exhibit uniform types. Two intra-chromosome rearrangements altered Rel and lft regulation，potentially contributing to wing patterning differentiation and host plant choice. Notably ，butterflies exhibited chromatin loops between Hox gene cluster ANT-C and BX-C ，unlike Drosophila. Our CRISPR-Cas9 experiments in butterflies confirm that knocking out the CTCF binding site of the loops in BX-C affected the phenotypes regulated by Antp in ANT-C ，resulting in legless larva. Our results reveal evolutionary patterns of insect 3D chromatin structures and provide evidence that 3D chromatin structure changes can play important roles in the evolution of traits.