Determining carbohydrate structures, such as their compositions, linkage positions, and in particular the anomers and stereoisomers, is a great challenge. Isomers of different anomers or stereoisomers have the same sequences of chemical bonds, but have different orientations of some chemical bonds which are difficult to be distinguished by mass spectrometry. Collision-induced dissociation (CID) tandem mass spectroscopy (MS/MS) is a widely used technique for characterizing carbohydrate structures. Understanding the carbohydrate dissociation mechanism is important for obtaining the structural information from MS/MS. In this work, we studied the CID mechanism of galactose-N-acetylgalactosamine (Gal-GalNAc) and glucose-N-acetylglucosamine (Glc-GlcNAc) disaccharides with 1→3 and 1→4 linkages. For Gal-GalNAc disaccharides, the CID mass spectra of sodium ion adducts show significant difference between the α- and β-anomers of GalNAc at the reducing end, while no difference in the CID mass spectra between two anomers of Glc-GlcNAc disaccharides was found. Quantum chemistry calculations show that for Gal-GalNAc disaccharides, the difference of the dissociation barriers between dehydration and glycosidic bond cleavage is significantly small in the β-anomer compared to that in the α-anomer; while these differences are similar between the α- and β-anomers of Glc-GlcNAc disaccharides. These differences can be attributed to the different orientations of hydroxyl and N-acetyl groups located at GalNAc and GlcNAc. The calculation results are consistent with the CID spectra of isotope labelled disaccharides. Our study provides an insight into the CID of 1→3 and 1→4 linked Gal-GalNAc and Glc-GlcNAc disaccharides. This information is useful for determining the anomeric configurations of GalNAc in oligosaccharides.