Alzheimer's disease (AD) is an insidious and progressive neurodegenerative disease. The main pathological features of AD are the formation of amyloid-β deposits in the anterior cerebral cortex and hippocampus as well as the formation of intracellular neurofibrillary tangles. Thus far, accumulating evidence shows that glycation is closely related to AD. As a final product resulting from the crosslinking of a reducing sugar or other reactive carbonyls and a protein, the advanced glycation end products have been found to be associated with the formation of amyloid-β and neurofibrillary tangles in AD. As a saccharification inhibitor, the glyoxalase system and its substrate methylglyoxal (MG) were certified to be associated with AD onset and development. As an active substance of AGEs, MG could cause direct or indirect damage to nerve cells and tissues. MG is converted to D-lactic acid after decomposition by the glyoxalase system. Under normal circumstances, MG metabolism is in a dynamic equilibrium, whereas MG accumulates in cells in the case of aging or pathological states. Studies have shown that increasing glyoxalase activity and reducing the MG level can inhibit the generation of oxidative stress and AGEs, thereby alleviating the symptoms and signs of AD to some extent. This paper focuses on the relevant mechanisms of action of the glyoxalase system and MG in the pathogenesis of AD, as well as the potential of inhibiting the production of advanced glycation end products in the treatment of AD.