It is widely accepted that associative recognition can be supported by familiarity through integrating more than two stimuli into a unit, but the role of unitization in recollection-based associative recognition remains unclear. In this study, we aimed to illustrate how the level of unitization (LOU) affected recollection-based associative recognition and to examine whether the unitization–congruence between original and rearranged picture pairs (UC) could have effect on the relationship between LOU and associative recognition. In encoding, participants were asked to learn related and unrelated picture pairs, and in retrieval, they needed to distinguish intact pairs from rearranged pairs. We also distinguished the LOU of the pairs based on its status at encoding or retrieval separately. The results showed that: (1) LOU-at-encoding could improve associative recognition through increasing recollection-based associative recognition selectively; (2) LOU-at-retrieval could improve associative recognition through increasing familiarity-based and recollection-based associative recognitions; (3) UC did not moderate the relationship between LOU and associative recognition. Hence, in future studies, researchers do not need to pay much attention to the construction of rearranged pairs to ensure that the LOU between original and rearranged picture pairs is matched. It greatly reduces the difficulty of materials selection.