In his most celebrated essay, Portrait du colonisé précédé de portrait du colonisateur (1957), Albert Memmi affirmed that racism illustrates, summarizes, and symbolizes the colonial relation. It is remarkable that in his Portrait du décolonisé arabo-musulman et de quelques autres (2004), a companion text to his first work, Memmi almost intentionally refuses to use racism as an analytical tool in examining the fate of Arab Muslim immigrés. How can we make sense of this almost total absence of racism in his analysis in spite of multiple practices of racialization at every level of daily life of immigrés? Contrary to the commonly held view of young radical metamorphosing into old reactionary, or radical discontinuity of Memmi’s thinking, I will argue that in his initial conceptualization of racism in context of colonialism, Memmi seems to fail to grasp the important aspect of European colonial racism, “racial historicism.” This failure is partly due to Memmi’s tendency of absolutizing the element of “difference” in conceptualizing racism and also to his eurocentric conception of history.