One of the main topics within the empirical sociology of culture and taste is the effect of cultural socialisation. In line with the theoretical insights of Pierre Bourdieu, much research has been done on the influences of the different socialization agents on cultural taste and cultural participation behaviour. Sometimes the family seems to be the principal cultural socialization agency, whereas other research points to the importance of school and education or of doing cultural activities at an early age. All in all, cultural socialization proves to be a complex process in which it is difficult to disentangle the respective impact of the different socialization agencies. In this article we elaborate on the complexity of the cultural socialization process. Using data from a representative large-scale survey on cultural participation in Flanders (Belgium), we first construct a cultural participation typology of the Flemish population between 18 and 79 years old and compare it with an already existing typology based on other Flemish survey data. We find that a five cluster segmentation fits our data best. The five participation clusters differ in participation frequency and breath of participation. For each one of these five different participation clusters, we examine the influence of parental educational capital, of the respondent’s educational capital, and of the respondent’s cultural activities at an early age. Our results show that, besides the expected importance of one’s own educational capital, being culturally active at an older age is primarily influenced by being oneself culturally active at an early age. Neither visiting legitimate or illegitimate cultural activities between 12 and 14 years old, nor doing this within the context of family or school, has a major influence on the later participation behaviour.