A framework is presented for modeling the relational structure of concepts using item response theory (IRT) models with interactions between the items, so-called models with local item dependency (LID). The proposed approach works for unidimensional and multidimensional concepts. For the relational structure of a concept to be analyzed, two types of items are used: items that directly refer to the concept and items that refer to the underlying components. The dependencies (the LIDs) are included in the model to analyze the mutual relations between the components and between the components and the concept. In a study on guilt, it was found that a unidimensional model complemented with situation-specific dependencies could explain the data that were gathered. Because of its flexibility, the approach is a promising tool for a structural analysis of concepts.