Previous research has shown that object recognition from different viewpoints often yields strong effects of viewpoint. However, for some objects and experimental paradigms almost complete viewpoint invariance is obtained. This suggests the existence of multiple routes to object recognition. In this study we further strengthen this notion by designing two different conditions using the same experimental paradigm (simultaneous matching) and highly similar objects (multiblock figures). In the first condition (involving a handedness violation), strong effects of viewpoint were obtained. In the second condition (involving an invariance violation), the effects of viewpoint were negligible. This result illustrates that asking under what circumstances object recognition is viewpoint dependent or independent is more fruitful than attempting to show that object recognition is either viewpoint dependent or independent.