Grapheme-color synesthetes experience a specific color when they see a grapheme but they do not report to perceive a grapheme when a color is presented. In this study, we investigate whether color can still evoke number-processes even when a vivid number experience is absent. We used color-number and number-color priming, both revealing faster responses in congruent compared to incongruent conditions. Interestingly, the congruency effect was of similar magnitude for both conditions, and a numerical distance effect was present only in the color-number priming task. In addition, a priming task in which synesthetes had to judge the parity of a colored number revealed faster responses in parity congruent than in parity incongruent trials. These combined results demonstrate that synesthesia is indeed bi-directional and of similar strength in both directions. Furthermore, they illustrate the precise nature of these interactions and show that the direction of these interactions is determined by task demands, not by the more vividly experienced aspect of the stimulus.